00000001:02000400:1.0F:1788834799.805615:0:3289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_hostid 00000001:02000400:1.0:1788834809.953122:0:3491:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local 00000001:01000000:1.0:1788834811.949842:0:3553:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 500 MB/s 00000001:01000000:1.0:1788834812.199675:0:3553:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 703 MB/s 00000001:01000000:2.0F:1788834812.449385:0:3553:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 4039 MB/s 00000020:02000000:3.0F:1788834813.303042:0:3583:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_108_g4a8ba26 00000400:02000000:1.0:1788834814.455487:0:3598:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.122@tcp [8/256/0/180] 00008000:02000000:0.0F:1788834818.073750:0:3747:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1788834877.527356:0:5715:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788834891.079677:0:6464:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788834891.079687:0:6464:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788834891.079688:0:6464:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788834891.079850:0:6464:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 0000000033650400 00000080:02000400:1.0:1788834891.079863:0:6464:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1788834891.098839:0:6464:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1788834891.098859:0:6464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788834891.098913:0:6464:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000007cd6dc7a) 00000020:00000080:1.0:1788834891.098940:0:6464:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:0.0:1788834891.190186:0:6464:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1788834891.190301:0:6464:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00080000:01000000:0.0:1788834891.222104:0:6464:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788834891.222411:0:6464:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:0.0:1788834891.222558:0:6464:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788834891.222575:0:6464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf60171e5a5d162d 00000020:01000004:0.0:1788834891.222585:0:6464:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:0.0:1788834891.222590:0:6464:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:0.0:1788834891.222595:0:6464:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000033650400 from MGS 00000020:01000004:0.0:1788834891.222601:0:6464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:0.0:1788834891.222626:0:6464:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000f6f58ef9) 00000020:00000080:0.0:1788834891.222641:0:6464:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:0.0:1788834891.222772:0:6464:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000033650400 from MGS, refs=2 00080000:01000000:0.0:1788834891.222778:0:6464:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788834891.222784:0:6464:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf60171e5a5d163b 00000100:00100000:0.0:1788834891.223040:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:0.0:1788834891.223188:0:6464:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:0.0:1788834891.223194:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1788834891.223999:0:6464:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1788834891.224007:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1788834891.225202:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788834891.225658:0:6464:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1788834891.225666:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1788834891.226264:0:6464:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1788834891.226273:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1788834891.227019:0:6464:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1788834891.227029:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1788834891.232219:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834891.232227:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834891.232229:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834891.232770:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834891.232773:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834891.232775:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834891.233709:0:6464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1788834891.238552:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:3.0:1788834891.486570:0:6464:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3229 MB/s 00000001:01000000:2.0:1788834891.741453:0:6464:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3050 MB/s 00000001:01000000:3.0:1788834891.992088:0:6464:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 403 MB/s 00000001:01000000:3.0:1788834892.241816:0:6464:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 723 MB/s 00080000:10000000:3.0:1788834892.248577:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00010000:00010000:0.0:1788834892.263416:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:2.0:1788834892.264219:0:6464:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788834892.266808:0:6479:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:2.0:1788834892.266845:0:6464:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:2.0:1788834892.267160:0:6464:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:2.0:1788834892.267388:0:6464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:2.0:1788834892.267412:0:6464:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:2.0:1788834892.267831:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788834892.268153:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:2.0:1788834892.268159:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1788834892.269163:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1788834892.269172:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788834892.269596:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788834892.269603:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788834892.270353:0:6464:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788834892.270372:0:6464:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.122@tcp' 00000020:01000004:2.0:1788834892.270373:0:6464:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788834892.270414:0:6464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.122@tcp (typ=mgc) 00000020:00000080:2.0:1788834892.270433:0:6464:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.122@tcp (00000000aa25b82c) 00000020:00000080:2.0:1788834892.270449:0:6464:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788834892.270548:0:6464:0:(ldlm_lib.c:102:import_set_conn()) imp 000000000d09fb8b@MGC192.168.203.122@tcp: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1788834892.270712:0:6464:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.122@tcp-0 is initialized 00000040:01000000:2.0:1788834892.270720:0:6464:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 1 is initialized 00000100:00080000:1.0:1788834892.273573:0:6484:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1788834892.273585:0:6485:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788834892.273730:0:6464:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.122@tcp (uuid 5f0122c5-c616-4176-9ca1-6fdce4068f64) 00000020:00000080:2.0:1788834892.273754:0:6464:0:(genops.c:1385:class_connect()) connect: client 5f0122c5-c616-4176-9ca1-6fdce4068f64, cookie 0xdf60171e5a5d1649 00000100:00080000:2.0:1788834892.273766:0:6464:0:(import.c:510:import_select_connection()) MGC192.168.203.122@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788834892.273777:0:6464:0:(import.c:624:import_select_connection()) MGC192.168.203.122@tcp: import 000000000d09fb8b using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788834892.273818:0:6464:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000257af892 x1875729253924992/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788834892.274077:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000257af892 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5f0122c5-c616-4176-9ca1-6fdce4068f64:3613:1875729253924992:0@lo:250: 00000100:00100000:1.0:1788834892.274200:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788834892.274264:0:6464:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 5f0122c5-c616-4176-9ca1-6fdce4068f64->MGS 00000020:01000004:2.0:1788834892.274284:0:6464:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788834892.274308:0:6464:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788834892.274343:0:6464:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000035612de9) 00000020:00000080:2.0:1788834892.274355:0:6464:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1788834892.277393:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253924992 00000100:00100000:1.0:1788834892.277408:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253924992 00000100:00100000:1.0:1788834892.277492:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788834892.277499:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079cd4680 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3613:x1875729253924992:12345-0@lo:250: 00010000:00080000:1.0:1788834892.277529:0:6481:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 5f0122c5-c616-4176-9ca1-6fdce4068f64@0@lo t0 exp 0000000000000000 cur 134 last 0 00000020:00000080:1.0:1788834892.277554:0:6481:0:(genops.c:1385:class_connect()) connect: client 5f0122c5-c616-4176-9ca1-6fdce4068f64, cookie 0xdf60171e5a5d1657 00000100:00080000:1.0:1788834892.277760:0:6481:0:(import.c:65:import_set_state_nolock()) 00000000db2a3c17 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788834892.278969:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079cd4680 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+5:3613:x1875729253924992:12345-0@lo:250: Request processed in 1465us (4765us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834892.278982:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788834892.279034:0:3613:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.122@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1788834892.279044:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.122@tcp: connect to target with instance 0 00000100:00080000:1.0:1788834892.279060:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.122@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1788834892.279065:0:3613:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1788834892.279069:0:3613:0:(import.c:65:import_set_state_nolock()) 000000000d09fb8b MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1788834892.279072:0:3613:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1788834892.279080:0:3613:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1788834892.279086:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000257af892 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5f0122c5-c616-4176-9ca1-6fdce4068f64:3613:1875729253924992:0@lo:250: 00000100:00100000:3.0:1788834892.307430:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788834892.308201:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1788834892.308208:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1788834892.309431:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1788834892.309442:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788834892.309890:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788834892.309899:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1788834892.313503:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788834892.313730:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1788834892.313737:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788834892.315403:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788834892.315415:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788834892.384972:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788834892.385216:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788834892.385223:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1788834892.389288:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1788834892.389957:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788834892.403824:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788834892.404016:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788834892.404022:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1788834892.405135:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788834892.405145:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788834892.406145:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788834892.406377:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788834892.406383:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1788834892.407913:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1788834892.407924:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788834892.411933:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788834892.412162:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788834892.412169:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788834892.425700:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788834892.425714:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1788834892.473137:0:6464:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788834892.474735:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1788834892.474745:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788834892.480311:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788834892.480349:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788834892.481911:0:6464:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788834892.481924:0:6464:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788834892.491095:0:6464:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788834892.491127:0:6464:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788834892.491134:0:6464:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788834892.491376:0:6464:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788834892.491561:0:6464:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.122@tcp, index=0000, flags=0x20065 00000020:01000004:2.0:1788834892.491565:0:6464:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788834892.491566:0:6464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788834892.491567:0:6464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788834892.491568:0:6464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788834892.491569:0:6464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788834892.491574:0:6464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788834892.491574:0:6464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788834892.491575:0:6464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788834892.491577:0:6464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788834892.491577:0:6464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788834892.491578:0:6464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788834892.491579:0:6464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788834892.491581:0:6464:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:2.0:1788834892.491582:0:6464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788834892.491583:0:6464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788834892.491584:0:6464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788834892.491584:0:6464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788834892.491585:0:6464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788834892.491585:0:6464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788834892.491586:0:6464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788834892.491586:0:6464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788834892.491587:0:6464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788834892.491587:0:6464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788834892.491588:0:6464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788834892.491588:0:6464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788834892.491619:0:6464:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788834892.491634:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ee0351d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253925120:0@lo:253: 00000100:00100000:2.0:1788834892.491696:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834892.491741:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 0000000093dc21e1 going to sleep for 11 seconds 00000100:00100000:3.0:1788834892.494705:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253925120 00000100:00100000:3.0:1788834892.494723:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253925120 00000100:00100000:3.0:1788834892.494829:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788834892.494840:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f855a8fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+5:6464:x1875729253925120:12345-0@lo:253: 20000000:01000000:3.0:1788834892.494908:0:6483:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788834892.494912:0:6483:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:3.0:1788834892.496709:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1788834892.496793:0:6483:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1788834892.497093:0:6483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788834892.498856:0:6504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1788834892.499179:0:6483:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1788834892.499183:0:6483:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1788834892.499189:0:6483:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1788834892.499191:0:6483:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1788834892.499215:0:6483:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1788834892.499420:0:6483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788834892.499609:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1788834892.499625:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788834892.499644:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1788834892.499661:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1788834892.499675:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1788834892.499726:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1788834892.499735:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1788834892.499747:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1788834892.499751:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1788834892.499762:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1788834892.499766:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1788834892.499777:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1788834892.499792:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1788834892.499819:0:6483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1788834892.499823:0:6483:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1788834892.499830:0:6483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788834892.499921:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1788834892.499931:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1788834892.499947:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1788834892.499963:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1788834892.499977:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1788834892.499986:0:6483:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1788834892.500027:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1788834892.500037:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788834892.500050:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1788834892.500064:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1788834892.500078:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1788834892.500087:0:6483:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1788834892.500111:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1788834892.500120:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1788834892.500141:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1788834892.500156:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1788834892.500210:0:6483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1788834892.500231:0:6483:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788834892.500238:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:3.0:1788834892.509152:0:6505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:1.0:1788834892.514130:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:1.0:1788834892.514163:0:6483:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.122@tcp for mdt 20000000:01000000:1.0:1788834892.514166:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:1.0:1788834892.514184:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:1.0:1788834892.514191:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1788834892.514206:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:1.0:1788834892.514212:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:1.0:1788834892.514226:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:1.0:1788834892.514234:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788834892.514248:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:1.0:1788834892.514264:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:1.0:1788834892.514298:0:6483:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788834892.514301:0:6483:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788834892.514305:0:6483:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788834892.514768:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788834892.514771:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1788834892.519359:0:6506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:1.0:1788834892.519786:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1788834892.519832:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:1.0:1788834892.519852:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:1.0:1788834892.519863:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788834892.519866:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1788834892.521706:0:6507:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1788834892.521963:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1788834892.521994:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1788834892.522011:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1788834892.522024:0:6483:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788834892.522026:0:6483:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:0.0:1788834892.522031:0:6483:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788834892.522033:0:6483:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1788834892.522038:0:6483:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1788834892.522045:0:6483:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788834892.522868:0:6508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:1.0:1788834892.522999:0:6483:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1788834892.537696:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:1.0:1788834892.537873:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:1.0:1788834892.537887:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:1.0:1788834892.537907:0:6483:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1788834892.537932:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000066795f7f/0xdf60171e5a5d165e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834892.537951:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000066795f7f/0xdf60171e5a5d165e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834892.537961:0:6483:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000066795f7f/0xdf60171e5a5d165e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834892.537967:0:6483:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000066795f7f/0xdf60171e5a5d165e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834892.537973:0:6483:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000066795f7f/0xdf60171e5a5d165e lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834892.537979:0:6483:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000066795f7f/0xdf60171e5a5d165e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834892.537985:0:6483:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000066795f7f already unused, calling callback (00000000a5212b7f) 00010000:00010000:1.0:1788834892.537988:0:6483:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000066795f7f/0xdf60171e5a5d165e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834892.537994:0:6483:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000066795f7f/0xdf60171e5a5d165e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834892.538005:0:6483:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000066795f7f/0xdf60171e5a5d165e lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834892.538011:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000066795f7f/0xdf60171e5a5d165e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834892.538025:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000066795f7f/0xdf60171e5a5d165e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788834892.538049:0:6483:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1788834892.567532:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f855a8fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+5:6464:x1875729253925120:12345-0@lo:253: Request processed in 72683us (75824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834892.567617:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788834892.568165:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ee0351d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253925120:0@lo:253: 10000000:01000000:2.0:1788834892.568187:0:6464:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788834892.568190:0:6464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788834892.568192:0:6464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788834892.568193:0:6464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788834892.568195:0:6464:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:2.0:1788834892.568196:0:6464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788834892.568197:0:6464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788834892.568198:0:6464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788834892.568199:0:6464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788834892.568201:0:6464:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1788834892.568203:0:6464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788834892.568204:0:6464:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788834892.568241:0:6464:0:(tgt_mount.c:101:server_register_mount()) register mount 0000000033650400 from lustre-MDT0000 10000000:01000000:2.0:1788834892.568277:0:6464:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788834892.568280:0:6464:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788834892.568284:0:6464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9afdab4bb370 10000000:01000000:2.0:1788834892.568289:0:6464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788834892.568298:0:6464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9afdab4bb370 from 1 10000000:01000000:2.0:1788834892.568301:0:6464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788834892.569875:0:6464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000fde59cc2/0xdf60171e5a5d1665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.569906:0:6464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000fde59cc2/0xdf60171e5a5d1665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.569917:0:6464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000fde59cc2/0xdf60171e5a5d1665 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834892.569942:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ee0351d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253925248:0@lo:101: 00000100:00100000:2.0:1788834892.570031:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834892.570092:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f949666 going to sleep for 11 seconds 00000100:00100000:0.0:1788834892.570139:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253925248 00000100:00100000:0.0:1788834892.570152:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253925248 00000100:00100000:0.0:1788834892.570218:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788834892.570227:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008806b688 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+5:6464:x1875729253925248:12345-0@lo:101: 00010000:00010000:0.0:1788834892.570244:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788834892.570264:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d166c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1665 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834892.570291:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d166c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1665 expref: 6 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834892.570303:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d166c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1665 expref: 6 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834892.570312:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b86c7e54, rc 0) 00000100:00100000:0.0:1788834892.570414:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008806b688 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+6:6464:x1875729253925248:12345-0@lo:101: Request processed in 188us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834892.570421:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788834892.571691:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ee0351d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253925248:0@lo:101: 00010000:00010000:2.0:1788834892.571718:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000fde59cc2/0xdf60171e5a5d1665 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d166c expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.571731:0:6464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000fde59cc2/0xdf60171e5a5d1665 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d166c expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834892.571817:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ee0351d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253925376:0@lo:501: 00000100:00100000:2.0:1788834892.571877:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834892.576685:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253925376 00000100:00100000:1.0:1788834892.576703:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253925376 00000100:00100000:2.0:1788834892.576705:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f949666 going to sleep for 11 seconds 00000100:00100000:1.0:1788834892.576793:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788834892.576804:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f417b916 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+6:6464:x1875729253925376:12345-0@lo:501: 00000100:00100000:1.0:1788834892.576967:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f417b916 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+6:6464:x1875729253925376:12345-0@lo:501: Request processed in 165us (5090us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788834892.576976:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788834892.577151:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ee0351d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253925376:0@lo:501: 10000000:01000000:2.0:1788834892.577216:0:6464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788834892.577243:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000fde59cc2/0xdf60171e5a5d1665 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d166c expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.577255:0:6464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000fde59cc2/0xdf60171e5a5d1665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d166c expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834892.577266:0:6464:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9afd85554000 10000000:01000000:2.0:1788834892.577272:0:6464:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788834892.577278:0:6464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9afd85554000 10000000:01000000:2.0:1788834892.577281:0:6464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788834892.577283:0:6464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9afd85554000 from 1 10000000:01000000:2.0:1788834892.577286:0:6464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788834892.577356:0:6464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 0000000052fc6f58/0xdf60171e5a5d1673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.577363:0:6464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 0000000052fc6f58/0xdf60171e5a5d1673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.577375:0:6464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 0000000052fc6f58/0xdf60171e5a5d1673 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834892.577395:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ee0351d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253925504:0@lo:101: 00000100:00100000:2.0:1788834892.577484:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834892.577518:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f949666 going to sleep for 11 seconds 00000100:00100000:0.0:1788834892.577541:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253925504 00000100:00100000:0.0:1788834892.577549:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253925504 00000100:00100000:0.0:1788834892.577607:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788834892.577615:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000686a805b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+6:6464:x1875729253925504:12345-0@lo:101: 00010000:00010000:0.0:1788834892.577627:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788834892.577649:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004053fb42/0xdf60171e5a5d167a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1673 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834892.577674:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004053fb42/0xdf60171e5a5d167a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1673 expref: 7 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834892.577684:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004053fb42/0xdf60171e5a5d167a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1673 expref: 7 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834892.577694:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004053fb42, rc 0) 00000100:00100000:0.0:1788834892.577739:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000686a805b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+7:6464:x1875729253925504:12345-0@lo:101: Request processed in 124us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834892.577745:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788834892.577999:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ee0351d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253925504:0@lo:101: 00010000:00010000:2.0:1788834892.578016:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 0000000052fc6f58/0xdf60171e5a5d1673 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d167a expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.578043:0:6464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 0000000052fc6f58/0xdf60171e5a5d1673 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d167a expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834892.578063:0:6464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788834892.578068:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 0000000052fc6f58/0xdf60171e5a5d1673 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d167a expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.578075:0:6464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 0000000052fc6f58/0xdf60171e5a5d1673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d167a expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834892.578082:0:6464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788834892.578087:0:6464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788834892.578092:0:6464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9afd85554000 10000000:01000000:2.0:1788834892.578095:0:6464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788834892.578099:0:6464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788834892.578102:0:6464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788834892.578126:0:6464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 000000005bd45f2e/0xdf60171e5a5d1681 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.578133:0:6464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 000000005bd45f2e/0xdf60171e5a5d1681 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.578140:0:6464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 000000005bd45f2e/0xdf60171e5a5d1681 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834892.578156:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ee0351d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253925632:0@lo:101: 00000100:00100000:2.0:1788834892.578214:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834892.578239:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f949666 going to sleep for 11 seconds 00000100:00100000:2.0:1788834892.578268:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253925632 00000100:00100000:2.0:1788834892.578279:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253925632 00000100:00100000:2.0:1788834892.578312:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788834892.578365:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d24a3a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+7:6464:x1875729253925632:12345-0@lo:101: 00010000:00010000:2.0:1788834892.578374:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788834892.578698:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000b9bf444d/0xdf60171e5a5d1688 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1681 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.578718:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b9bf444d/0xdf60171e5a5d1688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1681 expref: 8 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.578727:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000b9bf444d/0xdf60171e5a5d1688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1681 expref: 8 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.578734:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000b9bf444d, rc 0) 00000100:00100000:2.0:1788834892.578892:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d24a3a1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+8:6464:x1875729253925632:12345-0@lo:101: Request processed in 534us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834892.578899:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788834892.586389:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ee0351d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253925632:0@lo:101: 00010000:00010000:0.0:1788834892.586433:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 000000005bd45f2e/0xdf60171e5a5d1681 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1688 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834892.586451:0:6464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 000000005bd45f2e/0xdf60171e5a5d1681 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1688 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834892.586738:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059757893 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253925760:0@lo:501: 00000100:00100000:1.0:1788834892.586816:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834892.586891:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000de7f6229 going to sleep for 11 seconds 00000100:00100000:0.0:1788834892.590207:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253925760 00000100:00100000:0.0:1788834892.590253:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253925760 00000100:00100000:0.0:1788834892.590675:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788834892.590687:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cd918e8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+8:6464:x1875729253925760:12345-0@lo:501: 00000100:00100000:0.0:1788834892.591294:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cd918e8c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+9:6464:x1875729253925760:12345-0@lo:501: Request processed in 607us (4476us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834892.591303:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788834892.596481:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059757893 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253925760:0@lo:501: 00000100:00100000:1.0:1788834892.596634:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059757893 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253925888:0@lo:503: 00000100:00100000:1.0:1788834892.596739:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834892.596905:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000de7f6229 going to sleep for 11 seconds 00000100:00100000:2.0:1788834892.604020:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253925888 00000100:00100000:2.0:1788834892.604048:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253925888 00000100:00100000:3.0:1788834892.608636:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788834892.608652:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000127432af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+9:6464:x1875729253925888:12345-0@lo:503: 00000100:00100000:3.0:1788834892.608945:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000127432af pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+9:6464:x1875729253925888:12345-0@lo:503: Request processed in 296us (12206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834892.608953:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788834892.616157:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059757893 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253925888:0@lo:503: 00000100:00100000:0.0:1788834892.617068:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb2ba8c4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:6509:1875729253926016:0@lo:502: 00000100:00100000:0.0:1788834892.617156:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834892.617525:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 0000000025ff2a4a going to sleep for 11 seconds 00000100:00100000:1.0:1788834892.619927:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253926016 00000100:00100000:1.0:1788834892.619949:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253926016 00000100:00100000:1.0:1788834892.620038:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788834892.620049:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009f71e756 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+9:6509:x1875729253926016:12345-0@lo:502: 00000100:00100000:1.0:1788834892.620286:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009f71e756 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+9:6509:x1875729253926016:12345-0@lo:502: Request processed in 238us (3129us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834892.620294:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788834892.621068:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb2ba8c4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:6509:1875729253926016:0@lo:502: 00000020:01000000:0.0:1788834892.621116:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788834892.621133:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788834892.621137:0:6509:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788834892.621144:0:6509:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788834892.621147:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788834892.621177:0:6509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (0000000095db07e8) 00000020:00000080:0.0:1788834892.621207:0:6509:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788834892.621214:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788834892.621354:0:6509:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788834892.621362:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf60171e5a5d1696 00000020:00000080:0.0:1788834892.621769:0:6509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788834892.621774:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788834892.621779:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788834892.621781:0:6509:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788834892.621784:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788834892.621788:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788834892.621789:0:6509:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788834892.621792:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788834892.621802:0:6509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (000000001421c88c) 00000020:00000080:0.0:1788834892.621813:0:6509:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788834892.621822:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788834892.621824:0:6509:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788834892.621827:0:6509:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788834892.621834:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788834892.621894:0:6509:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000033650400 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788834892.621908:0:6509:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000001dd5cac3) 00000020:00000080:0.0:1788834892.621916:0:6509:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788834892.621984:0:6509:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788834892.621999:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf60171e5a5d16ab 00000020:00000080:0.0:1788834892.622092:0:6509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788834892.622099:0:6509:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788834892.622104:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdf60171e5a5d16b2 00080000:01000000:0.0:1788834892.622110:0:6509:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788834892.622113:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf60171e5a5d16b9 00080000:10000000:0.0:1788834892.626044:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:0.0:1788834892.627405:0:6509:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1788834892.640159:0:6509:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1788834892.780261:0:6509:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1788834892.781279:0:6509:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1788834892.792745:0:6509:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1788834892.793101:0:6509:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788834892.805122:0:6509:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000009804feb1) 00000020:00000080:2.0:1788834892.805155:0:6509:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1788834892.805235:0:6509:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788834892.805244:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf60171e5a5d16c7 00000020:00000080:3.0:1788834892.816693:0:6509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:0.0:1788834892.821272:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00080000:10000000:0.0:1788834892.832943:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00080000:10000000:0.0:1788834892.836987:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:10000000:0.0:1788834892.842915:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00080000:10000000:0.0:1788834892.845957:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00080000:10000000:2.0:1788834892.852693:0:6509:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00000020:00000080:2.0:1788834892.858978:0:6509:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdf60171e5a5d16ce 00000020:00000080:0.0:1788834892.860485:0:6509:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788834892.860500:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788834892.860508:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788834892.860511:0:6509:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788834892.860514:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788834892.860519:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788834892.860520:0:6509:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788834892.860523:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788834892.860525:0:6509:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788834892.860527:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788834892.860540:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788834892.860542:0:6509:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788834892.860545:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788834892.860550:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788834892.860551:0:6509:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788834892.860554:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788834892.860666:0:6509:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:0.0:1788834892.860729:0:6509:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb2ba8c4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:6509:1875729253926144:0@lo:502: 00000100:00100000:1.0:1788834892.861482:0:6509:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834892.861534:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253926144 00000100:00100000:2.0:1788834892.861545:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253926144 00000100:00100000:1.0:1788834892.861597:0:6509:0:(client.c:2715:ptlrpc_set_wait()) set 000000005b1ddc6b going to sleep for 11 seconds 00000100:00100000:2.0:1788834892.861657:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788834892.861666:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000047249b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+9:6509:x1875729253926144:12345-0@lo:502: 00000100:00100000:2.0:1788834892.861995:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000047249b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+9:6509:x1875729253926144:12345-0@lo:502: Request processed in 329us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834892.862004:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788834892.862962:0:6509:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb2ba8c4 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:6509:1875729253926144:0@lo:502: 00000020:01000000:1.0:1788834892.863006:0:6509:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788834892.863014:0:6509:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788834892.863017:0:6509:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:1.0:1788834892.863021:0:6509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:2.0:1788834892.863501:0:6464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:2.0:1788834892.863526:0:6464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788834892.863544:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 000000005bd45f2e/0xdf60171e5a5d1681 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1688 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.863556:0:6464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 000000005bd45f2e/0xdf60171e5a5d1681 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1688 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834892.863564:0:6464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afd85554000 from 1 10000000:01000000:2.0:1788834892.863567:0:6464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788834892.865793:0:6464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 000000006f6b0fed/0xdf60171e5a5d16d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.865813:0:6464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 000000006f6b0fed/0xdf60171e5a5d16d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.865823:0:6464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 000000006f6b0fed/0xdf60171e5a5d16d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834892.865850:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db86a644 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253926272:0@lo:101: 00000100:00100000:2.0:1788834892.865922:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834892.865972:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000788172b9 going to sleep for 11 seconds 00000100:00100000:3.0:1788834892.865998:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253926272 00000100:00100000:3.0:1788834892.866009:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253926272 00000100:00100000:3.0:1788834892.866065:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788834892.866075:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000596b0bb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+9:6464:x1875729253926272:12345-0@lo:101: 00010000:00010000:3.0:1788834892.866092:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788834892.866109:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003e82e6ae/0xdf60171e5a5d16dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d16d5 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834892.866138:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003e82e6ae/0xdf60171e5a5d16dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d16d5 expref: 10 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834892.866150:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003e82e6ae/0xdf60171e5a5d16dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d16d5 expref: 10 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834892.866729:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003e82e6ae, rc 0) 00000100:00100000:3.0:1788834892.866839:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000596b0bb7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+10:6464:x1875729253926272:12345-0@lo:101: Request processed in 766us (917us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834892.866847:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788834892.866929:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db86a644 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253926272:0@lo:101: 00010000:00010000:2.0:1788834892.867028:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 000000006f6b0fed/0xdf60171e5a5d16d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d16dc expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.867053:0:6464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 000000006f6b0fed/0xdf60171e5a5d16d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d16dc expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834892.867821:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db86a644 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253926400:0@lo:256: 00000100:00100000:2.0:1788834892.867872:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834892.868457:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000788172b9 going to sleep for 11 seconds 00000100:00100000:3.0:1788834892.870921:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253926400 00000100:00100000:3.0:1788834892.870936:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253926400 00000100:00100000:3.0:1788834892.871004:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788834892.871014:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006cb8ea6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+10:6464:x1875729253926400:12345-0@lo:256: 20000000:01000000:3.0:1788834892.871044:0:6481:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1788834892.871051:0:6481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1788834892.871626:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006cb8ea6b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+10:6464:x1875729253926400:12345-0@lo:256: Request processed in 611us (3751us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834892.871635:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788834892.871746:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db86a644 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253926400:0@lo:256: 10000000:01000000:0.0:1788834892.872803:0:6464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788834892.872824:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 000000006f6b0fed/0xdf60171e5a5d16d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d16dc expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834892.872837:0:6464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 000000006f6b0fed/0xdf60171e5a5d16d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d16dc expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788834892.872846:0:6464:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afd85554000 from 1 10000000:01000000:0.0:1788834892.872848:0:6464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788834892.872889:0:6464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000fac15cb5/0xdf60171e5a5d16e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834892.872897:0:6464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000fac15cb5/0xdf60171e5a5d16e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834892.872906:0:6464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000fac15cb5/0xdf60171e5a5d16e3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834892.872925:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c353905d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253926528:0@lo:101: 00000100:00100000:0.0:1788834892.872977:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834892.873401:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253926528 00000100:00100000:3.0:1788834892.873409:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253926528 00000100:00100000:0.0:1788834892.873482:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a5c5009d going to sleep for 11 seconds 00000100:00100000:3.0:1788834892.873644:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788834892.873656:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000078bee8cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+10:6464:x1875729253926528:12345-0@lo:101: 00010000:00010000:3.0:1788834892.873673:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788834892.873690:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000036725224/0xdf60171e5a5d16ea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d16e3 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834892.873717:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000036725224/0xdf60171e5a5d16ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d16e3 expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834892.873728:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000036725224/0xdf60171e5a5d16ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d16e3 expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834892.873751:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000036725224, rc 0) 00000100:00100000:3.0:1788834892.873811:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000078bee8cf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+11:6464:x1875729253926528:12345-0@lo:101: Request processed in 157us (834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834892.873817:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788834892.873922:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c353905d pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253926528:0@lo:101: 00010000:00010000:2.0:1788834892.873938:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000fac15cb5/0xdf60171e5a5d16e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d16ea expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.873945:0:6464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000fac15cb5/0xdf60171e5a5d16e3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d16ea expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834892.874009:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000feedb68f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253926656:0@lo:501: 00000100:00100000:2.0:1788834892.874040:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834892.874296:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000788172b9 going to sleep for 11 seconds 00000100:00100000:3.0:1788834892.874449:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253926656 00000100:00100000:3.0:1788834892.874454:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253926656 00000100:00100000:3.0:1788834892.874538:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788834892.874546:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005c7a8c31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+11:6464:x1875729253926656:12345-0@lo:501: 00000100:00100000:3.0:1788834892.874724:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005c7a8c31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+11:6464:x1875729253926656:12345-0@lo:501: Request processed in 179us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834892.874732:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788834892.874805:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000feedb68f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253926656:0@lo:501: 00000100:00100000:3.0:1788834892.874856:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000006c29b1c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253926784:0@lo:503: 00000100:00100000:3.0:1788834892.875723:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834892.875762:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000edd7e9d9 going to sleep for 11 seconds 00000100:00100000:1.0:1788834892.875794:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253926784 00000100:00100000:1.0:1788834892.875802:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253926784 00000100:00100000:1.0:1788834892.875838:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788834892.875847:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000245641b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+11:6464:x1875729253926784:12345-0@lo:503: 00000040:00080000:1.0:1788834892.875898:0:6483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788834892.875964:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000245641b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+11:6464:x1875729253926784:12345-0@lo:503: Request processed in 118us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834892.875973:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788834892.876529:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000006c29b1c9 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253926784:0@lo:503: 00000040:00080000:3.0:1788834892.878241:0:6513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1788834892.878665:0:6464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788834892.878693:0:6464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788834892.878713:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000fac15cb5/0xdf60171e5a5d16e3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d16ea expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.878726:0:6464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000fac15cb5/0xdf60171e5a5d16e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d16ea expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834892.878778:0:6464:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788834892.878781:0:6464:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9afd85554000 10000000:01000000:2.0:1788834892.878784:0:6464:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9afd85554000 10000000:01000000:2.0:1788834892.878800:0:6464:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788834892.878807:0:6464:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afd85554000 from 1 10000000:01000000:2.0:1788834892.878809:0:6464:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788834892.878850:0:6464:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000063e52b8/0xdf60171e5a5d16f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.878858:0:6464:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000063e52b8/0xdf60171e5a5d16f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.878868:0:6464:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000063e52b8/0xdf60171e5a5d16f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834892.878889:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b5b4799 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253926912:0@lo:101: 00000100:00100000:2.0:1788834892.878951:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834892.879042:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f949666 going to sleep for 11 seconds 00000100:00100000:0.0:1788834892.879427:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253926912 00000100:00100000:0.0:1788834892.879436:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253926912 00000100:00100000:0.0:1788834892.879527:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788834892.879537:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b888192 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+11:6464:x1875729253926912:12345-0@lo:101: 00010000:00010000:0.0:1788834892.879555:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788834892.879568:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000414d5b8f/0xdf60171e5a5d16f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d16f1 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834892.879608:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000414d5b8f/0xdf60171e5a5d16f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d16f1 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834892.879619:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000414d5b8f/0xdf60171e5a5d16f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d16f1 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834892.879627:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000414d5b8f, rc 0) 00000100:00100000:0.0:1788834892.879677:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b888192 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:6464:x1875729253926912:12345-0@lo:101: Request processed in 143us (726us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834892.879684:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788834892.879756:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b5b4799 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253926912:0@lo:101: 00010000:00010000:2.0:1788834892.879771:0:6464:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000063e52b8/0xdf60171e5a5d16f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d16f8 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.879779:0:6464:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000063e52b8/0xdf60171e5a5d16f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d16f8 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834892.879842:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b5b4799 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253927040:0@lo:501: 00000100:00100000:2.0:1788834892.879873:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834892.880068:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f949666 going to sleep for 11 seconds 00000100:00100000:3.0:1788834892.880274:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253927040 00000100:00100000:3.0:1788834892.880280:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253927040 00000100:00100000:3.0:1788834892.880399:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788834892.880407:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a78b25c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:6464:x1875729253927040:12345-0@lo:501: 00000100:00100000:3.0:1788834892.880600:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a78b25c8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:6464:x1875729253927040:12345-0@lo:501: Request processed in 194us (726us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834892.880607:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788834892.880847:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b5b4799 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253927040:0@lo:501: 00000100:00100000:2.0:1788834892.880880:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b5b4799 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253927168:0@lo:503: 00000100:00100000:2.0:1788834892.880922:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834892.881035:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 000000005f949666 going to sleep for 11 seconds 00000100:00100000:3.0:1788834892.881257:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253927168 00000100:00100000:3.0:1788834892.881263:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253927168 00000100:00100000:3.0:1788834892.881299:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788834892.881306:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000999104a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:6464:x1875729253927168:12345-0@lo:503: 00000100:00100000:3.0:1788834892.881503:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000999104a9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:6464:x1875729253927168:12345-0@lo:503: Request processed in 198us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834892.881511:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788834892.881707:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b5b4799 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253927168:0@lo:503: 00000100:00100000:2.0:1788834892.882150:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b5b4799 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:6514:1875729253927296:0@lo:502: 00000100:00100000:2.0:1788834892.882198:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834892.882277:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 00000000788172b9 going to sleep for 11 seconds 00000100:00100000:0.0:1788834892.882342:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253927296 00000100:00100000:0.0:1788834892.882348:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253927296 00000100:00100000:0.0:1788834892.882380:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788834892.882387:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000065f043e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:6514:x1875729253927296:12345-0@lo:502: 00000100:00100000:0.0:1788834892.882660:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000065f043e9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:6514:x1875729253927296:12345-0@lo:502: Request processed in 273us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834892.882668:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788834892.882707:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b5b4799 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:6514:1875729253927296:0@lo:502: 00000020:01000004:2.0:1788834892.882764:0:6514:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788834892.882780:0:6514:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000e29804f2) 00000020:00000080:2.0:1788834892.882798:0:6514:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:2.0:1788834892.882881:0:6514:0:(tgt_mount.c:153:server_get_mount()) get mount 0000000033650400 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788834892.882885:0:6514:0:(tgt_mount.c:187:server_put_mount()) put mount 0000000033650400 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788834892.882888:0:6514:0:(obd_mount.c:710:lustre_put_lsi()) put 0000000033650400 4 00010000:00080000:2.0:1788834892.882917:0:6514:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000169adb04@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1788834892.885724:0:6514:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1788834892.885971:0:6514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788834892.886013:0:6514:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788834892.886027:0:6514:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdf60171e5a5d1706 00000100:00080000:2.0:1788834892.886036:0:6514:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788834892.886041:0:6514:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000169adb04 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788834892.887152:0:6514:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000000b5b4799 x1875729253927424/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788834892.887189:0:6514:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1788834892.888825:0:6514:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f51a50d2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:6514:1875729253927552:0@lo:502: 00000100:00100000:2.0:1788834892.888915:0:6514:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834892.889105:0:6514:0:(client.c:2715:ptlrpc_set_wait()) set 0000000069503b10 going to sleep for 11 seconds 00000100:00100000:3.0:1788834892.889173:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b5b4799 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875729253927424:0@lo:38: 00000100:00100000:3.0:1788834892.889214:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834892.889263:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253927552 00000100:00100000:3.0:1788834892.889272:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253927552 00000100:00100000:0.0:1788834892.889753:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253927424 00000100:00100000:0.0:1788834892.889758:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253927424 00000100:00100000:0.0:1788834892.889788:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788834892.889813:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c29b1c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875729253927424:12345-0@lo:38: 00000100:00100000:0.0:1788834892.889879:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c29b1c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875729253927424:12345-0@lo:38: Request processed in 74us (665us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788834892.889885:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788834892.890034:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788834892.890043:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000f952f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:6514:x1875729253927552:12345-0@lo:502: 00000100:00100000:3.0:1788834892.890513:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000f952f4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:6514:x1875729253927552:12345-0@lo:502: Request processed in 472us (1598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834892.891005:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788834892.891080:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788834892.891087:0:3613:0:(import.c:65:import_set_state_nolock()) 00000000169adb04 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788834892.891092:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1788834892.891095:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b5b4799 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875729253927424:0@lo:38: 00000100:00100000:0.0:1788834892.891204:0:6514:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f51a50d2 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:6514:1875729253927552:0@lo:502: 00000040:00080000:0.0:1788834892.891233:0:6514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1788834892.892039:0:6464:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1788834892.892064:0:6464:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1788834892.892300:0:6464:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000063e52b8/0xdf60171e5a5d16f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d16f8 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834892.892339:0:6464:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000063e52b8/0xdf60171e5a5d16f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d16f8 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1788834892.892401:0:6464:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1788834892.892404:0:6464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788834892.892416:0:6464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788834892.892417:0:6464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788834892.892419:0:6464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788834892.892420:0:6464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788834892.892421:0:6464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788834892.892423:0:6464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788834892.892424:0:6464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788834892.892425:0:6464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788834892.892427:0:6464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788834892.892428:0:6464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788834892.892431:0:6464:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1788834892.892433:0:6464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1788834892.892435:0:6464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788834892.892436:0:6464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788834892.892437:0:6464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788834892.892437:0:6464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788834892.892438:0:6464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788834892.892439:0:6464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788834892.892440:0:6464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788834892.892441:0:6464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788834892.892442:0:6464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788834892.892443:0:6464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788834892.892444:0:6464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1788834892.892479:0:6464:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1788834892.892496:0:6464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000cc4bdeff pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253927680:0@lo:253: 00000100:00100000:3.0:1788834892.892567:0:6464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834892.892604:0:6464:0:(client.c:2715:ptlrpc_set_wait()) set 00000000edd7e9d9 going to sleep for 11 seconds 00000100:00100000:1.0:1788834892.894761:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253927680 00000100:00100000:1.0:1788834892.894775:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253927680 00000100:00100000:1.0:1788834892.894833:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788834892.894842:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6f182a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:6464:x1875729253927680:12345-0@lo:253: 20000000:01000000:1.0:1788834892.894884:0:6482:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1788834892.894897:0:6482:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788834892.905612:0:6482:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788834892.905630:0:6482:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788834892.906059:0:6503:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788834892.906065:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788834892.906088:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000f01189cb/0xdf60171e5a5d170d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834892.906110:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000003e82e6ae/0xdf60171e5a5d16dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d16d5 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834892.906133:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000f01189cb/0xdf60171e5a5d170d lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834892.906175:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000003e82e6ae/0xdf60171e5a5d16dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d16d5 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834892.906190:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000003e82e6ae/0xdf60171e5a5d16dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d16d5 expref: 12 pid: 6483 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834892.906205:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e50da666 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875729253927808:0@lo:104: 00000100:00100000:3.0:1788834892.906274:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834892.906501:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6f182a0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:6464:x1875729253927680:12345-0@lo:253: Request processed in 11658us (13932us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834892.906846:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788834892.907019:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253927808 00000100:00100000:2.0:1788834892.907029:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253927808 00000100:00100000:3.0:1788834892.908750:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ad0c009f going to sleep for 11 seconds 00000100:00100000:3.0:1788834892.908813:0:6464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000cc4bdeff pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:6464:1875729253927680:0@lo:253: 10000000:01000000:3.0:1788834892.908833:0:6464:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1788834892.908836:0:6464:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788834892.908838:0:6464:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1788834892.908840:0:6464:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788834892.908841:0:6464:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788834892.908842:0:6464:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788834892.908844:0:6464:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788834892.908845:0:6464:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1788834892.908847:0:6464:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1788834892.908848:0:6464:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1788834892.908849:0:6464:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1788834892.908850:0:6464:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788834892.908852:0:6464:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1788834892.908869:0:6464:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:2.0:1788834892.909514:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788834892.909543:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007ce79b62 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:6503:x1875729253927808:12345-0@lo:104: 00010000:00010000:2.0:1788834892.909561:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: 000000006f6b0fed/0xdf60171e5a5d16d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d16dc expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.909663:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788834892.909668:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007ce79b62 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:6503:x1875729253927808:12345-0@lo:104: Request processed in 145us (3395us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834892.909676:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788834892.916497:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788834892.916512:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 000000006f6b0fed/0xdf60171e5a5d16d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d16dc expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834892.916738:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006f6b0fed already unused, calling callback (00000000f6c941bc) 10000000:00010000:0.0:1788834892.916743:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 000000006f6b0fed/0xdf60171e5a5d16d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d16dc expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834892.916754:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 000000006f6b0fed/0xdf60171e5a5d16d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d16dc expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788834892.916760:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 000000006f6b0fed/0xdf60171e5a5d16d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d16dc expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788834892.916766:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788834892.916833:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 000000006f6b0fed/0xdf60171e5a5d16d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d16dc expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834892.916841:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788834892.916874:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 000000006f6b0fed/0xdf60171e5a5d16d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d16dc expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834892.916881:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 000000006f6b0fed/0xdf60171e5a5d16d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d16dc expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834892.916921:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788834892.916923:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788834892.916925:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788834892.918376:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e50da666 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875729253927808:0@lo:104: 00000100:00100000:2.0:1788834892.918600:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788834892.918616:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009945cdf4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253927936:0@lo:103: 00000100:00100000:2.0:1788834892.918678:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834892.918847:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253927936 00000100:00100000:2.0:1788834892.918855:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253927936 00010000:00010000:2.0:1788834892.918884:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000003e82e6ae/0xdf60171e5a5d16dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d16d5 expref: 12 pid: 6483 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834892.918918:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788834892.918927:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051d82749 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:3614:x1875729253927936:12345-0@lo:103: 00010000:00010000:2.0:1788834892.918941:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788834892.918946:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000003e82e6ae/0xdf60171e5a5d16dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d16d5 expref: 12 pid: 6483 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834892.919037:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000f01189cb/0xdf60171e5a5d170d lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.920111:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000003e82e6ae/0xdf60171e5a5d16dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d16d5 expref: 12 pid: 6483 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.920138:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000003e82e6ae/0xdf60171e5a5d16dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d16d5 expref: 12 pid: 6483 timeout: 284 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.920156:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000f01189cb/0xdf60171e5a5d170d lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.920561:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f01189cb/0xdf60171e5a5d170d lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788834892.920580:0:6473:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014516741s 00010000:00010000:2.0:1788834892.920586:0:6473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f01189cb/0xdf60171e5a5d170d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.920593:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000f01189cb/0xdf60171e5a5d170d lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.920599:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000f01189cb/0xdf60171e5a5d170d lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.920606:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000f01189cb/0xdf60171e5a5d170d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.920612:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f01189cb already unused, calling callback (00000000a5212b7f) 00010000:00010000:2.0:1788834892.920616:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000f01189cb/0xdf60171e5a5d170d lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.920624:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000f01189cb/0xdf60171e5a5d170d lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.920634:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000f01189cb/0xdf60171e5a5d170d lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834892.920647:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788834892.921061:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009945cdf4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253927936:0@lo:103: 00010000:00010000:3.0:1788834892.921203:0:6503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000f01189cb/0xdf60171e5a5d170d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834892.921212:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000f01189cb/0xdf60171e5a5d170d lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834892.921218:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000f01189cb/0xdf60171e5a5d170d lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834892.921540:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051d82749 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+11:3614:x1875729253927936:12345-0@lo:103: Request processed in 1807us (2054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834892.921552:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00080000:10000000:3.0:1788834892.924714:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00080000:10000000:3.0:1788834892.924904:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:3.0:1788834892.931503:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00080000:10000000:3.0:1788834892.932162:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:3.0:1788834892.934999:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00080000:10000000:3.0:1788834892.935259:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:0.0:1788834892.937741:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00080000:10000000:0.0:1788834892.937932:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:0.0:1788834892.938124:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00080000:10000000:0.0:1788834892.938284:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:0.0:1788834892.938963:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00080000:10000000:0.0:1788834892.939192:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 40000000:02000000:1.0:1788834892.945905:0:6464:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:1.0:1788834892.960107:0:6464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1788834892.960243:0:6519:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1788834892.960248:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:1.0:1788834892.962342:0:6520:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:3.0:1788834892.967187:0:6464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1788834892.970168:0:6464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1788834892.970896:0:6464:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788834892.970912:0:6464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1788834892.973610:0:6464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788834892.974669:0:6464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1788834892.975225:0:6464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:2.0:1788834892.975262:0:6464:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:2.0:1788834892.975487:0:6464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788834892.975713:0:6464:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x10:0x0] (8/32) registered 00100000:10000000:2.0:1788834892.976393:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000040:00080000:0.0:1788834892.980171:0:6520:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00100000:10000000:2.0:1788834892.981111:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:2.0:1788834892.984998:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:2.0:1788834892.985161:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:2.0:1788834892.985378:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:2.0:1788834892.986236:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:2.0:1788834892.986816:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:2.0:1788834892.988768:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:2.0:1788834892.989211:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:2.0:1788834892.990292:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:2.0:1788834892.991277:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:2.0:1788834892.992259:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:2.0:1788834892.992473:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1788834892.992632:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1788834892.992804:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00000040:00080000:0.0:1788834892.993648:0:6520:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788834892.993729:0:6520:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:0.0:1788834892.993734:0:6520:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00100000:10000000:2.0:1788834892.994309:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1788834892.994746:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1788834892.994907:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1788834892.995297:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1788834892.995708:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1788834892.995871:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1788834892.996278:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1788834892.996873:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1788834892.997750:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1788834892.997909:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1788834892.999567:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1788834892.999722:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1788834892.999847:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1788834893.000015:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1788834893.000170:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1788834893.000355:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1788834893.001083:0:6464:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1788834893.001359:0:6464:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:2.0:1788834893.010717:0:6464:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788834893.010765:0:6464:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadff41c1f988 00100000:10000000:2.0:1788834893.010774:0:6464:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1788834893.013087:0:6464:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788834893.013104:0:6464:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788834893.013125:0:6464:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:1.0:1788834893.013140:0:6464:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:1.0:1788834893.021205:0:6464:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788834893.023748:0:6464:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:0.0:1788834893.295578:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788834894.310076:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788834895.339514:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788834896.358306:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788834897.390515:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788834897.703053:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1788834897.703064:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afd85554000 from 3 10000000:01000000:3.0:1788834897.703071:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788834897.703134:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000f01189cb/0xdf60171e5a5d1714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834897.703148:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000f01189cb/0xdf60171e5a5d1714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834897.703169:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000f01189cb/0xdf60171e5a5d1714 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834897.703197:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e50da666 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253928064:0@lo:101: 00000100:00100000:3.0:1788834897.703291:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834897.703399:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c0b64636 going to sleep for 11 seconds 00000100:00100000:1.0:1788834897.703505:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253928064 00000100:00100000:1.0:1788834897.703514:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253928064 00000100:00100000:1.0:1788834897.703586:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788834897.703595:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f16d83db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+11:6485:x1875729253928064:12345-0@lo:101: 00010000:00010000:1.0:1788834897.703612:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788834897.703628:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ffa9191c/0xdf60171e5a5d171b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1714 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834897.703653:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ffa9191c/0xdf60171e5a5d171b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1714 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834897.703664:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ffa9191c/0xdf60171e5a5d171b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1714 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834897.703673:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ffa9191c, rc 0) 00000100:00100000:1.0:1788834897.703725:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f16d83db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:6485:x1875729253928064:12345-0@lo:101: Request processed in 132us (435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834897.703732:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788834897.704449:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e50da666 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253928064:0@lo:101: 00010000:00010000:3.0:1788834897.704473:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000f01189cb/0xdf60171e5a5d1714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d171b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834897.704485:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000f01189cb/0xdf60171e5a5d1714 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d171b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834897.704566:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e50da666 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253928192:0@lo:256: 00000100:00100000:3.0:1788834897.704624:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834897.704666:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c0b64636 going to sleep for 11 seconds 00000100:00100000:1.0:1788834897.704782:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253928192 00000100:00100000:1.0:1788834897.704797:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253928192 00000100:00100000:1.0:1788834897.704846:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788834897.704853:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dac5d229 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:6485:x1875729253928192:12345-0@lo:256: 20000000:01000000:1.0:1788834897.704874:0:6482:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788834897.704903:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788834897.704910:0:6482:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788834897.704994:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dac5d229 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:6485:x1875729253928192:12345-0@lo:256: Request processed in 142us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834897.705002:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788834897.705594:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e50da666 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253928192:0@lo:256: 10000000:01000000:3.0:1788834897.705653:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788834897.705662:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000f01189cb/0xdf60171e5a5d1714 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d171b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834897.705671:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000f01189cb/0xdf60171e5a5d1714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d171b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:1.0:1788834898.122287:0:6764:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:1.0:1788834898.213875:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788834898.213888:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788834898.213891:0:37:0:(import.c:65:import_set_state_nolock()) 00000000169adb04 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788834898.213907:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000169adb04 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788834898.213933:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000959dd62a x1875729253928448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788834898.213980:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000959dd62a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875729253928448:0@lo:38: 00000100:00100000:1.0:1788834898.214061:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834898.214283:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059757893 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253928320:0@lo:400: 00000100:00100000:3.0:1788834898.214385:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834898.215007:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253928320 00000100:00100000:1.0:1788834898.215019:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253928320 00000100:00100000:1.0:1788834898.215078:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788834898.215088:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004cb1c0fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:3616:x1875729253928320:12345-0@lo:400: 00000100:00100000:1.0:1788834898.215180:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004cb1c0fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:3616:x1875729253928320:12345-0@lo:400: Request processed in 92us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834898.215189:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788834898.215245:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059757893 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253928320:0@lo:400: 00000100:00100000:2.0:1788834898.215978:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253928448 00000100:00100000:2.0:1788834898.215988:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253928448 00000100:00100000:2.0:1788834898.216027:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788834898.216033:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fbc4c24d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3613:x1875729253928448:12345-0@lo:38: 00010000:00080000:2.0:1788834898.216060:0:6489:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 140 last 0 00000020:00000080:2.0:1788834898.216104:0:6489:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdf60171e5a5d1722 00000004:00100000:2.0:1788834898.216157:0:6489:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788834898.216287:0:6489:0:(import.c:65:import_set_state_nolock()) 00000000e016a7f1 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788834898.217103:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fbc4c24d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1875729253928448:12345-0@lo:38: Request processed in 1066us (3039us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834898.217125:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788834898.218767:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000959dd62a x1875729253928448/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788834908 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788834898.218793:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1788834898.218803:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788834898.218808:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788834898.218812:0:3613:0:(import.c:65:import_set_state_nolock()) 00000000169adb04 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788834898.218821:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000959dd62a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875729253928448:0@lo:38: 00010000:00010000:0.0:1788834898.407204:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788834899.216761:0:6817:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788834899.217073:0:6817:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788834899.435181:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788834900.453945:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834901.477642:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788834902.032619:0:6918:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788834902.032827:0:6918:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788834902.506553:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788834903.333723:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788834903.333764:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b9a189c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253928576:0@lo:400: 00000100:00100000:2.0:1788834903.333869:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834903.333958:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f46520c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729253928704:0@lo:400: 00000100:00100000:1.0:1788834903.334632:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253928576 00000100:00100000:1.0:1788834903.334643:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253928576 00000100:00100000:1.0:1788834903.334706:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788834903.334716:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad721d33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:3616:x1875729253928576:12345-0@lo:400: 00000100:00100000:1.0:1788834903.334793:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad721d33 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:3616:x1875729253928576:12345-0@lo:400: Request processed in 79us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834903.334801:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788834903.334863:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b9a189c9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253928576:0@lo:400: 00000100:00100000:2.0:1788834903.337035:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834903.337282:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253928704 00000100:00100000:1.0:1788834903.337298:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253928704 00000100:00100000:1.0:1788834903.337418:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788834903.337428:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e4475a76 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729253928704:12345-0@lo:400: 00000100:00100000:1.0:1788834903.337562:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e4475a76 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729253928704:12345-0@lo:400: Request processed in 134us (532us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834903.337571:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788834903.337583:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000f46520c1 x1875729253928704/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834919 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834903.337603:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f46520c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729253928704:0@lo:400: 00010000:00010000:2.0:1788834903.528353:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788834904.549869:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834905.575586:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788834906.597744:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788834907.623282:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788834908.460738:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000959dd62a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729253928832:0@lo:400: 00000100:00100000:1.0:1788834908.460860:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834908.460922:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000059757893 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729253928960:0@lo:400: 00000100:00100000:1.0:1788834908.460961:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834908.461344:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253928960 00000100:00100000:2.0:1788834908.461352:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253928960 00000100:00100000:2.0:1788834908.462652:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788834908.462673:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004bf19dd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729253928960:12345-0@lo:400: 00000100:00100000:2.0:1788834908.462755:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004bf19dd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729253928960:12345-0@lo:400: Request processed in 93us (1793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834908.462762:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788834908.462812:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000059757893 x1875729253928960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834924 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834908.462825:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000059757893 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729253928960:0@lo:400: 00000100:00100000:3.0:1788834908.476762:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253928832 00000100:00100000:3.0:1788834908.476782:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253928832 00000100:00100000:3.0:1788834908.476884:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788834908.476904:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000158e1a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:3615:x1875729253928832:12345-0@lo:400: 00000100:00100000:3.0:1788834908.478226:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000158e1a36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:3615:x1875729253928832:12345-0@lo:400: Request processed in 1323us (17359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834908.478242:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788834908.480491:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000959dd62a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729253928832:0@lo:400: 00010000:00010000:0.0:1788834908.651518:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788834909.670597:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788834910.693983:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834911.720840:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788834912.518698:0:7416:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788834912.518705:0:7416:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788834912.518718:0:7416:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788834912.518882:0:7416:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 000000006b846f67 00000020:01000004:2.0:1788834912.518906:0:7416:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200061, mountfl=0 00000020:01000004:2.0:1788834912.518920:0:7416:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788834912.518948:0:7416:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (0000000079a09578) 00000020:00000080:2.0:1788834912.518968:0:7416:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788834912.616659:0:7416:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00100000:10000000:2.0:1788834912.616766:0:7416:0:(scrub.c:230:scrub_file_store()) lustre-MDT0001: store scrub file: rc = 0 00080000:01000000:0.0:1788834912.661716:0:7416:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:0.0:1788834912.662151:0:7416:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:0.0:1788834912.662166:0:7416:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:0.0:1788834912.662180:0:7416:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdf60171e5a5d1730 00000020:01000004:0.0:1788834912.662197:0:7416:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:0.0:1788834912.662224:0:7416:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.122@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1788834912.662228:0:7416:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1788834912.662235:0:7416:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:0.0:1788834912.662270:0:7416:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:0.0:1788834912.662921:0:7416:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788834912.691284:0:7416:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788834912.691379:0:7416:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.122@tcp, index=0001, flags=0x20061 00000020:01000004:2.0:1788834912.691384:0:7416:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788834912.691386:0:7416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788834912.691387:0:7416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788834912.691388:0:7416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788834912.691390:0:7416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788834912.691391:0:7416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788834912.691392:0:7416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788834912.691394:0:7416:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788834912.691395:0:7416:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788834912.691396:0:7416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788834912.691398:0:7416:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788834912.691403:0:7416:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020061 00000020:01000004:2.0:1788834912.691405:0:7416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788834912.691407:0:7416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788834912.691408:0:7416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788834912.691409:0:7416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788834912.691410:0:7416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788834912.691411:0:7416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788834912.691412:0:7416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788834912.691413:0:7416:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788834912.691414:0:7416:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788834912.691415:0:7416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788834912.691416:0:7416:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788834912.691452:0:7416:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788834912.691474:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f46520c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253929088:0@lo:253: 00000100:00100000:2.0:1788834912.691573:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834912.691644:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b18cece2 going to sleep for 11 seconds 00000100:00100000:1.0:1788834912.695226:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253929088 00000100:00100000:1.0:1788834912.695241:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253929088 00000100:00100000:1.0:1788834912.695342:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788834912.695357:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001f22cbca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:7416:x1875729253929088:12345-0@lo:253: 20000000:01000000:1.0:1788834912.695393:0:6483:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1788834912.695399:0:6483:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0001, index=1 20000000:01000000:1.0:1788834912.695405:0:6483:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0001 to 1 20000000:01000000:1.0:1788834912.695410:0:6483:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0001 20000000:01000000:1.0:1788834912.695455:0:6483:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0001-mdtlov) log for lustre-MDT0001 00000040:00080000:1.0:1788834912.695778:0:6483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788834912.696902:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:1.0:1788834912.696925:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf001 lov lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788834912.697069:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:1.0:1788834912.697090:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:1.0:1788834912.697107:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:1.0:1788834912.697180:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 20000000:01000000:1.0:1788834912.697188:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf001 mdt lustre-MDT0001_UUID (null) (null) 00000040:00080000:1.0:1788834912.697200:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 20000000:01000000:1.0:1788834912.697205:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0001 lustre-MDT0001-mdtlov (null) (null) 00000040:00080000:1.0:1788834912.697216:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 20000000:01000000:1.0:1788834912.697220:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf003 lustre-MDT0001_UUID 1 lustre-MDT0001-mdtlov f 00000040:00080000:1.0:1788834912.697231:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:1.0:1788834912.697246:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:1.0:1788834912.697405:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 20000000:01000000:1.0:1788834912.697418:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:1.0:1788834912.697431:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 20000000:01000000:1.0:1788834912.697437:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf001 osp lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788834912.697473:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 20000000:01000000:1.0:1788834912.697480:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-osp-MDT0001 0xcf003 lustre-MDT0000_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:1.0:1788834912.697492:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 20000000:01000000:1.0:1788834912.697497:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:1.0:1788834912.697511:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:1.0:1788834912.697528:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:1.0:1788834912.697540:0:6483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788834912.698638:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 20000000:01000000:0.0:1788834912.698677:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf009 sys.timeout=20 (null) (null) (null) 00000040:00080000:0.0:1788834912.698696:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788834912.698718:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788834912.698736:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 20000000:01000000:0.0:1788834912.699157:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001 0xcf00f mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (null) (null) (null) 00000040:00080000:0.0:1788834912.699184:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788834912.699220:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788834912.699226:0:6483:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 20000000:01000000:0.0:1788834912.699295:0:6483:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0001 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1788834912.699304:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0001/add mdc fl=4 00000040:00080000:3.0:1788834912.701797:0:7423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000040:00080000:0.0:1788834912.703634:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1788834912.703673:0:6483:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.122@tcp for mdt 20000000:01000000:0.0:1788834912.703676:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:0.0:1788834912.703694:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1788834912.703700:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1788834912.703713:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1788834912.703718:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdc 0xcf003 lustre-MDT0001_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:0.0:1788834912.703734:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1788834912.703743:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0001_UUID 1 1 lustre-MDT0001-mdc_UUID 00000040:00080000:0.0:1788834912.703756:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 160 off12472 00000040:00080000:0.0:1788834912.703769:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12696 20000000:01000000:0.0:1788834912.703829:0:6483:0:(mgs_llog.c:3435:mgs_write_log_osp_to_mdt()) adding osp index 1 to lustre-MDT0000 20000000:01000000:0.0:1788834912.703839:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre-MDT0001/add osp fl=4 00000040:00080000:2.0:1788834912.705306:0:7424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000040:00080000:0.0:1788834912.705639:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1788834912.705667:0:6483:0:(mgs_llog.c:3493:mgs_write_log_osp_to_mdt()) add nid 192.168.203.122@tcp for mdt 20000000:01000000:0.0:1788834912.705670:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:0.0:1788834912.705687:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1788834912.705692:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf001 osp lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1788834912.705704:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1788834912.705708:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-osp-MDT0000 0xcf003 lustre-MDT0001_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:0.0:1788834912.705719:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1788834912.705725:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf014 lustre-MDT0001_UUID 1 1 (null) 00000040:00080000:0.0:1788834912.705735:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1788834912.705750:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 20000000:01000000:0.0:1788834912.705770:0:6483:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:0.0:1788834912.705773:0:6483:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1788834912.705776:0:6483:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1788834912.705821:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:0.0:1788834912.705823:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788834912.706256:0:7425:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 16 marker 14 1->4: lustre sys.timeout 20000000:01000000:2.0:1788834912.706276:0:7425:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 14 2->4: lustre sys.timeout 00000040:00080000:2.0:1788834912.706290:0:7425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 22 count 22 00000040:00080000:0.0:1788834912.706540:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788834912.706564:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788834912.706583:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 20000000:01000000:0.0:1788834912.706599:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788834912.706601:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788834912.706837:0:7426:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:2.0:1788834912.706855:0:7426:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:2.0:1788834912.706870:0:7426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1788834912.709120:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1788834912.709153:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1788834912.709182:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1788834912.709194:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788834912.709197:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788834912.711030:0:7427:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1788834912.711068:0:7427:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1788834912.711082:0:7427:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1788834912.711270:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12920 00000040:00080000:2.0:1788834912.711294:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off13000 00000040:00080000:2.0:1788834912.711309:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13224 20000000:01000000:2.0:1788834912.711524:0:6483:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788834912.711528:0:6483:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1788834912.711533:0:6483:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1788834912.711539:0:6483:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0001/lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1788834912.712491:0:7428:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 20 count 25 20000000:00000400:2.0:1788834912.712615:0:6483:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify lustre-MDT0001/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788834912.740833:0:6483:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788834912.740935:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000990a187a/0xdf60171e5a5d1737 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.740957:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d166c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1665 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.740963:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000b9bf444d/0xdf60171e5a5d1688 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1681 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.740967:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000414d5b8f/0xdf60171e5a5d16f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d16f1 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.740971:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000990a187a/0xdf60171e5a5d1737 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.741017:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000414d5b8f/0xdf60171e5a5d16f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d16f1 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.741048:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000414d5b8f/0xdf60171e5a5d16f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d16f1 expref: 12 pid: 6482 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834912.741062:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e50da666 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253929216:0@lo:104: 00000100:00100000:3.0:1788834912.741144:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788834912.741216:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b9bf444d/0xdf60171e5a5d1688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1681 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.741225:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b9bf444d/0xdf60171e5a5d1688 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1681 expref: 12 pid: 6483 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834912.741233:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0a3056c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253929344:0@lo:104: 00000100:00100000:3.0:1788834912.741254:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788834912.741299:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d166c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1665 expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.741307:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d166c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1665 expref: 12 pid: 6482 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834912.741364:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bfe36425 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253929472:0@lo:104: 00000100:00100000:0.0:1788834912.741384:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253929216 00000100:00100000:3.0:1788834912.741394:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834912.741410:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253929216 00000100:00100000:3.0:1788834912.741413:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set 0000000087585325 going to sleep for 11 seconds 00000100:00100000:0.0:1788834912.741475:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253929344 00000100:00100000:0.0:1788834912.741478:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253929344 00000100:00100000:0.0:1788834912.741487:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253929472 00000100:00100000:0.0:1788834912.741489:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253929472 00000100:00100000:0.0:1788834912.741505:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788834912.741513:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cc4bdeff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+5:6483:x1875729253929216:12345-0@lo:104: 00010000:00010000:0.0:1788834912.741528:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: 00000000063e52b8/0xdf60171e5a5d16f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d16f8 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834912.741638:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788834912.741644:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cc4bdeff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+5:6483:x1875729253929216:12345-0@lo:104: Request processed in 132us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834912.741651:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788834912.741669:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788834912.741678:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f71fb536 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:6483:x1875729253929344:12345-0@lo:104: 00010000:00010000:0.0:1788834912.741686:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: 000000005bd45f2e/0xdf60171e5a5d1681 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1688 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834912.741732:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788834912.741736:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f71fb536 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:6483:x1875729253929344:12345-0@lo:104: Request processed in 63us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834912.741742:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788834912.741754:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788834912.741759:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c9bff2e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:6483:x1875729253929472:12345-0@lo:104: 00010000:00010000:0.0:1788834912.741765:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: 00000000fde59cc2/0xdf60171e5a5d1665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d166c expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834912.741791:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788834912.741801:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c9bff2e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:6483:x1875729253929472:12345-0@lo:104: Request processed in 44us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834912.741807:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1788834912.741944:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788834912.741952:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 000000005bd45f2e/0xdf60171e5a5d1681 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1688 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.741961:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000005bd45f2e already unused, calling callback (00000000f6c941bc) 10000000:00010000:2.0:1788834912.741965:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 000000005bd45f2e/0xdf60171e5a5d1681 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1688 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.741974:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 000000005bd45f2e/0xdf60171e5a5d1681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1688 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788834912.741981:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 000000005bd45f2e/0xdf60171e5a5d1681 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1688 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834912.742001:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788834912.742020:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788834912.742042:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 000000005bd45f2e/0xdf60171e5a5d1681 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1688 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.742057:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788834912.742081:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 000000005bd45f2e/0xdf60171e5a5d1681 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1688 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.742086:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 000000005bd45f2e/0xdf60171e5a5d1681 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1688 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.742104:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788834912.742107:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 00000000fde59cc2/0xdf60171e5a5d1665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d166c expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.742116:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fde59cc2 already unused, calling callback (00000000f6c941bc) 10000000:00010000:2.0:1788834912.742119:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 00000000fde59cc2/0xdf60171e5a5d1665 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d166c expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.742125:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 00000000fde59cc2/0xdf60171e5a5d1665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d166c expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788834912.742130:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 00000000fde59cc2/0xdf60171e5a5d1665 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d166c expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834912.742134:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788834912.742146:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 00000000fde59cc2/0xdf60171e5a5d1665 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d166c expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.742152:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788834912.742176:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 00000000fde59cc2/0xdf60171e5a5d1665 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d166c expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.742182:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 00000000fde59cc2/0xdf60171e5a5d1665 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d166c expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.742191:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834912.742193:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834912.742195:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788834912.742220:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788834912.742242:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000002c50c2e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253929600:0@lo:103: 00000100:00100000:2.0:1788834912.742304:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834912.742412:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e50da666 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253929216:0@lo:104: 00000100:00100000:3.0:1788834912.742429:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0a3056c pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253929344:0@lo:104: 00000100:00100000:3.0:1788834912.742443:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bfe36425 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253929472:0@lo:104: 00010000:00010000:3.0:1788834912.742485:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000990a187a/0xdf60171e5a5d1737 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834912.742512:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e90c8ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253929728:0@lo:103: 00000100:00100000:2.0:1788834912.742542:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834912.742588:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253929600 00000100:00100000:2.0:1788834912.742596:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253929600 00010000:00010000:2.0:1788834912.742643:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b9bf444d/0xdf60171e5a5d1688 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1681 expref: 13 pid: 6483 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834912.742673:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253929728 00000100:00100000:2.0:1788834912.742681:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788834912.742682:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253929728 00000100:00100000:2.0:1788834912.742697:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ea8475f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:3616:x1875729253929600:12345-0@lo:103: 00010000:00010000:3.0:1788834912.742711:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d166c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1665 expref: 14 pid: 6482 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.742713:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788834912.742725:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b9bf444d/0xdf60171e5a5d1688 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1681 expref: 14 pid: 6483 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.742743:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b9bf444d/0xdf60171e5a5d1688 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1681 expref: 14 pid: 6483 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834912.742748:0:6474:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1788834912.742758:0:6474:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1788834912.742765:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b9bf444d/0xdf60171e5a5d1688 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1681 expref: 14 pid: 6483 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.742793:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788834912.742835:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ea8475f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:3616:x1875729253929600:12345-0@lo:103: Request processed in 145us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834912.742842:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788834912.742861:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788834912.742868:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000345243e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:3614:x1875729253929728:12345-0@lo:103: 00010000:00010000:2.0:1788834912.742876:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788834912.742879:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d166c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1665 expref: 12 pid: 6482 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.742886:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d166c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1665 expref: 12 pid: 6482 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.742896:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d166c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1665 expref: 12 pid: 6482 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.742905:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788834912.742930:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000345243e6 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+11:3614:x1875729253929728:12345-0@lo:103: Request processed in 63us (388us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834912.742935:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788834912.743202:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000002c50c2e9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253929600:0@lo:103: 00000100:00100000:3.0:1788834912.743530:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e90c8ec pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253929728:0@lo:103: 00010000:00010000:3.0:1788834912.744009:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834912.745867:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834912.745872:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834912.745874:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788834912.745977:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 00000000063e52b8/0xdf60171e5a5d16f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d16f8 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.745992:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000063e52b8 already unused, calling callback (00000000f6c941bc) 10000000:00010000:3.0:1788834912.745996:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 00000000063e52b8/0xdf60171e5a5d16f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d16f8 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.746005:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 00000000063e52b8/0xdf60171e5a5d16f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d16f8 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788834912.746011:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 00000000063e52b8/0xdf60171e5a5d16f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d16f8 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788834912.746018:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788834912.746069:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 00000000063e52b8/0xdf60171e5a5d16f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d16f8 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.746076:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788834912.746122:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 00000000063e52b8/0xdf60171e5a5d16f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d16f8 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.746130:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 00000000063e52b8/0xdf60171e5a5d16f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d16f8 expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.746148:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788834912.746150:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788834912.746152:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788834912.746158:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bfe36425 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729253929856:0@lo:103: 00000100:00100000:2.0:1788834912.746259:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834912.746824:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253929856 00000100:00100000:3.0:1788834912.746833:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253929856 00010000:00010000:3.0:1788834912.746934:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000414d5b8f/0xdf60171e5a5d16f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d16f1 expref: 11 pid: 6482 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834912.746975:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788834912.746984:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000630540a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+11:3615:x1875729253929856:12345-0@lo:103: 00010000:00010000:3.0:1788834912.746998:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788834912.747003:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000414d5b8f/0xdf60171e5a5d16f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d16f1 expref: 11 pid: 6482 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.747015:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000414d5b8f/0xdf60171e5a5d16f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d16f1 expref: 11 pid: 6482 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.747029:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000414d5b8f/0xdf60171e5a5d16f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d16f1 expref: 11 pid: 6482 timeout: 304 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.747043:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000990a187a/0xdf60171e5a5d1737 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.747051:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000990a187a/0xdf60171e5a5d1737 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.747078:0:6473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000990a187a/0xdf60171e5a5d1737 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.747084:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000990a187a/0xdf60171e5a5d1737 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.747088:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000990a187a/0xdf60171e5a5d1737 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.747093:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000990a187a/0xdf60171e5a5d1737 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.747098:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000990a187a already unused, calling callback (00000000a5212b7f) 00010000:00010000:3.0:1788834912.747101:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000990a187a/0xdf60171e5a5d1737 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.747107:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000990a187a/0xdf60171e5a5d1737 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.747125:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000990a187a/0xdf60171e5a5d1737 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.747138:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788834912.747153:0:6483:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000990a187a/0xdf60171e5a5d1737 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.747167:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000990a187a/0xdf60171e5a5d1737 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.747200:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000990a187a/0xdf60171e5a5d1737 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834912.747221:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000630540a2 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+10:3615:x1875729253929856:12345-0@lo:103: Request processed in 235us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834912.747232:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 20000000:01000000:2.0:1788834912.747232:0:6483:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:2.0:1788834912.747300:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bfe36425 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729253929856:0@lo:103: 00000100:00100000:2.0:1788834912.755405:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001f22cbca pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+9:7416:x1875729253929088:12345-0@lo:253: Request processed in 60032us (63810us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834912.755426:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f46520c1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253929088:0@lo:253: 00000100:00100000:2.0:1788834912.755428:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 10000000:01000000:0.0:1788834912.755451:0:7416:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788834912.755454:0:7416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788834912.755457:0:7416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788834912.755459:0:7416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788834912.755460:0:7416:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0001_UUID 00000020:01000004:0.0:1788834912.755461:0:7416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788834912.755463:0:7416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788834912.755465:0:7416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788834912.755466:0:7416:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788834912.755468:0:7416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788834912.755469:0:7416:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788834912.755496:0:7416:0:(tgt_mount.c:101:server_register_mount()) register mount 000000006b846f67 from lustre-MDT0001 10000000:01000000:0.0:1788834912.755534:0:7416:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:0.0:1788834912.755538:0:7416:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788834912.755544:0:7416:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9afdab4bb370 local copy 10000000:01000000:0.0:1788834912.755548:0:7416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788834912.755585:0:7416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000dde96522/0xdf60171e5a5d173e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834912.755595:0:7416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.122@tcp lock: 00000000dde96522/0xdf60171e5a5d173e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834912.755603:0:7416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000dde96522/0xdf60171e5a5d173e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834912.756028:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009945cdf4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253929984:0@lo:101: 00000100:00100000:0.0:1788834912.756091:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834912.756222:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b4954bbe going to sleep for 11 seconds 00000100:00100000:3.0:1788834912.757142:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253929984 00000100:00100000:3.0:1788834912.757151:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253929984 00000100:00100000:3.0:1788834912.757258:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788834912.757267:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000de231a4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+9:7416:x1875729253929984:12345-0@lo:101: 00010000:00010000:3.0:1788834912.757293:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788834912.757310:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004f775790/0xdf60171e5a5d1745 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d173e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.757372:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004f775790/0xdf60171e5a5d1745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d173e expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.757384:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004f775790/0xdf60171e5a5d1745 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d173e expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.757393:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004f775790, rc 0) 00000100:00100000:3.0:1788834912.757455:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000de231a4a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+10:7416:x1875729253929984:12345-0@lo:101: Request processed in 189us (1363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834912.757462:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788834912.757561:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009945cdf4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253929984:0@lo:101: 00010000:00010000:2.0:1788834912.757575:0:7416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000dde96522/0xdf60171e5a5d173e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdf60171e5a5d1745 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.757583:0:7416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000dde96522/0xdf60171e5a5d173e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdf60171e5a5d1745 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834912.757700:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000866cb3da pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253930112:0@lo:501: 00000100:00100000:2.0:1788834912.757731:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834912.758255:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 00000000487f08d7 going to sleep for 11 seconds 00000100:00100000:0.0:1788834912.758288:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253930112 00000100:00100000:0.0:1788834912.758294:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253930112 00000100:00100000:0.0:1788834912.758348:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788834912.758355:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b1da1445 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+10:7416:x1875729253930112:12345-0@lo:501: 00000100:00100000:0.0:1788834912.758427:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b1da1445 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+10:7416:x1875729253930112:12345-0@lo:501: Request processed in 72us (695us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788834912.758434:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788834912.758576:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000866cb3da pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253930112:0@lo:501: 10000000:01000000:2.0:1788834912.758589:0:7416:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788834912.758861:0:7416:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788834912.758868:0:7416:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000dde96522/0xdf60171e5a5d173e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdf60171e5a5d1745 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.758877:0:7416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000dde96522/0xdf60171e5a5d173e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdf60171e5a5d1745 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.758897:0:7416:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: 00000000dde96522/0xdf60171e5a5d173e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdf60171e5a5d1745 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.758921:0:7416:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788834912.758947:0:7416:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9afdb279f000 10000000:01000000:2.0:1788834912.758952:0:7416:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788834912.758957:0:7416:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9afdab4bb370 10000000:01000000:2.0:1788834912.758960:0:7416:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788834912.758963:0:7416:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9afdab4bb370 from 1 10000000:01000000:2.0:1788834912.758966:0:7416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788834912.758987:0:7416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000b9bf444d/0xdf60171e5a5d174c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.758994:0:7416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000b9bf444d/0xdf60171e5a5d174c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.759002:0:7416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000b9bf444d/0xdf60171e5a5d174c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834912.759015:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000866cb3da pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253930240:0@lo:101: 00010000:00010000:3.0:1788834912.759016:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788834912.759021:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 00000000dde96522/0xdf60171e5a5d173e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdf60171e5a5d1745 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.759028:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dde96522 already unused, calling callback (00000000f6c941bc) 10000000:00010000:3.0:1788834912.759031:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 00000000dde96522/0xdf60171e5a5d173e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xdf60171e5a5d1745 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.759038:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 00000000dde96522/0xdf60171e5a5d173e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xdf60171e5a5d1745 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834912.759042:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:00010000:3.0:1788834912.759045:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 00000000dde96522/0xdf60171e5a5d173e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xdf60171e5a5d1745 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788834912.759050:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1788834912.759067:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 00000000dde96522/0xdf60171e5a5d173e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf60171e5a5d1745 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834912.759068:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d89ffdcb going to sleep for 11 seconds 00010000:00010000:3.0:1788834912.759080:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1788834912.759082:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253930240 00000100:00100000:2.0:1788834912.759085:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253930240 00010000:00010000:3.0:1788834912.759103:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 00000000dde96522/0xdf60171e5a5d173e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf60171e5a5d1745 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834912.759107:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00010000:00010000:3.0:1788834912.759110:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 00000000dde96522/0xdf60171e5a5d173e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf60171e5a5d1745 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834912.759113:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009e19e385 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+10:7416:x1875729253930240:12345-0@lo:101: 00010000:00010000:2.0:1788834912.759120:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788834912.759124:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788834912.759126:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788834912.759127:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834912.759131:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fde59cc2/0xdf60171e5a5d1753 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d174c expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.759154:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fde59cc2/0xdf60171e5a5d1753 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d174c expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.759163:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fde59cc2/0xdf60171e5a5d1753 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d174c expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.759171:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fde59cc2, rc 0) 00000100:00100000:2.0:1788834912.759279:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009e19e385 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+11:7416:x1875729253930240:12345-0@lo:101: Request processed in 95us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834912.759294:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788834912.759352:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000866cb3da pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253930240:0@lo:101: 00010000:00010000:3.0:1788834912.759363:0:7416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000b9bf444d/0xdf60171e5a5d174c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1753 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.759371:0:7416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000b9bf444d/0xdf60171e5a5d174c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1753 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788834912.759384:0:7416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1788834912.759396:0:7416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000b9bf444d/0xdf60171e5a5d174c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1753 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.759402:0:7416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000b9bf444d/0xdf60171e5a5d174c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1753 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788834912.759409:0:7416:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9afdb279f000 10000000:01000000:3.0:1788834912.759412:0:7416:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1788834912.759415:0:7416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9afdb279f000 from 1 10000000:01000000:3.0:1788834912.759417:0:7416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1788834912.759436:0:7416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000990a187a/0xdf60171e5a5d175a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.759442:0:7416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000990a187a/0xdf60171e5a5d175a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.759448:0:7416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000990a187a/0xdf60171e5a5d175a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834912.759459:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e50da666 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253930496:0@lo:101: 00000100:00100000:3.0:1788834912.759485:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834912.759502:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 0000000093194c08 going to sleep for 11 seconds 00000100:00100000:2.0:1788834912.759504:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253930496 00000100:00100000:2.0:1788834912.759508:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253930496 00000100:00100000:2.0:1788834912.759540:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788834912.759547:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000071ba00aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+11:7416:x1875729253930496:12345-0@lo:101: 00000100:00100000:1.0:1788834912.759553:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:2.0:1788834912.759554:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788834912.759562:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005bd45f2e/0xdf60171e5a5d1761 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d175a expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834912.759569:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d0a3056c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729253930368:0@lo:103: 00010000:00010000:2.0:1788834912.759578:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005bd45f2e/0xdf60171e5a5d1761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d175a expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.759587:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005bd45f2e/0xdf60171e5a5d1761 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d175a expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.759594:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005bd45f2e, rc 0) 00000100:00100000:1.0:1788834912.759608:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834912.759862:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253930368 00000100:00100000:0.0:1788834912.759867:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253930368 00000100:00100000:0.0:1788834912.759903:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788834912.759909:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cc24f40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:3617:x1875729253930368:12345-0@lo:103: 00010000:00010000:0.0:1788834912.759917:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788834912.759927:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000004f775790/0xdf60171e5a5d1745 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d173e expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834912.759939:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788834912.759969:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cc24f40 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:3617:x1875729253930368:12345-0@lo:103: Request processed in 61us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834912.759976:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788834912.760000:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d0a3056c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729253930368:0@lo:103: 00000100:00100000:2.0:1788834912.760054:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000071ba00aa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+11:7416:x1875729253930496:12345-0@lo:101: Request processed in 508us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834912.760060:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788834912.760140:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e50da666 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253930496:0@lo:101: 00010000:00010000:3.0:1788834912.760150:0:7416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000990a187a/0xdf60171e5a5d175a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1761 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.760156:0:7416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000990a187a/0xdf60171e5a5d175a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1761 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788834912.760167:0:7416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1788834912.760181:0:7416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000990a187a/0xdf60171e5a5d175a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1761 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.760187:0:7416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000990a187a/0xdf60171e5a5d175a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1761 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788834912.760192:0:7416:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:3.0:1788834912.760196:0:7416:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788834912.760200:0:7416:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9afdb279f000 10000000:01000000:3.0:1788834912.760203:0:7416:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1788834912.761061:0:7416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:3.0:1788834912.761063:0:7416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:3.0:1788834912.761090:0:7416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 000000003e82e6ae/0xdf60171e5a5d1768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.761098:0:7416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 000000003e82e6ae/0xdf60171e5a5d1768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.761106:0:7416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 000000003e82e6ae/0xdf60171e5a5d1768 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834912.761120:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e50da666 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253930624:0@lo:101: 00000100:00100000:3.0:1788834912.761162:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834912.761235:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 0000000093194c08 going to sleep for 11 seconds 00000100:00100000:0.0:1788834912.761275:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253930624 00000100:00100000:0.0:1788834912.761281:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253930624 00000100:00100000:0.0:1788834912.761396:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788834912.761403:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a5513dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+11:7416:x1875729253930624:12345-0@lo:101: 00010000:00010000:0.0:1788834912.761414:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788834912.761425:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000414d5b8f/0xdf60171e5a5d176f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1768 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834912.761457:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000414d5b8f/0xdf60171e5a5d176f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1768 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834912.761467:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000414d5b8f/0xdf60171e5a5d176f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1768 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834912.761476:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000414d5b8f, rc 0) 00000100:00100000:0.0:1788834912.761510:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a5513dc0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:7416:x1875729253930624:12345-0@lo:101: Request processed in 108us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834912.761516:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788834912.761554:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e50da666 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253930624:0@lo:101: 00010000:00010000:2.0:1788834912.761566:0:7416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 000000003e82e6ae/0xdf60171e5a5d1768 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d176f expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.761573:0:7416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 000000003e82e6ae/0xdf60171e5a5d1768 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d176f expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834912.761924:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bedf0fc3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253930752:0@lo:501: 00000100:00100000:2.0:1788834912.761954:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834912.761978:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 000000006aecd5cc going to sleep for 11 seconds 00000100:00100000:3.0:1788834912.762068:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253930752 00000100:00100000:3.0:1788834912.762073:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253930752 00000100:00100000:3.0:1788834912.762112:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788834912.762120:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c93fb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:7416:x1875729253930752:12345-0@lo:501: 00000100:00100000:3.0:1788834912.762348:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c93fb27 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:7416:x1875729253930752:12345-0@lo:501: Request processed in 228us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834912.762355:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788834912.762483:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bedf0fc3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253930752:0@lo:501: 00000100:00100000:2.0:1788834912.762511:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bedf0fc3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253930880:0@lo:503: 00000100:00100000:2.0:1788834912.762555:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834912.762622:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 000000006aecd5cc going to sleep for 11 seconds 00000100:00100000:1.0:1788834912.762698:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253930880 00000100:00100000:1.0:1788834912.762703:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253930880 00000100:00100000:1.0:1788834912.762766:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788834912.762773:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b99ed3ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:7416:x1875729253930880:12345-0@lo:503: 00000100:00100000:1.0:1788834912.762865:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b99ed3ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:7416:x1875729253930880:12345-0@lo:503: Request processed in 92us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834912.762872:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788834912.762940:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bedf0fc3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253930880:0@lo:503: 00000040:00080000:2.0:1788834912.763170:0:7416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788834912.763245:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bedf0fc3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253931008:0@lo:502: 00000100:00100000:2.0:1788834912.763279:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834912.766894:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 000000006aecd5cc going to sleep for 11 seconds 00000100:00100000:3.0:1788834912.767199:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253931008 00000100:00100000:3.0:1788834912.767208:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253931008 00000100:00100000:3.0:1788834912.767258:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788834912.767265:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b64a3cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:7416:x1875729253931008:12345-0@lo:502: 00000100:00100000:3.0:1788834912.767455:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b64a3cc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:7416:x1875729253931008:12345-0@lo:502: Request processed in 189us (4174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834912.767463:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1788834912.767843:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bedf0fc3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253931008:0@lo:502: 00000040:00080000:2.0:1788834912.768064:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1788834912.768094:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 136 off8552 00000040:00080000:2.0:1788834912.768107:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 176 off8728 00000040:00080000:2.0:1788834912.768118:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8952 00000040:00080000:2.0:1788834912.768129:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9176 00000040:00080000:2.0:1788834912.768140:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 120 off9296 00000040:00080000:2.0:1788834912.768151:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 112 off9408 00000040:00080000:2.0:1788834912.768173:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 160 off9568 00000040:00080000:2.0:1788834912.768184:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9792 00000040:00080000:2.0:1788834912.768195:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10016 00000040:00080000:2.0:1788834912.768207:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 88 off10104 00000040:00080000:2.0:1788834912.768221:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 144 off10248 00000040:00080000:2.0:1788834912.768251:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].13, 152 off10400 00000040:00080000:2.0:1788834912.768266:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].14, 168 off10568 00000040:00080000:2.0:1788834912.768281:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].15, 224 off10792 00000040:00080000:2.0:1788834912.768293:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].16, 224 off11016 00000040:00080000:2.0:1788834912.768306:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].17, 80 off11096 00000040:00080000:2.0:1788834912.768361:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].18, 224 off11320 00000040:00080000:2.0:1788834912.768376:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].19, 224 off11544 00000040:00080000:2.0:1788834912.768390:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].20, 160 off11704 00000040:00080000:2.0:1788834912.768403:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].21, 224 off11928 00000040:00080000:2.0:1788834912.768415:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].22, 224 off12152 00000040:00080000:2.0:1788834912.768428:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].23, 80 off12232 00000100:00100000:2.0:1788834912.768460:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bedf0fc3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253931136:0@lo:502: 00000100:00100000:2.0:1788834912.768516:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834912.768549:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 000000006aecd5cc going to sleep for 11 seconds 00000100:00100000:3.0:1788834912.768868:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253931136 00000100:00100000:3.0:1788834912.768881:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253931136 00000100:00100000:3.0:1788834912.768912:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788834912.768918:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000095fb2934 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:7416:x1875729253931136:12345-0@lo:502: 00000100:00100000:3.0:1788834912.769003:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000095fb2934 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:7416:x1875729253931136:12345-0@lo:502: Request processed in 85us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834912.769010:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788834912.769153:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bedf0fc3 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253931136:0@lo:502: 00000040:00080000:2.0:1788834912.769202:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].24, 224 off12456 00000040:00080000:2.0:1788834912.769209:0:7416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 24 count 25 00000020:01000000:3.0:1788834912.770916:0:7431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788834912.770930:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788834912.770933:0:7431:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788834912.770938:0:7431:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788834912.770941:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788834912.770976:0:7431:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (00000000bf3030aa) 00000020:00000080:3.0:1788834912.771006:0:7431:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lod with refcount 2 00000020:00000080:3.0:1788834912.771013:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788834912.771085:0:7431:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788834912.771094:0:7431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdf60171e5a5d177d 00000020:00000080:3.0:1788834912.771302:0:7431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788834912.771306:0:7431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788834912.771309:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788834912.771311:0:7431:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788834912.771351:0:7431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788834912.771356:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788834912.771358:0:7431:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788834912.771361:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788834912.771369:0:7431:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (00000000f8b3a784) 00000020:00000080:3.0:1788834912.771379:0:7431:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type mdt with refcount 2 00000020:00000080:3.0:1788834912.771382:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788834912.771384:0:7431:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788834912.771387:0:7431:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788834912.771393:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788834912.771724:0:7431:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006b846f67 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788834912.771752:0:7431:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (0000000031c258fb) 00000020:00000080:3.0:1788834912.771778:0:7431:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type mdd with refcount 2 00000004:01000000:3.0:1788834912.771930:0:7431:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788834912.771939:0:7431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdf60171e5a5d1792 00000020:00000080:3.0:1788834912.773543:0:7431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788834912.773563:0:7431:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788834912.773576:0:7431:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xdf60171e5a5d1799 00080000:01000000:3.0:1788834912.773588:0:7431:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788834912.773593:0:7431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdf60171e5a5d17a0 00080000:10000000:3.0:1788834912.774577:0:7431:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 40000000:02000000:3.0:1788834912.774802:0:7431:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0001: No data found on store. Initialize space. 00010000:00010000:2.0:1788834912.889049:0:7431:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:02000400:2.0:1788834912.889543:0:7431:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0001: new disk, initializing 00000001:00000004:2.0:1788834912.893800:0:7431:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1788834912.894287:0:7431:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0001: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788834912.914124:0:7431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:1.0:1788834912.914146:0:7431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788834912.914155:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788834912.914158:0:7431:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:1.0:1788834912.914162:0:7431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788834912.914169:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788834912.914170:0:7431:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:1.0:1788834912.914173:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788834912.914179:0:7431:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:00000080:1.0:1788834912.914217:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788834912.914247:0:7431:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (00000000118b493c) 00000020:00000080:1.0:1788834912.914278:0:7431:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1788834912.914287:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788834912.915611:0:7431:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:1.0:1788834912.915623:0:7431:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:1.0:1788834912.915635:0:7431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdf60171e5a5d17ae 00010000:00080000:1.0:1788834912.915687:0:7431:0:(ldlm_lib.c:102:import_set_conn()) imp 000000009059b186@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.122@tcp at head 00010000:00010000:1.0:1788834912.924311:0:7431:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-2 is initialized 00000020:00000080:1.0:1788834912.932776:0:7431:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788834912.932799:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788834912.932917:0:7431:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:1.0:1788834912.932944:0:7431:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdf60171e5a5d17b5 00000100:00080000:1.0:1788834912.932957:0:7431:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788834912.932963:0:7431:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import 000000009059b186 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788834912.933010:0:7431:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000f86b1f47 x1875729253931264/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788834912.933082:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f86b1f47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729253931264:0@lo:38: 00000100:00080000:1.0:1788834912.933830:0:7431:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:1.0:1788834912.934075:0:7431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788834912.934082:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788834912.934085:0:7431:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:1.0:1788834912.934089:0:7431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788834912.934096:0:7431:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1788834912.934101:0:7431:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000100:00100000:2.0:1788834912.934103:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1788834912.934105:0:7431:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788834912.934111:0:7431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788834912.934117:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788834912.934118:0:7431:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788834912.934123:0:7431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788834912.934128:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788834912.934131:0:7431:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:1.0:1788834912.934136:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1788834912.934217:0:7431:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1788834912.934238:0:7431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788834912.934241:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788834912.934243:0:7431:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:1.0:1788834912.934245:0:7431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788834912.934247:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788834912.934248:0:7431:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788834912.934251:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788834912.934253:0:7431:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788834912.934293:0:7431:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788834912.934296:0:7431:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788834912.934298:0:7431:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788834912.934301:0:7431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000100:00100000:3.0:1788834912.934801:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253931264 00000100:00100000:3.0:1788834912.934814:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253931264 00000100:00100000:3.0:1788834912.934877:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788834912.934886:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bedf0fc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875729253931264:12345-0@lo:38: 00010000:00080000:3.0:1788834912.934919:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 154 last 0 00000020:00000080:3.0:1788834912.934973:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdf60171e5a5d17bc 00000004:00100000:3.0:1788834912.934997:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:3.0:1788834912.935004:0:6492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000020:01000000:2.0:1788834912.935187:0:7416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-24 (rc=0) 10000000:01000000:2.0:1788834912.935236:0:7416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788834912.935276:0:7416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 000000003e82e6ae/0xdf60171e5a5d1768 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d176f expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.935288:0:7416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 000000003e82e6ae/0xdf60171e5a5d1768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d176f expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834912.935297:0:7416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afdb279f000 from 1 10000000:01000000:2.0:1788834912.935300:0:7416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788834912.935374:0:7416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 000000000ff03c85/0xdf60171e5a5d17c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.935382:0:7416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 000000000ff03c85/0xdf60171e5a5d17c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.935459:0:7416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 000000000ff03c85/0xdf60171e5a5d17c3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834912.935481:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009375dd4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253931392:0@lo:101: 00000100:00100000:2.0:1788834912.935543:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834912.935602:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ca73d76f going to sleep for 11 seconds 00000100:00100000:1.0:1788834912.935645:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253931392 00000100:00100000:1.0:1788834912.935652:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253931392 00000100:00100000:1.0:1788834912.935715:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788834912.935725:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b89175c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:7416:x1875729253931392:12345-0@lo:101: 00010000:00010000:1.0:1788834912.935742:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788834912.935761:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000095cd8689/0xdf60171e5a5d17ca lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d17c3 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834912.935788:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000095cd8689/0xdf60171e5a5d17ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d17c3 expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834912.935799:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000095cd8689/0xdf60171e5a5d17ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d17c3 expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834912.935809:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000095cd8689, rc 0) 00000100:00100000:1.0:1788834912.935899:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b89175c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:7416:x1875729253931392:12345-0@lo:101: Request processed in 176us (355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834912.935906:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788834912.936135:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009375dd4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253931392:0@lo:101: 00010000:00010000:2.0:1788834912.936154:0:7416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 000000000ff03c85/0xdf60171e5a5d17c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d17ca expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.936164:0:7416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 000000000ff03c85/0xdf60171e5a5d17c3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d17ca expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834912.939150:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009375dd4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253931520:0@lo:256: 00000100:00100000:0.0:1788834912.942585:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788834912.942618:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001c40de55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729253931648:0@lo:400: 00000100:00100000:0.0:1788834912.946828:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834912.947234:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253931648 00000100:00100000:3.0:1788834912.947247:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253931648 00000100:00100000:3.0:1788834912.948353:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788834912.948373:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ad0cfc3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729253931648:12345-0@lo:400: 00000100:00100000:3.0:1788834912.949374:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ad0cfc3c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729253931648:12345-0@lo:400: Request processed in 1002us (2548us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834912.949388:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788834912.949704:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000001c40de55 x1875729253931648/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834928 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834912.949722:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001c40de55 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729253931648:0@lo:400: 00000100:00100000:2.0:1788834912.950469:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788834912.954579:0:6492:0:(import.c:65:import_set_state_nolock()) 0000000029ba41d2 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788834912.954712:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bedf0fc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3613:x1875729253931264:12345-0@lo:38: Request processed in 19823us (20620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834912.954729:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788834912.955069:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788834912.955080:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 1 00000100:00080000:3.0:1788834912.955089:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788834912.955096:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788834912.955107:0:3613:0:(import.c:65:import_set_state_nolock()) 000000009059b186 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788834912.955126:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f86b1f47 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729253931264:0@lo:38: 00000100:00100000:1.0:1788834912.955679:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788834912.955693:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066143a86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253931776:0@lo:41: 00000100:00100000:1.0:1788834912.955759:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834912.955995:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253931776 00000100:00100000:1.0:1788834912.956004:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253931776 00000100:00100000:1.0:1788834912.956063:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788834912.956072:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000014300e29 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3615:x1875729253931776:12345-0@lo:41: 00000004:00000024:1.0:1788834912.956108:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:1.0:1788834912.956154:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000014300e29 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3615:x1875729253931776:12345-0@lo:41: Request processed in 83us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834912.956162:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788834912.956197:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066143a86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253931776:0@lo:41: 00000100:00100000:1.0:1788834912.956829:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253931520 00000100:00100000:1.0:1788834912.956846:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253931520 00000100:00100000:1.0:1788834912.956883:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788834912.956891:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000aa24524 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:7416:x1875729253931520:12345-0@lo:256: 20000000:01000000:1.0:1788834912.956911:0:6483:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788834912.956939:0:6483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788834912.956942:0:6483:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1788834912.957053:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000aa24524 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:7416:x1875729253931520:12345-0@lo:256: Request processed in 162us (6587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834912.957067:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788834912.959059:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ca73d76f going to sleep for 11 seconds 00000100:00100000:3.0:1788834912.959122:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009375dd4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253931520:0@lo:256: 10000000:01000000:3.0:1788834912.960765:0:7416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788834912.960978:0:7416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 000000000ff03c85/0xdf60171e5a5d17c3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d17ca expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.960996:0:7416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 000000000ff03c85/0xdf60171e5a5d17c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d17ca expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788834912.961006:0:7416:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afdb279f000 from 1 10000000:01000000:3.0:1788834912.961009:0:7416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788834912.961060:0:7416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 000000006805d956/0xdf60171e5a5d17d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.961067:0:7416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 000000006805d956/0xdf60171e5a5d17d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.961078:0:7416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 000000006805d956/0xdf60171e5a5d17d1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834912.961106:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000007c69558 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253931904:0@lo:101: 00000100:00100000:3.0:1788834912.961206:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834912.961303:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d3f3f7e8 going to sleep for 11 seconds 00000100:00100000:1.0:1788834912.961545:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253931904 00000100:00100000:1.0:1788834912.961556:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253931904 00000100:00100000:1.0:1788834912.961611:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788834912.961621:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e3505b17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:7416:x1875729253931904:12345-0@lo:101: 00010000:00010000:1.0:1788834912.961639:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788834912.961730:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000132138b4/0xdf60171e5a5d17d8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d17d1 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834912.961763:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000132138b4/0xdf60171e5a5d17d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d17d1 expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834912.961776:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000132138b4/0xdf60171e5a5d17d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d17d1 expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834912.961914:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000132138b4, rc 0) 00000100:00100000:1.0:1788834912.962043:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e3505b17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:7416:x1875729253931904:12345-0@lo:101: Request processed in 424us (837us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834912.962050:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788834912.962128:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000007c69558 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253931904:0@lo:101: 00010000:00010000:3.0:1788834912.962146:0:7416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 000000006805d956/0xdf60171e5a5d17d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d17d8 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834912.962291:0:7416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 000000006805d956/0xdf60171e5a5d17d1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d17d8 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834912.962528:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000007c69558 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253932032:0@lo:501: 00000100:00100000:3.0:1788834912.962566:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834912.962635:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d3f3f7e8 going to sleep for 11 seconds 00000100:00100000:1.0:1788834912.962751:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253932032 00000100:00100000:1.0:1788834912.962759:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253932032 00000100:00100000:1.0:1788834912.962838:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788834912.962854:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009ef363b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:7416:x1875729253932032:12345-0@lo:501: 00000100:00100000:1.0:1788834912.962981:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009ef363b8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:7416:x1875729253932032:12345-0@lo:501: Request processed in 136us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834912.962989:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788834912.963027:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000007c69558 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253932032:0@lo:501: 00000100:00100000:1.0:1788834912.963074:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066143a86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253932160:0@lo:503: 00000100:00100000:1.0:1788834912.963112:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834912.963127:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f58c8b27 going to sleep for 11 seconds 00000100:00100000:1.0:1788834912.963141:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253932160 00000100:00100000:1.0:1788834912.963145:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253932160 00000100:00100000:1.0:1788834912.963174:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788834912.963513:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005e35cb74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:7416:x1875729253932160:12345-0@lo:503: 00000040:00080000:1.0:1788834912.963554:0:6481:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788834912.963599:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005e35cb74 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:7416:x1875729253932160:12345-0@lo:503: Request processed in 90us (487us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834912.963607:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788834912.963670:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066143a86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253932160:0@lo:503: 00000040:00080000:1.0:1788834912.964026:0:7416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788834912.964096:0:7416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 1 count 1 00000040:00080000:1.0:1788834912.964539:0:7416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788834912.968588:0:7436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 00000020:01000000:2.0:1788834912.969142:0:7416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1788834912.969197:0:7416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788834912.975980:0:7416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 000000006805d956/0xdf60171e5a5d17d1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d17d8 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.976007:0:7416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 000000006805d956/0xdf60171e5a5d17d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d17d8 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834912.982180:0:7416:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1788834912.982192:0:7416:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9afdb279f000 10000000:01000000:1.0:1788834912.982196:0:7416:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9afdb279f000 10000000:01000000:1.0:1788834912.982201:0:7416:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788834912.983111:0:7416:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afdb279f000 from 1 10000000:01000000:1.0:1788834912.983117:0:7416:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788834912.983175:0:7416:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 0000000076d8e01f/0xdf60171e5a5d17df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834912.983190:0:7416:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 0000000076d8e01f/0xdf60171e5a5d17df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834912.983202:0:7416:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 0000000076d8e01f/0xdf60171e5a5d17df lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834912.984126:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066143a86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253932288:0@lo:101: 00000100:00100000:1.0:1788834912.984740:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834912.985132:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253932288 00000100:00100000:2.0:1788834912.985143:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253932288 00000100:00100000:1.0:1788834912.985497:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b6879ee going to sleep for 11 seconds 00000100:00100000:2.0:1788834912.986656:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788834912.986680:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fd40f297 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:7416:x1875729253932288:12345-0@lo:101: 00010000:00010000:2.0:1788834912.986703:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788834912.986726:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000041a11a50/0xdf60171e5a5d17e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d17df expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.986760:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000041a11a50/0xdf60171e5a5d17e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d17df expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.986772:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000041a11a50/0xdf60171e5a5d17e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d17df expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834912.986783:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000041a11a50, rc 0) 00000100:00100000:2.0:1788834912.986889:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fd40f297 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:7416:x1875729253932288:12345-0@lo:101: Request processed in 220us (2152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834912.986896:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788834912.987062:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066143a86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253932288:0@lo:101: 00010000:00010000:1.0:1788834912.987083:0:7416:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 0000000076d8e01f/0xdf60171e5a5d17df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d17e6 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834912.987093:0:7416:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 0000000076d8e01f/0xdf60171e5a5d17df lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d17e6 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834912.987236:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066143a86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253932416:0@lo:501: 00000100:00100000:1.0:1788834912.987352:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834912.995355:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b6879ee going to sleep for 11 seconds 00000100:00100000:3.0:1788834912.995367:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253932416 00000100:00100000:3.0:1788834912.995383:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253932416 00000100:00100000:2.0:1788834912.998665:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788834912.998700:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a43bc10b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:7416:x1875729253932416:12345-0@lo:501: 00000100:00100000:2.0:1788834913.002516:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a43bc10b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:7416:x1875729253932416:12345-0@lo:501: Request processed in 3825us (15154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834913.002552:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788834913.009812:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066143a86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253932416:0@lo:501: 00000100:00100000:1.0:1788834913.009912:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066143a86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253932544:0@lo:503: 00000100:00100000:0.0:1788834913.010135:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834913.010353:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b6879ee going to sleep for 11 seconds 00000100:00100000:3.0:1788834913.013017:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253932544 00000100:00100000:3.0:1788834913.013039:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253932544 00000100:00100000:3.0:1788834913.014411:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788834913.014440:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ab0774b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:7416:x1875729253932544:12345-0@lo:503: 00000100:00100000:3.0:1788834913.014690:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ab0774b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:7416:x1875729253932544:12345-0@lo:503: Request processed in 263us (4555us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834913.014698:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788834913.014866:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066143a86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253932544:0@lo:503: 00000040:00080000:1.0:1788834913.015280:0:7416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788834913.015445:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066143a86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253932672:0@lo:502: 00000100:00100000:1.0:1788834913.015508:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834913.016188:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 000000002b6879ee going to sleep for 11 seconds 00000100:00100000:0.0:1788834913.016192:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253932672 00000100:00100000:0.0:1788834913.016355:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253932672 00000100:00100000:0.0:1788834913.016419:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788834913.016428:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c5a44eb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:7416:x1875729253932672:12345-0@lo:502: 00000100:00100000:0.0:1788834913.017609:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c5a44eb0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:7416:x1875729253932672:12345-0@lo:502: Request processed in 1173us (2092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834913.017623:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788834913.021509:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066143a86 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253932672:0@lo:502: 00000040:00080000:1.0:1788834913.023656:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1788834913.023727:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1788834913.023745:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1788834913.023776:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788834913.026114:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788834913.026156:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788834913.026174:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788834913.026187:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788834913.026202:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788834913.026216:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788834913.026228:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788834913.026240:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788834913.026251:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788834913.026262:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788834913.026274:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788834913.026288:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788834913.026299:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788834913.026312:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788834913.026364:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788834913.026376:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788834913.026387:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788834913.026398:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788834913.026421:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788834913.026436:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788834913.026448:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788834913.026459:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788834913.026471:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788834913.026482:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000100:00100000:2.0:1788834913.026540:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009375dd4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253932800:0@lo:502: 00000100:00100000:2.0:1788834913.026648:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834913.026711:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 000000004cd77f0d going to sleep for 11 seconds 00000100:00100000:1.0:1788834913.027023:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253932800 00000100:00100000:1.0:1788834913.027034:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253932800 00000100:00100000:1.0:1788834913.027104:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788834913.027115:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f64389c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:7416:x1875729253932800:12345-0@lo:502: 00000100:00100000:1.0:1788834913.027309:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f64389c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:7416:x1875729253932800:12345-0@lo:502: Request processed in 195us (660us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834913.027359:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788834913.027701:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009375dd4f pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253932800:0@lo:502: 00000040:00080000:2.0:1788834913.027809:0:7416:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788834913.027830:0:7416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1788834913.028846:0:7437:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:2.0:1788834913.028867:0:7437:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (000000002a3b1e65) 00000020:00000080:2.0:1788834913.028896:0:7437:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1788834913.029002:0:7437:0:(tgt_mount.c:153:server_get_mount()) get mount 000000006b846f67 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788834913.029007:0:7437:0:(tgt_mount.c:187:server_put_mount()) put mount 000000006b846f67 from lustre-MDT0001, refs=3 00000020:01000004:2.0:1788834913.029010:0:7437:0:(obd_mount.c:710:lustre_put_lsi()) put 000000006b846f67 3 00010000:00080000:2.0:1788834913.029046:0:7437:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000088e7ce5e@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1788834913.032196:0:7437:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-3 is initialized 00000020:00000080:2.0:1788834913.032556:0:7437:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:2.0:1788834913.032610:0:7437:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788834913.032626:0:7437:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xdf60171e5a5d17f4 00000100:00080000:2.0:1788834913.032639:0:7437:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788834913.032644:0:7437:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import 0000000088e7ce5e using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788834913.032688:0:7437:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000009375dd4f x1875729253932928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788834913.032720:0:7437:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1788834913.033369:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000009375dd4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875729253932928:0@lo:38: 00000100:00100000:3.0:1788834913.033470:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834913.033597:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253932928 00000100:00100000:2.0:1788834913.033607:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253932928 00000100:00100000:2.0:1788834913.033686:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788834913.033695:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000003dd3661 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875729253932928:12345-0@lo:38: 00010000:00080000:2.0:1788834913.033722:0:6487:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:2.0:1788834913.033762:0:6487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xdf60171e5a5d17fb 00000004:00100000:2.0:1788834913.033779:0:6487:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788834913.034529:0:6487:0:(import.c:65:import_set_state_nolock()) 000000008eb3f9c1 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788834913.034624:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000003dd3661 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1875729253932928:12345-0@lo:38: Request processed in 927us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834913.034634:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788834913.034757:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066143a86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875729253933056:0@lo:400: 00000100:00100000:1.0:1788834913.034976:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834913.038687:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788834913.038728:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a2b4ca5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253933184:0@lo:400: 00000100:00100000:0.0:1788834913.038996:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834913.039079:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253933184 00000100:00100000:0.0:1788834913.039089:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253933184 00000100:00100000:0.0:1788834913.039165:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788834913.039174:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cab7afe4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1875729253933184:12345-0@lo:400: 00000100:00100000:0.0:1788834913.039244:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cab7afe4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3617:x1875729253933184:12345-0@lo:400: Request processed in 71us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834913.039252:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788834913.039348:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a2b4ca5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253933184:0@lo:400: 00010000:00080000:1.0:1788834913.041494:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000009375dd4f x1875729253932928/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788834923 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834913.041513:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788834913.041526:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788834913.041537:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1788834913.041544:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788834913.041548:0:3613:0:(import.c:65:import_set_state_nolock()) 0000000088e7ce5e lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788834913.041555:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000009375dd4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875729253932928:0@lo:38: 00000100:00100000:3.0:1788834913.043005:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253933056 00000100:00100000:3.0:1788834913.043024:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253933056 00000100:00100000:3.0:1788834913.043267:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788834913.043282:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000055713c22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875729253933056:12345-0@lo:400: 00000100:00100000:3.0:1788834913.043510:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000055713c22 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875729253933056:12345-0@lo:400: Request processed in 232us (8534us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834913.043518:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:2.0:1788834913.043586:0:7437:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00010000:00080000:1.0:1788834913.044076:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000066143a86 x1875729253933056/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834929 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834913.044096:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066143a86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875729253933056:0@lo:400: 40000000:00080000:1.0:1788834913.044178:0:7438:0:(fid_handler.c:282:seq_server_check_and_alloc_super()) srv-lustre-MDT0001: Can't allocate super-sequence: rc = -115 00000020:01000000:0.0:1788834913.046127:0:7416:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1788834913.046190:0:7416:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788834913.046270:0:7416:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 0000000076d8e01f/0xdf60171e5a5d17df lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d17e6 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834913.046285:0:7416:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 0000000076d8e01f/0xdf60171e5a5d17df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d17e6 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788834913.046966:0:7416:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788834913.046970:0:7416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788834913.046971:0:7416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788834913.046972:0:7416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788834913.046973:0:7416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788834913.046975:0:7416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788834913.046976:0:7416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788834913.046977:0:7416:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788834913.046979:0:7416:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788834913.046981:0:7416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788834913.046982:0:7416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788834913.046987:0:7416:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020061 00000020:01000004:0.0:1788834913.046990:0:7416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788834913.046992:0:7416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788834913.046993:0:7416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788834913.046994:0:7416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788834913.046995:0:7416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788834913.046996:0:7416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788834913.046997:0:7416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788834913.046998:0:7416:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788834913.047079:0:7416:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788834913.047080:0:7416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788834913.047081:0:7416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788834913.047118:0:7416:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:0.0:1788834913.047142:0:7416:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a469f3c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253933312:0@lo:253: 00000100:00100000:0.0:1788834913.047364:0:7416:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834913.047430:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253933312 00000100:00100000:2.0:1788834913.047442:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253933312 00000100:00100000:2.0:1788834913.047525:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788834913.047537:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000093a16ffb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:7416:x1875729253933312:12345-0@lo:253: 20000000:01000000:2.0:1788834913.047589:0:6483:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788834913.047613:0:6483:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1788834913.047996:0:7416:0:(client.c:2715:ptlrpc_set_wait()) set 0000000025ff2a4a going to sleep for 11 seconds 00000001:00100000:0.0:1788834913.051662:0:6467:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788834913.051821:0:6483:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788834913.051835:0:6483:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788834913.052706:0:6503:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788834913.052714:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788834913.052868:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d1802 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834913.052903:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000ffa9191c/0xdf60171e5a5d171b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1714 expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834913.052911:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000095cd8689/0xdf60171e5a5d17ca lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d17c3 expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834913.052919:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d1802 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834913.052971:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000095cd8689/0xdf60171e5a5d17ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d17c3 expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834913.053299:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000095cd8689/0xdf60171e5a5d17ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d17c3 expref: 15 pid: 6481 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834913.053356:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007547d1df pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875729253933440:0@lo:104: 00000100:00100000:0.0:1788834913.053447:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788834913.053518:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000ffa9191c/0xdf60171e5a5d171b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1714 expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834913.053542:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000ffa9191c/0xdf60171e5a5d171b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1714 expref: 15 pid: 6481 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834913.053552:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000658bfc79 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875729253933568:0@lo:104: 00000100:00100000:2.0:1788834913.053556:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253933440 00000100:00100000:2.0:1788834913.053573:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253933440 00000100:00100000:0.0:1788834913.053580:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834913.053608:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ece9e50b going to sleep for 11 seconds 00000100:00100000:2.0:1788834913.053631:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253933568 00000100:00100000:2.0:1788834913.053638:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253933568 00000100:00100000:0.0:1788834913.053649:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788834913.053757:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000039b3d49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:6503:x1875729253933440:12345-0@lo:104: 00010000:00010000:0.0:1788834913.053773:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: 000000000ff03c85/0xdf60171e5a5d17c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d17ca expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834913.054925:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788834913.054937:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000039b3d49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:6503:x1875729253933440:12345-0@lo:104: Request processed in 1275us (1489us total) trans 0 rc 0/0 00010000:00010000:1.0:1788834913.055629:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788834913.055639:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 000000000ff03c85/0xdf60171e5a5d17c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d17ca expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834913.055665:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000000ff03c85 already unused, calling callback (00000000f6c941bc) 10000000:00010000:1.0:1788834913.055669:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 000000000ff03c85/0xdf60171e5a5d17c3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d17ca expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834913.055679:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 000000000ff03c85/0xdf60171e5a5d17c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d17ca expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788834913.055686:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 000000000ff03c85/0xdf60171e5a5d17c3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d17ca expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834913.055692:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788834913.055749:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 000000000ff03c85/0xdf60171e5a5d17c3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d17ca expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834913.055755:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788834913.055787:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 000000000ff03c85/0xdf60171e5a5d17c3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d17ca expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834913.055794:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 000000000ff03c85/0xdf60171e5a5d17c3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d17ca expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834913.057121:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834913.057126:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834913.057129:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788834913.058177:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000093a16ffb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:7416:x1875729253933312:12345-0@lo:253: Request processed in 10631us (10853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834913.058197:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788834913.063184:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788834913.063240:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788834913.063258:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f3ae8e1d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:6503:x1875729253933568:12345-0@lo:104: 00010000:00010000:0.0:1788834913.063286:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: 00000000f01189cb/0xdf60171e5a5d1714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d171b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834913.063420:0:6471:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1788834913.063440:0:6471:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:0.0:1788834913.063451:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788834913.063457:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f3ae8e1d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:6503:x1875729253933568:12345-0@lo:104: Request processed in 209us (9878us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834913.063464:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788834913.063489:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788834913.063510:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066143a86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253933696:0@lo:103: 00000100:00100000:0.0:1788834913.063579:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788834913.063951:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788834913.063960:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 00000000f01189cb/0xdf60171e5a5d1714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d171b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834913.063977:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253933696 00010000:00010000:1.0:1788834913.063978:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000f01189cb already unused, calling callback (00000000f6c941bc) 10000000:00010000:1.0:1788834913.063985:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 00000000f01189cb/0xdf60171e5a5d1714 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d171b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834913.063990:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253933696 00010000:00010000:1.0:1788834913.063995:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 00000000f01189cb/0xdf60171e5a5d1714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d171b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788834913.064006:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 00000000f01189cb/0xdf60171e5a5d1714 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d171b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834913.064020:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007547d1df pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875729253933440:0@lo:104: 00010000:00010000:3.0:1788834913.064028:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000095cd8689/0xdf60171e5a5d17ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d17c3 expref: 15 pid: 6481 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834913.064031:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000658bfc79 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875729253933568:0@lo:104: 00010000:00010000:0.0:1788834913.064053:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d1802 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834913.064057:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788834913.064063:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4c1c80f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:3616:x1875729253933696:12345-0@lo:103: 00010000:00010000:3.0:1788834913.064075:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788834913.064079:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000095cd8689/0xdf60171e5a5d17ca lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d17c3 expref: 15 pid: 6481 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834913.064085:0:7416:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a469f3c8 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:7416:1875729253933312:0@lo:253: 00010000:00010000:3.0:1788834913.064089:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000095cd8689/0xdf60171e5a5d17ca lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d17c3 expref: 15 pid: 6481 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788834913.064094:0:7416:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:0.0:1788834913.064098:0:7416:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788834913.064100:0:7416:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:0.0:1788834913.064101:0:7416:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788834913.064102:0:7416:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788834913.064103:0:7416:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00010000:00010000:3.0:1788834913.064108:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000095cd8689/0xdf60171e5a5d17ca lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d17c3 expref: 15 pid: 6481 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834913.064126:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788834913.064165:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4c1c80f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:3616:x1875729253933696:12345-0@lo:103: Request processed in 103us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834913.064171:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000020:01000004:0.0:1788834913.064180:0:7416:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788834913.064181:0:7416:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788834913.064183:0:7416:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788834913.064184:0:7416:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788834913.064186:0:7416:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788834913.064187:0:7416:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788834913.064200:0:7416:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788834913.064201:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066143a86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253933696:0@lo:103: 10000000:01000000:1.0:1788834913.064485:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788834913.064534:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 00000000f01189cb/0xdf60171e5a5d1714 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d171b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834913.064543:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788834913.064573:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 00000000f01189cb/0xdf60171e5a5d1714 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d171b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834913.064579:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 00000000f01189cb/0xdf60171e5a5d1714 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d171b expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834913.064595:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834913.064597:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834913.064599:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788834913.064609:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788834913.064620:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004772addc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729253933824:0@lo:103: 00000100:00100000:1.0:1788834913.064662:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834913.064706:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253933824 00000100:00100000:1.0:1788834913.064711:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253933824 00010000:00010000:1.0:1788834913.064748:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000ffa9191c/0xdf60171e5a5d171b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1714 expref: 14 pid: 6481 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834913.064774:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788834913.065366:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002b9b6839 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:3615:x1875729253933824:12345-0@lo:103: 00010000:00010000:1.0:1788834913.065381:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788834913.065693:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000ffa9191c/0xdf60171e5a5d171b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1714 expref: 14 pid: 6481 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834913.065711:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000ffa9191c/0xdf60171e5a5d171b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1714 expref: 14 pid: 6481 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834913.065729:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ffa9191c/0xdf60171e5a5d171b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1714 expref: 14 pid: 6481 timeout: 305 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834913.065750:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d1802 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834913.065759:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d1802 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788834913.065789:0:6474:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014516741s 00010000:00010000:1.0:1788834913.065794:0:6474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d1802 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834913.065801:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d1802 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834913.065807:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d1802 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834913.065813:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d1802 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834913.067294:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b86c7e54 already unused, calling callback (00000000a5212b7f) 00010000:00010000:1.0:1788834913.067300:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d1802 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834913.067310:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d1802 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834913.067370:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d1802 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834913.067393:0:6503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d1802 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834913.067406:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d1802 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834913.067413:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b86c7e54/0xdf60171e5a5d1802 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834913.067470:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788834913.067582:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002b9b6839 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:3615:x1875729253933824:12345-0@lo:103: Request processed in 2799us (2917us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834913.067594:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788834913.067891:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004772addc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729253933824:0@lo:103: 00080000:10000000:0.0:1788834913.074082:0:7416:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00080000:10000000:0.0:1788834913.074570:0:7416:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:0.0:1788834913.074856:0:7416:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788834913.075123:0:7416:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788834913.075618:0:7416:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788834913.075871:0:7416:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:10000000:1.0:1788834913.078676:0:7416:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788834913.079001:0:7416:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00080000:10000000:1.0:1788834913.079229:0:7416:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00080000:10000000:1.0:1788834913.079438:0:7416:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00080000:10000000:1.0:1788834913.079615:0:7416:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00080000:10000000:1.0:1788834913.079806:0:7416:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00000040:01000000:3.0:1788834913.089666:0:7416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:1.0:1788834913.090159:0:7443:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:1.0:1788834913.090165:0:7443:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788834913.090933:0:7444:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000100:00100000:2.0:1788834913.091007:0:7444:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000866cb3da pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7444:1875729253933952:0@lo:700: 00000100:00100000:2.0:1788834913.091117:0:7444:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:01000000:3.0:1788834913.091147:0:7416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788834913.091182:0:7444:0:(client.c:2715:ptlrpc_set_wait()) set 000000004e238417 going to sleep for 11 seconds 00000100:00100000:0.0:1788834913.091368:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253933952 00000100:00100000:0.0:1788834913.091378:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253933952 00000100:00100000:0.0:1788834913.091436:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788834913.091444:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f46520c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7444:x1875729253933952:12345-0@lo:700: 00000100:00100000:1.0:1788834913.093591:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003cc24f40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1875729253934080:0@lo:1000: 00000100:00100000:1.0:1788834913.093686:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834913.093740:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 000000003001c3e9 going to sleep for 11 seconds 00000100:00100000:0.0:1788834913.094188:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253934080 00000100:00100000:0.0:1788834913.094200:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253934080 00000100:00100000:0.0:1788834913.094667:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788834913.094678:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000417519d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1875729253934080:12345-0@lo:1000: 00000040:01000000:3.0:1788834913.095302:0:7416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:3.0:1788834913.095690:0:7416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788834913.095947:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000417519d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1875729253934080:12345-0@lo:1000: Request processed in 1268us (2259us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834913.095960:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:00000080:3.0:1788834913.096727:0:7416:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1788834913.096747:0:7416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:3.0:1788834913.097615:0:7416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 40000000:02000000:0.0:1788834913.102722:0:6494:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:1:mdt 00000100:00100000:2.0:1788834913.106616:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003cc24f40 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1875729253934080:0@lo:1000: 00000040:01000000:2.0:1788834913.106684:0:7445:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000100:00100000:2.0:1788834913.106748:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e90c8ec pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1875729253934208:0@lo:700: 00000040:00080000:3.0:1788834913.108098:0:7416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000100:00100000:2.0:1788834913.108783:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834913.108876:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d25deb86 going to sleep for 11 seconds 00000100:00100000:1.0:1788834913.109079:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253934208 00000100:00100000:1.0:1788834913.109091:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253934208 00000100:00100000:1.0:1788834913.109153:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788834913.109180:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c50c2e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7445:x1875729253934208:12345-0@lo:700: 00000100:00100000:1.0:1788834913.110156:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c50c2e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0001-mdtlov_UUID+5:7445:x1875729253934208:12345-0@lo:700: Request processed in 972us (1372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834913.110168:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788834913.110368:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e90c8ec pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1875729253934208:0@lo:700: 00000100:00100000:2.0:1788834913.110689:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e90c8ec pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7445:1875729253934336:0@lo:900: 00000100:00100000:2.0:1788834913.110740:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788834913.112796:0:7416:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1788834913.113017:0:7416:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000040:00080000:3.0:1788834913.113374:0:7416:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1788834913.113638:0:7416:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000100:00100000:2.0:1788834913.114542:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d25deb86 going to sleep for 11 seconds 00000100:00100000:1.0:1788834913.117583:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253934336 00000100:00100000:1.0:1788834913.117608:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253934336 00000100:00100000:1.0:1788834913.117700:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788834913.117711:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b9a189c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7445:x1875729253934336:12345-0@lo:900: 00100000:10000000:3.0:1788834913.120356:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00000100:00100000:1.0:1788834913.120778:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b9a189c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+6:7445:x1875729253934336:12345-0@lo:900: Request processed in 3063us (10031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834913.120794:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:3.0:1788834913.121121:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1788834913.121310:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1788834913.121654:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00000100:00100000:0.0:1788834913.122023:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f46520c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:7444:x1875729253933952:12345-0@lo:700: Request processed in 30576us (30903us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834913.122035:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00100000:10000000:3.0:1788834913.122201:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1788834913.122313:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00010000:00080000:2.0:1788834913.122453:0:7444:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@00000000866cb3da x1875729253933952/t0(0) o700->lustre-MDT0000-lwp-MDT0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788834929 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834913.122473:0:7444:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000866cb3da pname:cluuid:pid:xid:nid:opc:job lod0001_rec0001:lustre-MDT0000-lwp-MDT0001_UUID:7444:1875729253933952:0@lo:700: 40000000:02000000:2.0:1788834913.122491:0:7444:0:(fid_request.c:122:seq_client_rpc()) cli-ctl-lustre-MDT0001: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:1:mdt] 00100000:10000000:3.0:1788834913.122584:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1788834913.122723:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1788834913.123100:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1788834913.123217:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1788834913.123404:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1788834913.123540:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1788834913.123740:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00010000:00080000:0.0:1788834913.123768:0:7445:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000003e90c8ec x1875729253934336/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788834929 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834913.123785:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e90c8ec pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:7445:1875729253934336:0@lo:900: 00000100:00100000:0.0:1788834913.123957:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a469f3c8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1875729253934464:0@lo:1000: 00000100:00100000:0.0:1788834913.124033:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834913.124077:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 000000002fd32363 going to sleep for 11 seconds 00100000:10000000:3.0:1788834913.124186:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1788834913.124366:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1788834913.124523:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1788834913.125292:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1788834913.125506:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1788834913.125636:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1788834913.125801:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1788834913.125991:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1788834913.126487:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1788834913.126602:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1788834913.126747:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1788834913.126945:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00000100:00100000:1.0:1788834913.126989:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253934464 00000100:00100000:1.0:1788834913.127003:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253934464 00000100:00100000:1.0:1788834913.127075:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788834913.127086:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000658bfc79 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7445:x1875729253934464:12345-0@lo:1000: 00000100:00100000:1.0:1788834913.127240:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000658bfc79 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7445:x1875729253934464:12345-0@lo:1000: Request processed in 156us (3208us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834913.127249:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00100000:10000000:3.0:1788834913.127571:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1788834913.127692:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00000100:00100000:0.0:1788834913.127723:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a469f3c8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1875729253934464:0@lo:1000: 00000004:00080000:0.0:1788834913.127824:0:7445:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 0000000009b97218 with version 0 00000020:00100000:0.0:1788834913.127856:0:7445:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:0.0:1788834913.127863:0:7445:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000a469f3c8 x1875729253934720/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788834913.127885:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a469f3c8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1875729253934720:0@lo:1000: 00000100:00100000:0.0:1788834913.127933:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00100000:10000000:3.0:1788834913.127955:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00000100:00100000:0.0:1788834913.127978:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ea1108bb going to sleep for 11 seconds 00000100:00100000:1.0:1788834913.128136:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253934720 00000100:00100000:1.0:1788834913.128144:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253934720 00000100:00100000:1.0:1788834913.128189:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788834913.128197:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007547d1df pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7445:x1875729253934720:12345-0@lo:1000: 00100000:10000000:3.0:1788834913.128247:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1788834913.128512:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1788834913.128651:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1788834913.129110:0:7416:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0001-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1788834913.129368:0:7416:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00000001:00080000:1.0:1788834913.141956:0:7416:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1788834913.142009:0:7416:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffadff41b27988 00100000:10000000:1.0:1788834913.142019:0:7416:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000001:00080000:0.0:1788834913.142199:0:6467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000100:00100000:1.0:1788834913.142793:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007547d1df pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:7445:x1875729253934720:12345-0@lo:1000: Request processed in 14590us (14853us total) trans 4294967297 rc 0/0 00000004:00080000:2.0:1788834913.143135:0:7445:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788834913.143141:0:7445:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788834913.143159:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a469f3c8 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1875729253934720:0@lo:1000: 00000100:00100000:2.0:1788834913.143264:0:7445:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000866cb3da pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1875729253934848:0@lo:1000: 00000100:00100000:1.0:1788834913.144060:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788834913.144757:0:7445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000004:1.0:1788834913.145121:0:7416:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788834913.145162:0:7416:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788834913.145187:0:7416:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788834913.145207:0:7416:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000100:00100000:2.0:1788834913.146529:0:7445:0:(client.c:2715:ptlrpc_set_wait()) set 000000009917c135 going to sleep for 11 seconds 00000020:00000004:1.0:1788834913.147584:0:7416:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788834913.147805:0:7416:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:0.0:1788834913.149758:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253934848 00000100:00100000:0.0:1788834913.149775:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253934848 00000100:00100000:0.0:1788834913.149853:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788834913.149863:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f51a50d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1875729253934848:12345-0@lo:1000: 00000100:00100000:0.0:1788834913.150042:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f51a50d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7445:x1875729253934848:12345-0@lo:1000: Request processed in 179us (5287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834913.150049:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788834913.153679:0:7445:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000866cb3da pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:7445:1875729253934848:0@lo:1000: 00000040:00080000:0.0:1788834913.153746:0:7445:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:0.0:1788834913.153814:0:7445:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0000-osp-MDT0001: add oth 00000000c8ac7b68 with version 1 00000040:00080000:0.0:1788834913.155930:0:7445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:0.0:1788834913.156035:0:7445:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788834913.160352:0:7434:0:(osp_trans.c:1336:osp_get_next_request()) ou 0000000016144f37 version 1 rpc_version 1 00000020:00100000:2.0:1788834913.160507:0:7434:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0000-osp-MDT0001: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788834913.160521:0:7434:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@000000000b5b4799 x1875729253935104/t0(0) o1000->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788834913.160546:0:7434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000b5b4799 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7434:1875729253935104:0@lo:1000: 00000100:00100000:2.0:1788834913.160618:0:7434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834913.160671:0:7434:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a71a5e06 going to sleep for 11 seconds 00000100:00100000:0.0:1788834913.160925:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253935104 00000100:00100000:0.0:1788834913.160954:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253935104 00000100:00100000:0.0:1788834913.161037:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788834913.161049:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000feedb68f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7434:x1875729253935104:12345-0@lo:1000: 00000001:00080000:1.0:1788834913.189644:0:6467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000100:00100000:1.0:1788834913.191119:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000feedb68f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:7434:x1875729253935104:12345-0@lo:1000: Request processed in 30062us (30490us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788834913.191137:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:2.0:1788834913.191864:0:7434:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:2.0:1788834913.191874:0:7434:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788834913.191900:0:7434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000b5b4799 pname:cluuid:pid:xid:nid:opc:job osp_up0-1:lustre-MDT0001-mdtlov_UUID:7434:1875729253935104:0@lo:1000: 00000040:00080000:1.0:1788834913.192759:0:7444:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788834913.226740:0:7444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788834913.226851:0:7444:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788834913.226858:0:7444:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00010000:00010000:0.0:1788834913.767199:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834914.791267:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834915.813922:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834916.837438:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834917.873125:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788834917.884213:0:7689:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788834918.183411:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253935232:0@lo:41: 00000100:00100000:2.0:1788834918.183488:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834918.184145:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253935232 00000100:00100000:0.0:1788834918.184155:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253935232 00000100:00100000:0.0:1788834918.184207:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788834918.184215:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b5b4799 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253935232:12345-0@lo:41: 00000004:00000024:0.0:1788834918.184267:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446449152 avail 1300209664 00000100:00100000:2.0:1788834918.184928:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000db86a644 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253935360:0@lo:400: 00000100:00100000:2.0:1788834918.184988:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834918.185030:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788834918.185036:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ee0351d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729253935488:0@lo:400: 00000100:00100000:2.0:1788834918.185061:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834918.185086:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000257af892 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729253935616:0@lo:400: 00000100:00100000:2.0:1788834918.185109:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834918.185146:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253935488 00000100:00100000:2.0:1788834918.185151:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253935488 00000100:00100000:2.0:1788834918.185182:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253935616 00000100:00100000:2.0:1788834918.185185:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253935616 00000100:00100000:2.0:1788834918.185200:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788834918.185206:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000866cb3da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729253935488:12345-0@lo:400: 00000100:00100000:2.0:1788834918.185252:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000866cb3da pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729253935488:12345-0@lo:400: Request processed in 45us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834918.185259:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788834918.185274:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788834918.185279:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e90c8ec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729253935616:12345-0@lo:400: 00000100:00100000:2.0:1788834918.185344:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e90c8ec pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729253935616:12345-0@lo:400: Request processed in 64us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834918.185350:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1788834918.185386:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000257af892 x1875729253935616/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834918.185399:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000257af892 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729253935616:0@lo:400: 00010000:00080000:2.0:1788834918.185436:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000001ee0351d x1875729253935488/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834918.185459:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ee0351d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729253935488:0@lo:400: 00000100:00100000:1.0:1788834918.190922:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253935360 00000100:00100000:1.0:1788834918.190936:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253935360 00000100:00100000:1.0:1788834918.190997:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788834918.191005:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008d810b98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:3616:x1875729253935360:12345-0@lo:400: 00000100:00100000:1.0:1788834918.191109:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008d810b98 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:3616:x1875729253935360:12345-0@lo:400: Request processed in 105us (6122us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834918.191117:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788834918.192783:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b5b4799 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253935232:12345-0@lo:41: Request processed in 8564us (9292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834918.192795:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788834918.193225:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253935232:0@lo:41: 00000100:00100000:3.0:1788834918.194813:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000db86a644 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253935360:0@lo:400: 00000020:00000004:3.0:1788834918.792762:0:7741:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788834918.792986:0:7741:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788834918.885497:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834919.909487:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834920.935508:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788834921.680347:0:7843:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788834921.680554:0:7843:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788834921.777234:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788834921.777242:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afdb279f000 from 4 10000000:01000000:1.0:1788834921.777295:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788834921.777371:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000212c194b/0xdf60171e5a5d1809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834921.777384:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000212c194b/0xdf60171e5a5d1809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834921.777395:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000212c194b/0xdf60171e5a5d1809 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834921.777416:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253935744:0@lo:101: 00000100:00100000:1.0:1788834921.777491:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834921.777544:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set 00000000015ca846 going to sleep for 11 seconds 00000100:00100000:0.0:1788834921.778096:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253935744 00000100:00100000:0.0:1788834921.778104:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253935744 00000100:00100000:0.0:1788834921.778162:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788834921.778169:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c90197c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:6485:x1875729253935744:12345-0@lo:101: 00010000:00010000:0.0:1788834921.778183:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788834921.778197:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003c1ab4d9/0xdf60171e5a5d1810 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1809 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834921.778220:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003c1ab4d9/0xdf60171e5a5d1810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1809 expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834921.778229:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003c1ab4d9/0xdf60171e5a5d1810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1809 expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834921.778238:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003c1ab4d9, rc 0) 00000100:00100000:0.0:1788834921.778293:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c90197c7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:6485:x1875729253935744:12345-0@lo:101: Request processed in 125us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834921.778301:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1788834921.778750:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253935744:0@lo:101: 00010000:00010000:1.0:1788834921.778766:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000212c194b/0xdf60171e5a5d1809 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1810 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834921.778775:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000212c194b/0xdf60171e5a5d1809 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1810 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834921.778832:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253935872:0@lo:256: 00000100:00100000:1.0:1788834921.778869:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834921.778893:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253935872 00000100:00100000:1.0:1788834921.778897:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253935872 00000100:00100000:1.0:1788834921.778923:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788834921.778929:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003305baaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:6485:x1875729253935872:12345-0@lo:256: 20000000:01000000:1.0:1788834921.778943:0:6482:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788834921.778960:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788834921.778963:0:6482:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788834921.779031:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003305baaa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:6485:x1875729253935872:12345-0@lo:256: Request processed in 101us (161us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834921.779038:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788834921.779062:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set 00000000015ca846 going to sleep for 11 seconds 00000100:00100000:1.0:1788834921.779074:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253935872:0@lo:256: 10000000:01000000:1.0:1788834921.779117:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788834921.779123:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000212c194b/0xdf60171e5a5d1809 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1810 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834921.779130:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000212c194b/0xdf60171e5a5d1809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1810 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834921.779139:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788834921.779141:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afd85554000 from 21 10000000:01000000:1.0:1788834921.779143:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788834921.779161:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000629da012/0xdf60171e5a5d1817 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834921.779167:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000629da012/0xdf60171e5a5d1817 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834921.779173:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000629da012/0xdf60171e5a5d1817 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834921.779183:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253936000:0@lo:101: 00000100:00100000:1.0:1788834921.779206:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834921.779225:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253936000 00000100:00100000:1.0:1788834921.779229:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253936000 00000100:00100000:1.0:1788834921.779251:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788834921.779256:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ac596592 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:6485:x1875729253936000:12345-0@lo:101: 00010000:00010000:1.0:1788834921.779281:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788834921.779293:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ffa9191c/0xdf60171e5a5d181e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1817 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834921.779308:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ffa9191c/0xdf60171e5a5d181e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1817 expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834921.779335:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ffa9191c/0xdf60171e5a5d181e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1817 expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834921.779341:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ffa9191c, rc 0) 00000100:00100000:1.0:1788834921.779365:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ac596592 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:6485:x1875729253936000:12345-0@lo:101: Request processed in 109us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834921.779371:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788834921.779392:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set 00000000015ca846 going to sleep for 11 seconds 00000100:00100000:1.0:1788834921.779402:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253936000:0@lo:101: 00010000:00010000:1.0:1788834921.779410:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000629da012/0xdf60171e5a5d1817 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d181e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834921.779417:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000629da012/0xdf60171e5a5d1817 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d181e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834921.779466:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253936128:0@lo:501: 00000100:00100000:1.0:1788834921.779491:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834921.779510:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253936128 00000100:00100000:1.0:1788834921.779513:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253936128 00000100:00100000:1.0:1788834921.779533:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788834921.779539:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004d19c54f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:6485:x1875729253936128:12345-0@lo:501: 00000100:00100000:1.0:1788834921.779646:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004d19c54f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:6485:x1875729253936128:12345-0@lo:501: Request processed in 108us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834921.779653:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788834921.779671:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set 00000000015ca846 going to sleep for 11 seconds 00000100:00100000:1.0:1788834921.779680:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253936128:0@lo:501: 00000100:00100000:1.0:1788834921.779701:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253936256:0@lo:503: 00000100:00100000:1.0:1788834921.779738:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834921.779756:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253936256 00000100:00100000:1.0:1788834921.779760:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253936256 00000100:00100000:1.0:1788834921.779778:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788834921.779783:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000cac4029a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:6485:x1875729253936256:12345-0@lo:503: 00000100:00100000:1.0:1788834921.779852:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000cac4029a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:6485:x1875729253936256:12345-0@lo:503: Request processed in 69us (114us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834921.779859:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788834921.779887:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set 00000000015ca846 going to sleep for 11 seconds 00000100:00100000:1.0:1788834921.779898:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253936256:0@lo:503: 00000100:00100000:1.0:1788834921.780074:0:7849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:7849:1875729253936384:0@lo:502: 00000100:00100000:1.0:1788834921.780107:0:7849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834921.780124:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253936384 00000100:00100000:1.0:1788834921.780128:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253936384 00000100:00100000:1.0:1788834921.780148:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788834921.780152:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000890618ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:7849:x1875729253936384:12345-0@lo:502: 00000100:00100000:1.0:1788834921.780218:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000890618ba pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:7849:x1875729253936384:12345-0@lo:502: Request processed in 65us (111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834921.780224:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788834921.780256:0:7849:0:(client.c:2715:ptlrpc_set_wait()) set 000000008f721fa8 going to sleep for 11 seconds 00000100:00100000:1.0:1788834921.780281:0:7849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:7849:1875729253936384:0@lo:502: 00000100:00100000:1.0:1788834921.780339:0:7849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:7849:1875729253936512:0@lo:502: 00000100:00100000:1.0:1788834921.780371:0:7849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834921.780389:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253936512 00000100:00100000:1.0:1788834921.780392:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253936512 00000100:00100000:1.0:1788834921.780412:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788834921.780418:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000077eb89dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:7849:x1875729253936512:12345-0@lo:502: 00000100:00100000:1.0:1788834921.780474:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000077eb89dc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:7849:x1875729253936512:12345-0@lo:502: Request processed in 56us (103us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834921.780480:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1788834921.780506:0:7849:0:(client.c:2715:ptlrpc_set_wait()) set 000000008f721fa8 going to sleep for 11 seconds 00000100:00100000:1.0:1788834921.780517:0:7849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:7849:1875729253936512:0@lo:502: 00000040:00080000:1.0:1788834921.780535:0:7849:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1788834921.780583:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1788834921.780598:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788834921.780605:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000629da012/0xdf60171e5a5d1817 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d181e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834921.780613:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000629da012/0xdf60171e5a5d1817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d181e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834921.780621:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788834921.780623:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afd85554000 from 4 10000000:01000000:1.0:1788834921.780626:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788834921.780642:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 0000000095cd8689/0xdf60171e5a5d1825 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834921.780657:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 0000000095cd8689/0xdf60171e5a5d1825 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834921.780665:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 0000000095cd8689/0xdf60171e5a5d1825 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834921.780677:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253936640:0@lo:101: 00000100:00100000:1.0:1788834921.780701:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834921.780714:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set 0000000050253ac9 going to sleep for 11 seconds 00000100:00100000:1.0:1788834921.780726:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253936640 00000100:00100000:1.0:1788834921.780728:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253936640 00000100:00100000:1.0:1788834921.780748:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788834921.780752:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a157abfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:6485:x1875729253936640:12345-0@lo:101: 00010000:00010000:1.0:1788834921.780760:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788834921.780769:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003959cba5/0xdf60171e5a5d182c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1825 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834921.780784:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003959cba5/0xdf60171e5a5d182c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1825 expref: 16 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834921.780792:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003959cba5/0xdf60171e5a5d182c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1825 expref: 16 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834921.780798:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003959cba5, rc 0) 00000100:00100000:1.0:1788834921.780826:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a157abfb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253936640:12345-0@lo:101: Request processed in 73us (124us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834921.780832:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788834921.780859:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253936640:0@lo:101: 00010000:00010000:1.0:1788834921.780875:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 0000000095cd8689/0xdf60171e5a5d1825 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d182c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834921.780882:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 0000000095cd8689/0xdf60171e5a5d1825 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d182c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834921.780924:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253936768:0@lo:256: 00000100:00100000:1.0:1788834921.780952:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834921.780964:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set 0000000050253ac9 going to sleep for 11 seconds 00000100:00100000:1.0:1788834921.780975:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253936768 00000100:00100000:1.0:1788834921.780978:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253936768 00000100:00100000:1.0:1788834921.780997:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788834921.781003:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000254627b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253936768:12345-0@lo:256: 20000000:01000000:1.0:1788834921.781014:0:6481:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788834921.781030:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788834921.781033:0:6481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1788834921.781101:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000254627b5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253936768:12345-0@lo:256: Request processed in 98us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834921.781108:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788834921.781135:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253936768:0@lo:256: 10000000:01000000:1.0:1788834921.781170:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788834921.781175:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 0000000095cd8689/0xdf60171e5a5d1825 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d182c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834921.781182:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 0000000095cd8689/0xdf60171e5a5d1825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d182c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834921.781188:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788834921.781196:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1788834921.781198:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788834921.781213:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 0000000097192632/0xdf60171e5a5d1833 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834921.781219:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 0000000097192632/0xdf60171e5a5d1833 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834921.781226:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 0000000097192632/0xdf60171e5a5d1833 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834921.781236:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253936896:0@lo:101: 00000100:00100000:1.0:1788834921.781261:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834921.785540:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set 0000000050253ac9 going to sleep for 11 seconds 00000100:00100000:0.0:1788834921.792555:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253936896 00000100:00100000:0.0:1788834921.792570:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253936896 00000100:00100000:0.0:1788834921.792639:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788834921.792648:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000befd0318 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253936896:12345-0@lo:101: 00010000:00010000:0.0:1788834921.792665:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788834921.792682:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000005d9fa20d/0xdf60171e5a5d183a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1833 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834921.792709:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000005d9fa20d/0xdf60171e5a5d183a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1833 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834921.792720:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000005d9fa20d/0xdf60171e5a5d183a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1833 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834921.792745:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000005d9fa20d, rc 0) 00000100:00100000:0.0:1788834921.792822:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000befd0318 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253936896:12345-0@lo:101: Request processed in 176us (11561us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834921.792829:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788834921.792882:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000009b90933 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253936896:0@lo:101: 00010000:00010000:0.0:1788834921.792898:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 0000000097192632/0xdf60171e5a5d1833 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d183a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834921.792908:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 0000000097192632/0xdf60171e5a5d1833 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d183a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834921.792980:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000997b5278 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253937024:0@lo:501: 00000100:00100000:0.0:1788834921.793011:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834921.793040:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a0b6ce94 going to sleep for 11 seconds 00000100:00100000:0.0:1788834921.793053:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253937024 00000100:00100000:0.0:1788834921.793056:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253937024 00000100:00100000:0.0:1788834921.793078:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788834921.793083:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e21508db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253937024:12345-0@lo:501: 00000100:00100000:0.0:1788834921.793192:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e21508db pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253937024:12345-0@lo:501: Request processed in 109us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834921.793199:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788834921.793226:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000997b5278 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253937024:0@lo:501: 00000100:00100000:0.0:1788834921.793253:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000997b5278 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253937152:0@lo:503: 00000100:00100000:0.0:1788834921.793486:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834921.793516:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a0b6ce94 going to sleep for 11 seconds 00000100:00100000:1.0:1788834921.793560:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253937152 00000100:00100000:1.0:1788834921.793565:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253937152 00000100:00100000:1.0:1788834921.793599:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788834921.793606:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008e367c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253937152:12345-0@lo:503: 00000100:00100000:1.0:1788834921.793687:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008e367c6f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253937152:12345-0@lo:503: Request processed in 83us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834921.793694:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788834921.799074:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000997b5278 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253937152:0@lo:503: 00000100:00100000:2.0:1788834921.804164:0:7851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ee0351d pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:7851:1875729253937280:0@lo:502: 00000100:00100000:2.0:1788834921.804257:0:7851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834921.804350:0:7851:0:(client.c:2715:ptlrpc_set_wait()) set 00000000eba71275 going to sleep for 11 seconds 00000100:00100000:0.0:1788834921.804414:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253937280 00000100:00100000:0.0:1788834921.804421:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253937280 00000100:00100000:0.0:1788834921.804470:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788834921.804478:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a0adeee6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:7851:x1875729253937280:12345-0@lo:502: 00000100:00100000:0.0:1788834921.804593:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a0adeee6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:7851:x1875729253937280:12345-0@lo:502: Request processed in 115us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834921.804601:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788834921.804730:0:7851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ee0351d pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:7851:1875729253937280:0@lo:502: 00000020:01000000:2.0:1788834921.804757:0:7851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788834921.804767:0:7851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788834921.804770:0:7851:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:2.0:1788834921.804774:0:7851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788834921.804777:0:7851:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:00000080:2.0:1788834921.804798:0:7851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788834921.804812:0:7851:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (00000000005242e0) 00000020:00000080:2.0:1788834921.804830:0:7851:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osp with refcount 2 00000020:00000080:2.0:1788834921.804835:0:7851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788834921.804925:0:7851:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:2.0:1788834921.804930:0:7851:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788834921.804937:0:7851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf60171e5a5d1848 00010000:00080000:2.0:1788834921.804969:0:7851:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000088c3a006@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1788834921.812564:0:7851:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-4 is initialized 00000020:00000080:2.0:1788834921.818290:0:7851:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788834921.818306:0:7851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788834921.818368:0:7851:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788834921.818390:0:7851:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf60171e5a5d184f 00000100:00080000:2.0:1788834921.818401:0:7851:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788834921.818406:0:7851:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import 0000000088c3a006 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788834921.818440:0:7851:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001ee0351d x1875729253937408/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788834921.818470:0:7851:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000040:01000000:2.0:1788834921.818499:0:7851:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000100:00100000:1.0:1788834921.818599:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000001ee0351d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729253937408:0@lo:38: 00000100:00100000:1.0:1788834921.818669:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834921.818780:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000022819cc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875729253937536:0@lo:400: 00000100:00100000:1.0:1788834921.818849:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834921.818880:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003e2e656d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253937664:0@lo:400: 00000100:00100000:1.0:1788834921.818902:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834921.818918:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788834921.818930:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044ca4e31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729253937792:0@lo:400: 00000100:00100000:1.0:1788834921.818951:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834921.818977:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253937536 00000100:00100000:1.0:1788834921.818983:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253937536 00000100:00100000:1.0:1788834921.819021:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253937792 00000100:00100000:1.0:1788834921.819024:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253937792 00000100:00100000:1.0:1788834921.819040:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788834921.819047:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000037c05fb4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875729253937536:12345-0@lo:400: 00000100:00100000:1.0:1788834921.819095:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000037c05fb4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875729253937536:12345-0@lo:400: Request processed in 48us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834921.819102:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788834921.819118:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788834921.819124:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003cc24f40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729253937792:12345-0@lo:400: 00000100:00100000:1.0:1788834921.819154:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003cc24f40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729253937792:12345-0@lo:400: Request processed in 31us (202us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834921.819160:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788834921.819177:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253937408 00000100:00100000:1.0:1788834921.819180:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253937408 00000100:00100000:1.0:1788834921.819191:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253937664 00000100:00100000:1.0:1788834921.819194:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253937664 00000100:00100000:1.0:1788834921.819208:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788834921.819212:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002959fa90 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875729253937408:12345-0@lo:38: 00010000:00080000:1.0:1788834921.819232:0:6492:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 163 last 0 00000020:00000080:1.0:1788834921.819291:0:6492:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf60171e5a5d1856 00000004:00100000:1.0:1788834921.819307:0:6492:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788834921.819336:0:6492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00080000:1.0:1788834921.819458:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000022819cc7 x1875729253937536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834921.819485:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000022819cc7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875729253937536:0@lo:400: 00010000:00080000:1.0:1788834921.819515:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@0000000044ca4e31 x1875729253937792/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834937 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834921.819524:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044ca4e31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729253937792:0@lo:400: 00000020:01000000:2.0:1788834921.824091:0:7851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788834921.824101:0:7851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788834921.824103:0:7851:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:2.0:1788834921.824107:0:7851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788834921.824111:0:7851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788834921.824112:0:7851:0:(obd_config.c:1563:class_process_config()) marker 19 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788834921.824115:0:7851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788834921.824117:0:7851:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788834921.824161:0:7851:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000257af892 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:7851:1875729253937920:0@lo:502: 00000100:00100000:2.0:1788834921.824239:0:7851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834921.824288:0:7851:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d8ba6da9 going to sleep for 11 seconds 00000100:00080000:2.0:1788834921.824373:0:7856:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@0000000051d82749 x1875729253938048/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834921.824383:0:7856:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e10d5fbc going to sleep for 0 seconds 00000100:00100000:2.0:1788834921.826408:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253937920 00000100:00100000:2.0:1788834921.826420:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253937920 00000100:00100000:2.0:1788834921.826563:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788834921.826574:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003f6f0471 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:7851:x1875729253937920:12345-0@lo:502: 00000100:00100000:2.0:1788834921.826748:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003f6f0471 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:7851:x1875729253937920:12345-0@lo:502: Request processed in 177us (2510us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834921.826757:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788834921.826872:0:7851:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000257af892 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:7851:1875729253937920:0@lo:502: 00000020:01000000:3.0:1788834921.826907:0:7851:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788834921.826914:0:7851:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788834921.826917:0:7851:0:(obd_config.c:1563:class_process_config()) marker 19 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788834921.826927:0:7851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1788834921.827078:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1788834921.827099:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1788834921.827108:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 0000000097192632/0xdf60171e5a5d1833 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d183a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834921.827128:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 0000000097192632/0xdf60171e5a5d1833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d183a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834921.827136:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1788834921.827139:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9afdab4bb370 from 1 10000000:01000000:2.0:1788834921.827141:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788834921.827169:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000104ec54c/0xdf60171e5a5d185d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834921.827176:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000104ec54c/0xdf60171e5a5d185d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834921.827184:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000104ec54c/0xdf60171e5a5d185d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834921.827198:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008ea8475f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253938176:0@lo:101: 00000100:00100000:2.0:1788834921.827230:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834921.827281:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set 000000004bea256f going to sleep for 11 seconds 00000100:00100000:3.0:1788834921.827349:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253938176 00000100:00100000:3.0:1788834921.827355:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253938176 00000100:00100000:3.0:1788834921.827387:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788834921.827394:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000930caa12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253938176:12345-0@lo:101: 00010000:00010000:3.0:1788834921.827404:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788834921.827417:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000595e16a6/0xdf60171e5a5d1864 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d185d expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834921.827438:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000595e16a6/0xdf60171e5a5d1864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d185d expref: 18 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834921.827447:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000595e16a6/0xdf60171e5a5d1864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d185d expref: 18 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834921.827456:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000595e16a6, rc 0) 00000100:00100000:3.0:1788834921.827491:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000930caa12 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253938176:12345-0@lo:101: Request processed in 99us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834921.827496:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788834921.827528:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008ea8475f pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253938176:0@lo:101: 00010000:00010000:3.0:1788834921.827539:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000104ec54c/0xdf60171e5a5d185d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1864 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834921.827547:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000104ec54c/0xdf60171e5a5d185d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1864 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834921.827597:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f3518f33 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253938304:0@lo:501: 00000100:00100000:3.0:1788834921.827622:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834921.827635:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set 00000000094d7b08 going to sleep for 11 seconds 00000100:00100000:3.0:1788834921.827652:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253938304 00000100:00100000:3.0:1788834921.827656:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253938304 00000100:00100000:3.0:1788834921.827673:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788834921.827678:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7222d11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253938304:12345-0@lo:501: 00000100:00100000:3.0:1788834921.827742:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7222d11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253938304:12345-0@lo:501: Request processed in 63us (119us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788834921.827748:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1788834921.827775:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f3518f33 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253938304:0@lo:501: 10000000:01000000:3.0:1788834921.827798:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1788834921.827803:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: 00000000104ec54c/0xdf60171e5a5d185d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1864 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834921.827810:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: 00000000104ec54c/0xdf60171e5a5d185d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1864 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788834921.844682:0:6492:0:(import.c:65:import_set_state_nolock()) 00000000021566d6 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788834921.844799:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002959fa90 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3613:x1875729253937408:12345-0@lo:38: Request processed in 25584us (26129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834921.844810:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788834921.844844:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788834921.844854:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000009b90933 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253937664:12345-0@lo:400: 00000100:00100000:0.0:1788834921.844904:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000009b90933 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253937664:12345-0@lo:400: Request processed in 53us (26001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834921.844911:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788834921.845692:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788834921.845703:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788834921.845712:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:3.0:1788834921.845718:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788834921.845720:0:3613:0:(import.c:65:import_set_state_nolock()) 0000000088c3a006 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1788834921.845737:0:3613:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000e10d5fbc): req@0000000051d82749 x1875729253938048/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834921.845752:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000001ee0351d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729253937408:0@lo:38: 00000100:00100000:0.0:1788834921.848663:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003e2e656d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253937664:0@lo:400: 00000100:00100000:1.0:1788834921.851718:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000044ca4e31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253938432:0@lo:41: 00000100:00100000:1.0:1788834921.851795:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834921.853488:0:7856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834921.853530:0:7856:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e10d5fbc going to sleep for 11 seconds 00000100:00100000:2.0:1788834921.853567:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253938432 00000100:00100000:2.0:1788834921.853574:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253938432 00000100:00100000:1.0:1788834921.853825:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253938048 00000100:00100000:1.0:1788834921.853832:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253938048 00000100:00100000:1.0:1788834921.853868:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788834921.853876:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000345243e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7856:x1875729253938048:12345-0@lo:1000: 00000100:00100000:1.0:1788834921.853967:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000345243e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:7856:x1875729253938048:12345-0@lo:1000: Request processed in 91us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834921.853975:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788834921.854224:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788834921.854232:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000022819cc7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729253938432:12345-0@lo:41: 00000004:00000024:2.0:1788834921.854255:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:2.0:1788834921.854310:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000022819cc7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729253938432:12345-0@lo:41: Request processed in 79us (2517us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834921.854344:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788834921.854391:0:7856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051d82749 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7856:1875729253938048:0@lo:1000: 00000040:01000000:2.0:1788834921.854425:0:7856:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788834921.854458:0:7856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051d82749 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7856:1875729253938560:0@lo:1000: 00000100:00100000:2.0:1788834921.854490:0:7856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834921.854514:0:7856:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e10d5fbc going to sleep for 11 seconds 00000100:00100000:2.0:1788834921.854540:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000044ca4e31 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253938432:0@lo:41: 00000100:00100000:2.0:1788834921.854559:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253938560 00000100:00100000:2.0:1788834921.854562:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253938560 00000100:00100000:2.0:1788834921.854576:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788834921.854582:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000630540a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7856:x1875729253938560:12345-0@lo:1000: 00000100:00100000:2.0:1788834921.854682:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000630540a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7856:x1875729253938560:12345-0@lo:1000: Request processed in 99us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834921.854688:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788834921.854710:0:7856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051d82749 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7856:1875729253938560:0@lo:1000: 00000100:00100000:2.0:1788834921.854745:0:7856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051d82749 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7856:1875729253938688:0@lo:700: 00000100:00100000:2.0:1788834921.854770:0:7856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834921.854786:0:7856:0:(client.c:2715:ptlrpc_set_wait()) set 0000000055034c21 going to sleep for 11 seconds 00000100:00100000:2.0:1788834921.854801:0:6496:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253938688 00000100:00100000:2.0:1788834921.854805:0:6496:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253938688 00000100:00100000:2.0:1788834921.854828:0:6496:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788834921.854834:0:6496:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009375dd4f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7856:x1875729253938688:12345-0@lo:700: 00000100:00100000:2.0:1788834921.854872:0:6496:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009375dd4f pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:lustre-MDT0000-mdtlov_UUID+6:7856:x1875729253938688:12345-0@lo:700: Request processed in 39us (102us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834921.854879:0:6496:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788834921.854904:0:7856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051d82749 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7856:1875729253938688:0@lo:700: 00000100:00100000:2.0:1788834921.854991:0:7856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051d82749 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7856:1875729253938816:0@lo:1000: 00000100:00100000:2.0:1788834921.855023:0:7856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834921.855037:0:7856:0:(client.c:2715:ptlrpc_set_wait()) set 00000000ef8973ba going to sleep for 11 seconds 00000100:00100000:2.0:1788834921.855111:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253938816 00000100:00100000:2.0:1788834921.855115:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253938816 00000100:00100000:2.0:1788834921.855131:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788834921.855135:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001ee0351d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7856:x1875729253938816:12345-0@lo:1000: 00000100:00100000:2.0:1788834921.855177:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001ee0351d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7856:x1875729253938816:12345-0@lo:1000: Request processed in 41us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834921.855183:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788834921.855201:0:7856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051d82749 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7856:1875729253938816:0@lo:1000: 00000004:00080000:2.0:1788834921.855233:0:7856:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000055034c21 with version 0 00000020:00100000:2.0:1788834921.855244:0:7856:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:2.0:1788834921.855249:0:7856:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@0000000051d82749 x1875729253939072/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 632/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788834921.855261:0:7856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051d82749 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7856:1875729253939072:0@lo:1000: 00000100:00100000:2.0:1788834921.855292:0:7856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834921.855304:0:7856:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034ccde8d going to sleep for 11 seconds 00000100:00100000:2.0:1788834921.855331:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253939072 00000100:00100000:2.0:1788834921.855334:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253939072 00000100:00100000:2.0:1788834921.855349:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788834921.855353:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008ea8475f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7856:x1875729253939072:12345-0@lo:1000: 00000001:00080000:3.0:1788834921.876385:0:7417:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967297 is committed 00000001:00100000:3.0:1788834921.876402:0:7417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1788834921.879699:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008ea8475f pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7856:x1875729253939072:12345-0@lo:1000: Request processed in 24336us (24397us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1788834921.879715:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:2.0:1788834921.879769:0:7856:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967297 committed transno 4294967297 00000100:00100000:2.0:1788834921.879774:0:7856:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788834921.879787:0:7856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051d82749 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7856:1875729253939072:0@lo:1000: 00000100:00100000:2.0:1788834921.879880:0:7856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051d82749 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7856:1875729253939200:0@lo:1000: 00000100:00100000:2.0:1788834921.879917:0:7856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834921.880074:0:7856:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e10d5fbc going to sleep for 11 seconds 00000100:00100000:1.0:1788834921.880347:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253939200 00000100:00100000:1.0:1788834921.880354:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253939200 00000100:00100000:1.0:1788834921.880406:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788834921.880414:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000257af892 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7856:x1875729253939200:12345-0@lo:1000: 00000100:00100000:1.0:1788834921.880491:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000257af892 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7856:x1875729253939200:12345-0@lo:1000: Request processed in 78us (573us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834921.880497:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788834921.881015:0:7856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051d82749 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:7856:1875729253939200:0@lo:1000: 00000040:00080000:2.0:1788834921.881037:0:7856:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00080000:2.0:1788834921.881070:0:7856:0:(osp_trans.c:1595:osp_trans_stop()) lustre-MDT0001-osp-MDT0000: add oth 0000000055034c21 with version 1 00000040:00080000:2.0:1788834921.883278:0:7856:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1788834921.883392:0:7856:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1788834921.883397:0:7856:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00080000:1.0:1788834921.895035:0:7853:0:(osp_trans.c:1336:osp_get_next_request()) ou 00000000ca6cc89c version 1 rpc_version 1 00000020:00100000:3.0:1788834921.895293:0:7853:0:(genops.c:2428:obd_get_mod_rpc_slot()) lustre-MDT0001-osp-MDT0000: modify RPC slot 1 is allocated opc 1000, max 8 00000100:00100000:3.0:1788834921.895355:0:7853:0:(client.c:820:ptlrpc_reassign_next_xid()) @@@ reassign xid req@00000000f3518f33 x1875729253939456/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 360/4320 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788834921.895405:0:7853:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f3518f33 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7853:1875729253939456:0@lo:1000: 00000100:00100000:3.0:1788834921.895471:0:7853:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834921.895508:0:7853:0:(client.c:2715:ptlrpc_set_wait()) set 00000000094d7b08 going to sleep for 11 seconds 00000100:00100000:1.0:1788834921.895629:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253939456 00000100:00100000:1.0:1788834921.895637:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253939456 00000100:00100000:1.0:1788834921.895691:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788834921.895700:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d30ab71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7853:x1875729253939456:12345-0@lo:1000: 00000001:00080000:2.0:1788834921.911145:0:7417:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967298 is committed 00000100:00100000:1.0:1788834921.911456:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d30ab71 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:7853:x1875729253939456:12345-0@lo:1000: Request processed in 15754us (15982us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788834921.911471:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000004:00080000:3.0:1788834921.911487:0:7853:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967298 committed transno 4294967298 00000100:00100000:3.0:1788834921.911492:0:7853:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788834921.911508:0:7853:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f3518f33 pname:cluuid:pid:xid:nid:opc:job osp_up1-0:lustre-MDT0000-mdtlov_UUID:7853:1875729253939456:0@lo:1000: 00010000:00010000:1.0:1788834921.957585:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1788834922.771573:0:7896:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe818e54a0 20000000:00000080:3.0:1788834922.771592:0:7896:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9afdaf522400 uarg=0000000000000000 20000000:01000000:3.0:1788834922.771640:0:7896:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1788834922.771647:0:7896:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1788834922.771652:0:7896:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1788834922.771724:0:7896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1788834922.771736:0:7896:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1788834922.785310:0:7896:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788834922.785755:0:7896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788834922.785789:0:7896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1788834922.785806:0:7896:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1788834922.785822:0:7896:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788834922.785839:0:7896:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002facebd9/0xdf60171e5a5d186b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834922.785856:0:7896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000036725224/0xdf60171e5a5d16ea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d16e3 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834922.785863:0:7896:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000132138b4/0xdf60171e5a5d17d8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d17d1 expref: 17 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834922.785869:0:7896:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002facebd9/0xdf60171e5a5d186b lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834922.785918:0:7896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000132138b4/0xdf60171e5a5d17d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d17d1 expref: 17 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834922.785933:0:7896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000132138b4/0xdf60171e5a5d17d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d17d1 expref: 17 pid: 6482 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834922.785947:0:7896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f3518f33 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7896:1875729253939584:0@lo:104: 00000100:00100000:3.0:1788834922.786023:0:7896:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788834922.786086:0:7896:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000036725224/0xdf60171e5a5d16ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d16e3 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834922.786094:0:7896:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000036725224/0xdf60171e5a5d16ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d16e3 expref: 17 pid: 6483 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834922.786114:0:7896:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099d6473a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7896:1875729253939712:0@lo:104: 00000100:00100000:3.0:1788834922.786134:0:7896:0:(client.c:2715:ptlrpc_set_wait()) set 000000006ab169a7 going to sleep for 11 seconds 00000100:00100000:0.0:1788834922.786548:0:6471:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788834922.786570:0:6471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834922.786590:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253939584 00000100:00100000:0.0:1788834922.786597:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253939584 00000100:00100000:0.0:1788834922.786639:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253939712 00000100:00100000:0.0:1788834922.786642:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253939712 00000100:00100000:0.0:1788834922.786656:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788834922.786662:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e66652a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:7896:x1875729253939584:12345-0@lo:104: 00010000:00010000:0.0:1788834922.786673:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: 000000006805d956/0xdf60171e5a5d17d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d17d8 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834922.786737:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788834922.786743:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e66652a8 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:7896:x1875729253939584:12345-0@lo:104: Request processed in 82us (720us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834922.786750:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788834922.786788:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1788834922.786794:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000997b5278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:7896:x1875729253939712:12345-0@lo:104: 00010000:00010000:0.0:1788834922.786801:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: 00000000fac15cb5/0xdf60171e5a5d16e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d16ea expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834922.786833:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788834922.786838:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000997b5278 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:7896:x1875729253939712:12345-0@lo:104: Request processed in 45us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834922.786843:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788834922.786937:0:7896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f3518f33 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7896:1875729253939584:0@lo:104: 00000100:00100000:3.0:1788834922.786946:0:7896:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099d6473a pname:cluuid:pid:xid:nid:opc:job lctl:MGS:7896:1875729253939712:0@lo:104: 00010000:00010000:3.0:1788834922.786967:0:7896:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002facebd9/0xdf60171e5a5d186b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.787041:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788834922.787047:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 000000006805d956/0xdf60171e5a5d17d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d17d8 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.787054:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006805d956 already unused, calling callback (00000000f6c941bc) 10000000:00010000:1.0:1788834922.787084:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 000000006805d956/0xdf60171e5a5d17d1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d17d8 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.787092:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 000000006805d956/0xdf60171e5a5d17d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d17d8 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788834922.787107:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 000000006805d956/0xdf60171e5a5d17d1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d17d8 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834922.787113:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788834922.787146:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 000000006805d956/0xdf60171e5a5d17d1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d17d8 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.787153:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788834922.787179:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 000000006805d956/0xdf60171e5a5d17d1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d17d8 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.787186:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 000000006805d956/0xdf60171e5a5d17d1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d17d8 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.787197:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:0.0:1788834922.787346:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004772addc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729253939840:0@lo:103: 00000100:00100000:0.0:1788834922.787379:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834922.787437:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253939840 00000100:00100000:0.0:1788834922.787442:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253939840 00010000:00010000:0.0:1788834922.787459:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000132138b4/0xdf60171e5a5d17d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d17d1 expref: 18 pid: 6482 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834922.787495:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788834922.787501:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000039b3d49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:3615:x1875729253939840:12345-0@lo:103: 00010000:00010000:0.0:1788834922.787512:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788834922.787516:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000132138b4/0xdf60171e5a5d17d8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d17d1 expref: 18 pid: 6482 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834922.787525:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000132138b4/0xdf60171e5a5d17d8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d17d1 expref: 18 pid: 6482 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834922.787544:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000132138b4/0xdf60171e5a5d17d8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d17d1 expref: 18 pid: 6482 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834922.787558:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788834922.787585:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000039b3d49 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:3615:x1875729253939840:12345-0@lo:103: Request processed in 85us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834922.787592:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788834922.787613:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004772addc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729253939840:0@lo:103: 00010000:00010000:1.0:1788834922.787908:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: 00000000fac15cb5/0xdf60171e5a5d16e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d16ea expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.787915:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fac15cb5 already unused, calling callback (00000000f6c941bc) 10000000:00010000:1.0:1788834922.787917:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: 00000000fac15cb5/0xdf60171e5a5d16e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d16ea expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.787923:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: 00000000fac15cb5/0xdf60171e5a5d16e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d16ea expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788834922.787929:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: 00000000fac15cb5/0xdf60171e5a5d16e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d16ea expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834922.787934:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788834922.787950:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: 00000000fac15cb5/0xdf60171e5a5d16e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d16ea expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.787956:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788834922.787976:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: 00000000fac15cb5/0xdf60171e5a5d16e3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d16ea expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.787983:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: 00000000fac15cb5/0xdf60171e5a5d16e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d16ea expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.787997:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834922.787998:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834922.788000:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834922.788007:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788834922.788020:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788834922.788029:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066143a86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729253939968:0@lo:103: 00000100:00100000:1.0:1788834922.788056:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834922.788093:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253939968 00000100:00100000:1.0:1788834922.788110:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253939968 00010000:00010000:1.0:1788834922.788125:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000036725224/0xdf60171e5a5d16ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d16e3 expref: 17 pid: 6483 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834922.788146:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788834922.788152:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a2b4ca5f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:3617:x1875729253939968:12345-0@lo:103: 00010000:00010000:1.0:1788834922.788160:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788834922.788163:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000036725224/0xdf60171e5a5d16ea lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d16e3 expref: 17 pid: 6483 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.788170:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000036725224/0xdf60171e5a5d16ea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d16e3 expref: 17 pid: 6483 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.788180:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000036725224/0xdf60171e5a5d16ea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d16e3 expref: 17 pid: 6483 timeout: 314 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.788190:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002facebd9/0xdf60171e5a5d186b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.788197:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002facebd9/0xdf60171e5a5d186b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.788354:0:7430:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002facebd9/0xdf60171e5a5d186b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.788362:0:7430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002facebd9/0xdf60171e5a5d186b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.788368:0:7430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002facebd9/0xdf60171e5a5d186b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.788383:0:7430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002facebd9/0xdf60171e5a5d186b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.788388:0:7430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002facebd9 already unused, calling callback (00000000a5212b7f) 00010000:00010000:1.0:1788834922.788391:0:7430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002facebd9/0xdf60171e5a5d186b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.788398:0:7430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002facebd9/0xdf60171e5a5d186b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.788408:0:7430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002facebd9/0xdf60171e5a5d186b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.788417:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788834922.788445:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a2b4ca5f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:3617:x1875729253939968:12345-0@lo:103: Request processed in 293us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834922.788451:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788834922.788479:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066143a86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729253939968:0@lo:103: 00010000:00010000:3.0:1788834922.788975:0:7896:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002facebd9/0xdf60171e5a5d186b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834922.788984:0:7896:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002facebd9/0xdf60171e5a5d186b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834922.788989:0:7896:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002facebd9/0xdf60171e5a5d186b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 7896 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834922.983601:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788834923.301482:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788834923.305355:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000066143a86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253940096:0@lo:41: 00000100:00100000:3.0:1788834923.305443:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834923.306469:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253940096 00000100:00100000:1.0:1788834923.306480:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253940096 00000100:00100000:1.0:1788834923.306541:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788834923.306557:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099d6473a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253940096:12345-0@lo:41: 00000004:00000024:1.0:1788834923.306594:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:1.0:1788834923.306652:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099d6473a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253940096:12345-0@lo:41: Request processed in 104us (1210us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834923.306659:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788834923.307110:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000066143a86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253940096:0@lo:41: 00010000:00010000:2.0:1788834924.016743:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834925.030591:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788834926.057115:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788834926.894389:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f3ae8e1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253940224:0@lo:41: 00000100:00100000:0.0:1788834926.894460:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834926.894504:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000000c3a0ad6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729253940736:0@lo:400: 00000100:00100000:0.0:1788834926.894528:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834926.894551:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1788834926.894556:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000007acc746b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253940352:0@lo:400: 00000100:00100000:0.0:1788834926.894581:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834926.894600:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005c880c5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253940864:0@lo:400: 00000100:00100000:0.0:1788834926.894634:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834926.894664:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a0f313a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729253940480:0@lo:400: 00000100:00100000:0.0:1788834926.894685:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834926.894701:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788834926.894705:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000072e7a4aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253940608:0@lo:400: 00000100:00100000:0.0:1788834926.894723:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834926.894745:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253940224 00000100:00100000:0.0:1788834926.894751:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253940224 00000100:00100000:0.0:1788834926.894780:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253940864 00000100:00100000:0.0:1788834926.894794:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253940864 00000100:00100000:0.0:1788834926.894807:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253940608 00000100:00100000:0.0:1788834926.894810:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253940608 00000100:00100000:0.0:1788834926.894823:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788834926.894829:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a469f3c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729253940224:12345-0@lo:41: 00000004:00000024:0.0:1788834926.894863:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788834926.894920:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a469f3c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729253940224:12345-0@lo:41: Request processed in 90us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834926.894927:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788834926.894944:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788834926.894949:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001c40de55 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729253940864:12345-0@lo:400: 00000100:00100000:0.0:1788834926.894976:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001c40de55 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729253940864:12345-0@lo:400: Request processed in 28us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834926.894981:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788834926.894990:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788834926.894995:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c353905d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253940608:12345-0@lo:400: 00000100:00100000:0.0:1788834926.895022:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c353905d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253940608:12345-0@lo:400: Request processed in 27us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834926.895028:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788834926.895044:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253940736 00000100:00100000:0.0:1788834926.895048:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253940736 00000100:00100000:0.0:1788834926.895071:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253940480 00000100:00100000:0.0:1788834926.895073:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253940480 00000100:00100000:0.0:1788834926.895085:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788834926.895090:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d4c1c80f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729253940736:12345-0@lo:400: 00000100:00100000:0.0:1788834926.895119:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d4c1c80f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729253940736:12345-0@lo:400: Request processed in 29us (591us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834926.895125:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788834926.895143:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788834926.895148:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009945cdf4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729253940480:12345-0@lo:400: 00000100:00100000:0.0:1788834926.895174:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009945cdf4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729253940480:12345-0@lo:400: Request processed in 26us (488us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834926.895179:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788834926.895197:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253940352 00000100:00100000:0.0:1788834926.895200:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253940352 00000100:00100000:0.0:1788834926.895223:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788834926.895239:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000079cd4680 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:3614:x1875729253940352:12345-0@lo:400: 00000100:00100000:0.0:1788834926.895268:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000079cd4680 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:3614:x1875729253940352:12345-0@lo:400: Request processed in 40us (687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834926.895274:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788834926.895347:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000007acc746b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253940352:0@lo:400: 00000100:00100000:0.0:1788834926.895359:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005c880c5e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253940864:0@lo:400: 00000100:00100000:0.0:1788834926.895370:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f3ae8e1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253940224:0@lo:41: 00010000:00080000:0.0:1788834926.895380:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@000000000c3a0ad6 x1875729253940736/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834926.895390:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000000c3a0ad6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729253940736:0@lo:400: 00000100:00100000:0.0:1788834926.895423:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000072e7a4aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253940608:0@lo:400: 00010000:00080000:0.0:1788834926.895431:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@00000000a0f313a8 x1875729253940480/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834942 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834926.895439:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a0f313a8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729253940480:0@lo:400: 00010000:00010000:1.0:1788834927.079554:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788834927.398371:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788834927.398378:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afdb279f000 from 1 10000000:01000000:1.0:1788834927.398382:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788834927.398424:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: 00000000d350fb0a/0xdf60171e5a5d1872 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834927.398436:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: 00000000d350fb0a/0xdf60171e5a5d1872 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834927.398447:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: 00000000d350fb0a/0xdf60171e5a5d1872 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834927.398482:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f86b1f47 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253940992:0@lo:101: 00000100:00100000:1.0:1788834927.398546:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834927.398603:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e35d63e5 going to sleep for 11 seconds 00000100:00100000:0.0:1788834927.399277:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253940992 00000100:00100000:0.0:1788834927.399286:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253940992 00000100:00100000:0.0:1788834927.399364:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788834927.399374:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f855a8fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253940992:12345-0@lo:101: 00010000:00010000:0.0:1788834927.399388:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788834927.399401:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000dde96522/0xdf60171e5a5d1879 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1872 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834927.399425:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000dde96522/0xdf60171e5a5d1879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1872 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834927.399434:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000dde96522/0xdf60171e5a5d1879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1872 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834927.399443:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000dde96522, rc 0) 00000100:00100000:0.0:1788834927.399498:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f855a8fe pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253940992:12345-0@lo:101: Request processed in 127us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834927.399504:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788834927.399568:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f86b1f47 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253940992:0@lo:101: 00010000:00010000:1.0:1788834927.399583:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: 00000000d350fb0a/0xdf60171e5a5d1872 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1879 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834927.399592:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: 00000000d350fb0a/0xdf60171e5a5d1872 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1879 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834927.399653:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f86b1f47 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253941120:0@lo:501: 00000100:00100000:1.0:1788834927.399685:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834927.399718:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set 00000000e35d63e5 going to sleep for 11 seconds 00000100:00100000:0.0:1788834927.399756:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253941120 00000100:00100000:0.0:1788834927.399762:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253941120 00000100:00100000:0.0:1788834927.399796:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788834927.399803:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008806b688 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253941120:12345-0@lo:501: 00000100:00100000:0.0:1788834927.399968:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008806b688 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253941120:12345-0@lo:501: Request processed in 167us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834927.399976:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788834927.400101:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f86b1f47 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253941120:0@lo:501: 00000100:00100000:2.0:1788834927.400202:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000051d82749 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253941248:0@lo:503: 00000100:00100000:2.0:1788834927.400252:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834927.400275:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set 0000000034ccde8d going to sleep for 11 seconds 00000100:00100000:0.0:1788834927.401117:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253941248 00000100:00100000:0.0:1788834927.401125:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253941248 00000100:00100000:0.0:1788834927.401169:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788834927.401185:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f417b916 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253941248:12345-0@lo:503: 00000100:00100000:0.0:1788834927.401334:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f417b916 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253941248:12345-0@lo:503: Request processed in 140us (1063us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834927.401349:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788834927.401366:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000051d82749 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253941248:0@lo:503: 00000100:00100000:3.0:1788834927.408513:0:8129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000f3518f33 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8129:1875729253941376:0@lo:502: 00000100:00100000:3.0:1788834927.408611:0:8129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834927.408662:0:8129:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f36a9f23 going to sleep for 11 seconds 00000100:00100000:0.0:1788834927.408699:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253941376 00000100:00100000:0.0:1788834927.408708:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253941376 00000100:00100000:0.0:1788834927.408760:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788834927.408769:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000686a805b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:8129:x1875729253941376:12345-0@lo:502: 00000100:00100000:0.0:1788834927.408908:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000686a805b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:8129:x1875729253941376:12345-0@lo:502: Request processed in 140us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834927.408916:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788834927.408937:0:8129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000f3518f33 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8129:1875729253941376:0@lo:502: 00000020:01000000:3.0:1788834927.408972:0:8129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788834927.408986:0:8129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788834927.408989:0:8129:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788834927.408997:0:8129:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afdb279f000 00000020:00000080:3.0:1788834927.409000:0:8129:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788834927.409038:0:8129:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8129:1875729253941504:0@lo:502: 00000100:00100000:3.0:1788834927.409072:0:8129:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834927.409098:0:8129:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8663e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788834927.409157:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253941504 00000100:00100000:0.0:1788834927.409163:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253941504 00000100:00100000:0.0:1788834927.409275:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788834927.409284:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:8129:x1875729253941504:12345-0@lo:502: 00000100:00100000:0.0:1788834927.409382:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:8129:x1875729253941504:12345-0@lo:502: Request processed in 98us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834927.409391:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788834927.409406:0:8129:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8129:1875729253941504:0@lo:502: 00000020:01000000:3.0:1788834927.409429:0:8129:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788834927.409434:0:8129:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788834927.409436:0:8129:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788834927.409440:0:8129:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788834927.409527:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788834927.409556:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788834927.409566:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdc2167200/0xdf60171e5a5d1872 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1879 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834927.409577:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdc2167200/0xdf60171e5a5d1872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1879 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834927.409589:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788834927.409591:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afd85554000 from 1 10000000:01000000:2.0:1788834927.409594:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788834927.409784:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d1880 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834927.409794:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d1880 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834927.409802:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d1880 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834927.409815:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdaaf3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253941632:0@lo:101: 00000100:00100000:2.0:1788834927.409846:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834927.409882:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8330e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788834927.409936:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253941632 00000100:00100000:3.0:1788834927.409941:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253941632 00000100:00100000:3.0:1788834927.409987:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788834927.409996:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253941632:12345-0@lo:101: 00010000:00010000:3.0:1788834927.410013:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788834927.410026:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdc204b800/0xdf60171e5a5d1887 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1880 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834927.410048:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdc204b800/0xdf60171e5a5d1887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1880 expref: 18 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834927.410059:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdc204b800/0xdf60171e5a5d1887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1880 expref: 18 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834927.410068:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204b800, rc 0) 00000100:00100000:3.0:1788834927.410107:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253941632:12345-0@lo:101: Request processed in 113us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834927.410114:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788834927.410362:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdaaf3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253941632:0@lo:101: 00010000:00010000:2.0:1788834927.410375:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d1880 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1887 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834927.410385:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d1880 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1887 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834927.410432:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdaaf3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253941760:0@lo:501: 00000100:00100000:2.0:1788834927.410460:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834927.410479:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8330e3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834927.410492:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253941760 00000100:00100000:2.0:1788834927.410495:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253941760 00000100:00100000:2.0:1788834927.410518:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788834927.410524:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253941760:12345-0@lo:501: 00000100:00100000:2.0:1788834927.411491:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253941760:12345-0@lo:501: Request processed in 965us (1029us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834927.411500:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1788834927.411581:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdaaf3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253941760:0@lo:501: 00000100:00100000:1.0:1788834927.411617:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e810a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253941888:0@lo:503: 00000100:00100000:1.0:1788834927.411661:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834927.411696:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77600 going to sleep for 11 seconds 00000100:00100000:2.0:1788834927.411711:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253941888 00000100:00100000:2.0:1788834927.411718:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253941888 00000100:00100000:2.0:1788834927.411755:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788834927.411764:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253941888:12345-0@lo:503: 00000100:00100000:2.0:1788834927.411851:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253941888:12345-0@lo:503: Request processed in 88us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834927.411859:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788834927.412030:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e810a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253941888:0@lo:503: 00000100:00100000:0.0:1788834927.413944:0:8131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8131:1875729253942016:0@lo:502: 00000100:00100000:0.0:1788834927.414017:0:8131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834927.414095:0:8131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd9183b600 going to sleep for 11 seconds 00000100:00100000:2.0:1788834927.417058:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253942016 00000100:00100000:2.0:1788834927.417072:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253942016 00000100:00100000:2.0:1788834927.417139:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788834927.417149:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:8131:x1875729253942016:12345-0@lo:502: 00000100:00100000:2.0:1788834927.417355:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:8131:x1875729253942016:12345-0@lo:502: Request processed in 206us (3336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834927.417365:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788834927.417605:0:8131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8131:1875729253942016:0@lo:502: 00000020:01000000:0.0:1788834927.417654:0:8131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788834927.417663:0:8131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788834927.417665:0:8131:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788834927.417674:0:8131:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afd85554000 00000020:00000080:0.0:1788834927.417678:0:8131:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1788834927.417711:0:8131:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8131:1875729253942144:0@lo:502: 00000100:00100000:0.0:1788834927.417762:0:8131:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834927.417789:0:8131:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd9183b600 going to sleep for 11 seconds 00000100:00100000:1.0:1788834927.417966:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253942144 00000100:00100000:1.0:1788834927.417971:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253942144 00000100:00100000:1.0:1788834927.417999:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788834927.418007:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:8131:x1875729253942144:12345-0@lo:502: 00000100:00100000:1.0:1788834927.418089:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:8131:x1875729253942144:12345-0@lo:502: Request processed in 83us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834927.418096:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1788834927.419353:0:8131:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8131:1875729253942144:0@lo:502: 00000020:01000000:3.0:1788834927.419475:0:8131:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788834927.419484:0:8131:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788834927.419487:0:8131:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1788834927.419492:0:8131:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1788834927.421301:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788834927.421350:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788834927.421363:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d1880 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1887 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834927.421375:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d1880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1887 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834928.102943:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788834928.428479:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788834928.428503:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253942272:0@lo:41: 00000100:00100000:0.0:1788834928.428623:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834928.428698:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253942272 00000100:00100000:0.0:1788834928.428706:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253942272 00000100:00100000:0.0:1788834928.428766:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788834928.428775:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253942272:12345-0@lo:41: 00000004:00000024:0.0:1788834928.428808:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446432768 avail 1300193280 00000100:00100000:0.0:1788834928.428849:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253942272:12345-0@lo:41: Request processed in 76us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834928.428856:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1788834928.428900:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253942272:0@lo:41: 00010000:00010000:0.0:1788834929.126489:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834930.149668:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834931.176089:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788834932.006543:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253942400:0@lo:41: 00000100:00100000:1.0:1788834932.006752:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834932.006834:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253942400 00000100:00100000:1.0:1788834932.006842:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253942400 00000100:00100000:1.0:1788834932.006889:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788834932.006899:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253942400:12345-0@lo:41: 00000100:00100000:0.0:1788834932.007416:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253942528:0@lo:400: 00000004:00000024:1.0:1788834932.007475:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446563840 avail 1300324352 00000100:00100000:0.0:1788834932.007492:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834932.007541:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e810a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253942400:12345-0@lo:41: Request processed in 642us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834932.007550:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788834932.007767:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788834932.007781:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729253942656:0@lo:400: 00000100:00100000:0.0:1788834932.007817:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834932.007870:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253942656 00000100:00100000:0.0:1788834932.007877:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253942656 00000100:00100000:1.0:1788834932.007959:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253942528 00000100:00100000:1.0:1788834932.007966:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253942528 00000100:00100000:1.0:1788834932.008008:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788834932.008016:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:3614:x1875729253942528:12345-0@lo:400: 00000100:00100000:1.0:1788834932.008075:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:3614:x1875729253942528:12345-0@lo:400: Request processed in 60us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834932.008081:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788834932.008122:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253942784:0@lo:400: 00000100:00100000:1.0:1788834932.008168:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834932.008208:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788834932.008217:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729253942912:0@lo:400: 00000100:00100000:1.0:1788834932.008243:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834932.009232:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788834932.009245:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729253942656:12345-0@lo:400: 00000100:00100000:1.0:1788834932.009291:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729253942656:12345-0@lo:400: Request processed in 52us (1474us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834932.009299:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788834932.009363:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253942400:0@lo:41: 00010000:00080000:1.0:1788834932.009426:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afd9e817b80 x1875729253942656/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834932.009436:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729253942656:0@lo:400: 00000100:00100000:1.0:1788834932.009447:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253942528:0@lo:400: 00000100:00100000:1.0:1788834932.009759:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253942784 00000100:00100000:1.0:1788834932.009766:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253942784 00000100:00100000:1.0:1788834932.009800:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788834932.009809:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253942784:12345-0@lo:400: 00000100:00100000:1.0:1788834932.009851:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253942784:12345-0@lo:400: Request processed in 45us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834932.009857:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788834932.009889:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253942784:0@lo:400: 00000100:00100000:0.0:1788834932.010647:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253942912 00000100:00100000:0.0:1788834932.010661:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253942912 00000100:00100000:0.0:1788834932.010748:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788834932.010762:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729253942912:12345-0@lo:400: 00000100:00100000:0.0:1788834932.010855:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e812300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729253942912:12345-0@lo:400: Request processed in 97us (2610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834932.010878:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1788834932.010939:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afd9e814700 x1875729253942912/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834948 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834932.010954:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729253942912:0@lo:400: 00010000:00010000:0.0:1788834932.197668:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1788834932.861553:0:8396:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1788834932.861558:0:8396:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788834932.861560:0:8396:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:3.0:1788834932.861715:0:8396:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9afdba102000 00000020:01000004:3.0:1788834932.861732:0:8396:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1788834932.861744:0:8396:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:3.0:1788834932.861757:0:8396:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9afdaf55cd28) 00000020:00000080:3.0:1788834932.861776:0:8396:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788834932.940986:0:8396:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1788834932.941044:0:8396:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00080000:01000000:2.0:1788834932.990524:0:8396:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:2.0:1788834932.990730:0:8396:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1788834932.990742:0:8396:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:2.0:1788834932.990754:0:8396:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdf60171e5a5d1895 00000020:01000004:2.0:1788834932.990766:0:8396:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:2.0:1788834932.990788:0:8396:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.122@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1788834932.990792:0:8396:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1788834932.990798:0:8396:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1788834932.990803:0:8396:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1788834932.990816:0:8396:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9afdb715cd28) 00000020:00000080:2.0:1788834932.990826:0:8396:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type ost with refcount 2 00000100:00100000:2.0:1788834932.992136:0:8396:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788834932.992345:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1788834932.992352:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1788834932.995856:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1788834932.995866:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788834933.000271:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788834933.000292:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:2.0:1788834933.007842:0:8396:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788834933.008698:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:2.0:1788834933.008716:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788834933.010343:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788834933.010353:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1788834933.053831:0:8396:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1788834933.054171:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1788834933.054178:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1788834933.055948:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1788834933.055960:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1788834933.060610:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1788834933.060652:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1788834933.065152:0:8396:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788834933.066416:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788834933.066425:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1788834933.067725:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1788834933.067736:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1788834933.160477:0:8396:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1788834933.160864:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1788834933.160871:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1788834933.162945:0:8396:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1788834933.162957:0:8396:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1788834933.164386:0:8396:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1788834933.164420:0:8396:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:1.0:1788834933.164427:0:8396:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1788834933.203283:0:8396:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788834933.203348:0:8396:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.122@tcp, index=0000, flags=0x20062 00000020:01000004:1.0:1788834933.203353:0:8396:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788834933.203354:0:8396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788834933.203356:0:8396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788834933.203356:0:8396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788834933.203358:0:8396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788834933.203359:0:8396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788834933.203360:0:8396:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788834933.203361:0:8396:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788834933.203363:0:8396:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788834933.203364:0:8396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788834933.203365:0:8396:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788834933.203369:0:8396:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:1.0:1788834933.203372:0:8396:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788834933.203373:0:8396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788834933.203374:0:8396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788834933.203375:0:8396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788834933.203376:0:8396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788834933.203377:0:8396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788834933.203378:0:8396:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788834933.203379:0:8396:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788834933.203380:0:8396:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788834933.203381:0:8396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788834933.203382:0:8396:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788834933.203407:0:8396:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1788834933.203426:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e811880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253943040:0@lo:253: 00000100:00100000:1.0:1788834933.204779:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834933.204855:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2ef5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788834933.205017:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253943040 00000100:00100000:2.0:1788834933.205025:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253943040 00000100:00100000:2.0:1788834933.205223:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788834933.205233:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:8396:x1875729253943040:12345-0@lo:253: 20000000:01000000:2.0:1788834933.205264:0:6483:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1788834933.205268:0:6483:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1788834933.205273:0:6483:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1788834933.205277:0:6483:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1788834933.205935:0:6483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788834933.206220:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:2.0:1788834933.206236:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1788834933.206255:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:2.0:1788834933.206262:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1788834933.206275:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:2.0:1788834933.206291:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:2.0:1788834933.206421:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:2.0:1788834933.206437:0:6483:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.122@tcp 20000000:01000000:2.0:1788834933.206439:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:2.0:1788834933.206467:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:2.0:1788834933.206474:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788834933.206487:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:2.0:1788834933.206492:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:2.0:1788834933.206504:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:2.0:1788834933.206509:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788834933.206532:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:2.0:1788834933.206546:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1788834933.206622:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].25, 224 off12680 20000000:01000000:2.0:1788834933.206996:0:6483:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.122@tcp 20000000:01000000:2.0:1788834933.206998:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:2.0:1788834933.207017:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].26, 88 off12768 20000000:01000000:2.0:1788834933.207023:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1788834933.207035:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].27, 144 off12912 20000000:01000000:2.0:1788834933.207040:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0001 0xcf003 lustre-OST0000_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:2.0:1788834933.207054:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].28, 152 off13064 20000000:01000000:2.0:1788834933.207060:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788834933.207083:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].29, 136 off13200 00000040:00080000:2.0:1788834933.207101:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].30, 224 off13424 00000040:00080000:2.0:1788834933.207891:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13448 20000000:01000000:2.0:1788834933.207906:0:6483:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.122@tcp 20000000:01000000:2.0:1788834933.207908:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:2.0:1788834933.207920:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13536 20000000:01000000:2.0:1788834933.207925:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1788834933.207935:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13664 20000000:01000000:2.0:1788834933.207939:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:2.0:1788834933.207949:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13808 20000000:01000000:2.0:1788834933.207964:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1788834933.207977:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13936 00000040:00080000:2.0:1788834933.208083:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14160 20000000:01000000:2.0:1788834933.208099:0:6483:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1788834933.208102:0:6483:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1788834933.208105:0:6483:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1788834933.210355:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788834933.210363:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788834933.210884:0:8415:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 18 1->4: lustre sys.timeout 20000000:01000000:2.0:1788834933.210932:0:8415:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 18 2->4: lustre sys.timeout 00000040:00080000:2.0:1788834933.210951:0:8415:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 31 count 31 00000040:00080000:0.0:1788834933.211377:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].31, 224 off13648 00000040:00080000:0.0:1788834933.211401:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].32, 80 off13728 00000040:00080000:0.0:1788834933.211417:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].33, 224 off13952 20000000:01000000:0.0:1788834933.211443:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1788834933.211446:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1788834933.214757:0:8416:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 19 1->4: lustre sys.timeout 20000000:01000000:2.0:1788834933.214811:0:8416:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 19 2->4: lustre sys.timeout 00000040:00080000:2.0:1788834933.214830:0:8416:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:0.0:1788834933.215789:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:0.0:1788834933.215816:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:0.0:1788834933.215830:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:0.0:1788834933.215843:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1788834933.215846:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788834933.217299:0:8417:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:0.0:1788834933.217711:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:0.0:1788834933.217734:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:0.0:1788834933.217747:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:0.0:1788834933.217759:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1788834933.217761:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788834933.218487:0:8418:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 20 1->4: lustre sys.timeout 20000000:01000000:3.0:1788834933.218512:0:8418:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 20 2->4: lustre sys.timeout 00000040:00080000:3.0:1788834933.218528:0:8418:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:0.0:1788834933.218759:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14384 00000040:00080000:0.0:1788834933.218781:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14464 00000040:00080000:0.0:1788834933.218797:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14688 10000000:01000000:0.0:1788834933.218815:0:6483:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788834933.218837:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.218862:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd80031e00/0xdf60171e5a5d176f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1768 expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.218870:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd866f4600/0xdf60171e5a5d17e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d17df expref: 18 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.218953:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd81669e00/0xdf60171e5a5d181e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1817 expref: 18 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.218961:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd80031000/0xdf60171e5a5d183a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1833 expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.218967:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdc204bc00/0xdf60171e5a5d1864 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d185d expref: 18 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.218975:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18a3 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.219694:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdc204bc00/0xdf60171e5a5d1864 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d185d expref: 18 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.219712:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afdc204bc00/0xdf60171e5a5d1864 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d185d expref: 18 pid: 6482 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834933.219725:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253943168:0@lo:104: 00000100:00100000:0.0:1788834933.219786:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788834933.219902:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd80031000/0xdf60171e5a5d183a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1833 expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.219911:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afd80031000/0xdf60171e5a5d183a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1833 expref: 18 pid: 6483 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834933.219929:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253943296:0@lo:104: 00000100:00100000:0.0:1788834933.219954:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788834933.220343:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd81669e00/0xdf60171e5a5d181e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1817 expref: 18 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.220353:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afd81669e00/0xdf60171e5a5d181e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1817 expref: 18 pid: 6481 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834933.220362:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253943424:0@lo:104: 00000100:00100000:0.0:1788834933.220396:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834933.220498:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253943168 00000100:00100000:2.0:1788834933.220506:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253943168 00000100:00100000:2.0:1788834933.220549:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253943296 00000100:00100000:2.0:1788834933.220552:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253943296 00000100:00100000:2.0:1788834933.220569:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788834933.220577:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e815c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:6483:x1875729253943168:12345-0@lo:104: 00010000:00010000:2.0:1788834933.220602:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afd866f5e00/0xdf60171e5a5d185d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1864 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.220655:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788834933.220661:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e815c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:6483:x1875729253943168:12345-0@lo:104: Request processed in 85us (874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834933.220669:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788834933.220685:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788834933.220691:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:6483:x1875729253943296:12345-0@lo:104: 00010000:00010000:2.0:1788834933.220699:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdc2166c00/0xdf60171e5a5d1833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d183a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.220739:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788834933.220744:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:6483:x1875729253943296:12345-0@lo:104: Request processed in 54us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834933.220750:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1788834933.220768:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788834933.220774:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd866f5e00/0xdf60171e5a5d185d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1864 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.220781:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5e00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788834933.220785:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f5e00/0xdf60171e5a5d185d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1864 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.220800:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd866f5e00/0xdf60171e5a5d185d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1864 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788834933.220806:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f5e00/0xdf60171e5a5d185d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1864 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834933.220812:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788834933.220839:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd866f5e00/0xdf60171e5a5d185d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1864 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.220846:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788834933.220870:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd866f5e00/0xdf60171e5a5d185d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1864 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.220888:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd866f5e00/0xdf60171e5a5d185d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1864 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.220911:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788834933.220914:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdc2166c00/0xdf60171e5a5d1833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d183a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.220919:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc2166c00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788834933.220922:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdc2166c00/0xdf60171e5a5d1833 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d183a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.220927:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdc2166c00/0xdf60171e5a5d1833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d183a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788834933.220933:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdc2166c00/0xdf60171e5a5d1833 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d183a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834933.220937:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788834933.220952:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdc2166c00/0xdf60171e5a5d1833 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d183a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.220957:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788834933.220962:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdc2166c00/0xdf60171e5a5d1833 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d183a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.220967:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdc2166c00/0xdf60171e5a5d1833 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d183a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.220977:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834933.220979:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834933.220991:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834933.220999:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788834933.221024:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdaaf3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253943552:0@lo:103: 00000100:00100000:2.0:1788834933.221064:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834933.221097:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788834933.221103:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdaaf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253943680:0@lo:103: 00000100:00100000:2.0:1788834933.221123:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834933.221162:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253943552 00000100:00100000:2.0:1788834933.221166:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253943552 00010000:00010000:2.0:1788834933.221184:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdc204bc00/0xdf60171e5a5d1864 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d185d expref: 19 pid: 6482 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834933.221214:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253943680 00000100:00100000:2.0:1788834933.221217:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253943680 00010000:00010000:2.0:1788834933.221228:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd80031000/0xdf60171e5a5d183a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1833 expref: 20 pid: 6483 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834933.221245:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788834933.221252:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8207ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:3614:x1875729253943552:12345-0@lo:103: 00010000:00010000:2.0:1788834933.221262:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788834933.221266:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdc204bc00/0xdf60171e5a5d1864 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d185d expref: 20 pid: 6482 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.221276:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdc204bc00/0xdf60171e5a5d1864 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d185d expref: 20 pid: 6482 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.221291:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788834933.221352:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8207ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:3614:x1875729253943552:12345-0@lo:103: Request processed in 100us (288us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834933.221358:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788834933.221370:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788834933.221377:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82079500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:3614:x1875729253943680:12345-0@lo:103: 00010000:00010000:2.0:1788834933.221390:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788834933.221395:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd80031000/0xdf60171e5a5d183a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1833 expref: 19 pid: 6483 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.221403:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd80031000/0xdf60171e5a5d183a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1833 expref: 19 pid: 6483 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.221412:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788834933.221434:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82079500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:3614:x1875729253943680:12345-0@lo:103: Request processed in 58us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834933.221440:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788834933.221494:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdaaf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253943680:0@lo:103: 00000100:00100000:2.0:1788834933.221503:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdaaf3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253943552:0@lo:103: 00010000:00010000:0.0:1788834933.222171:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788834933.222217:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd866f4600/0xdf60171e5a5d17e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d17df expref: 18 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.222228:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afd866f4600/0xdf60171e5a5d17e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d17df expref: 18 pid: 6481 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834933.222237:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82074a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253943808:0@lo:104: 00000100:00100000:0.0:1788834933.222268:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788834933.222299:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd80031e00/0xdf60171e5a5d176f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1768 expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.222307:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afd80031e00/0xdf60171e5a5d176f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1768 expref: 18 pid: 6483 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834933.222335:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82075500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253943936:0@lo:104: 00000100:00100000:0.0:1788834933.222355:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834933.222365:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd83a88b40 going to sleep for 11 seconds 00010000:00010000:0.0:1788834933.222388:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdc204bc00/0xdf60171e5a5d1864 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d185d expref: 18 pid: 6482 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834933.222399:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253943168:0@lo:104: 00010000:00010000:0.0:1788834933.222408:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd80031000/0xdf60171e5a5d183a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1833 expref: 17 pid: 6483 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834933.222415:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253943296:0@lo:104: 00000100:00100000:1.0:1788834933.222514:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253943424 00000100:00100000:1.0:1788834933.222519:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253943424 00000100:00100000:1.0:1788834933.222543:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253943808 00000100:00100000:1.0:1788834933.222546:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253943808 00000100:00100000:1.0:1788834933.222555:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253943936 00000100:00100000:1.0:1788834933.222557:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253943936 00000100:00100000:1.0:1788834933.222568:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788834933.222575:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82075880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+5:6483:x1875729253943424:12345-0@lo:104: 00010000:00010000:1.0:1788834933.222594:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afd81669200/0xdf60171e5a5d1817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d181e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834933.222644:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788834933.222651:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82075880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+5:6483:x1875729253943424:12345-0@lo:104: Request processed in 76us (2254us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834933.222658:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788834933.222672:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788834933.222677:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82076d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:6483:x1875729253943808:12345-0@lo:104: 00010000:00010000:1.0:1788834933.222685:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afd81668c00/0xdf60171e5a5d17df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d17e6 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834933.222716:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788834933.222721:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82076d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:6483:x1875729253943808:12345-0@lo:104: Request processed in 44us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834933.222727:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788834933.222737:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788834933.222742:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82077b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:6483:x1875729253943936:12345-0@lo:104: 00010000:00010000:1.0:1788834933.222749:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdc204a400/0xdf60171e5a5d1768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d176f expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834933.222788:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788834933.222793:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82077b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:6483:x1875729253943936:12345-0@lo:104: Request processed in 51us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834933.222799:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:0.0:1788834933.222961:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788834933.222967:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd81669200/0xdf60171e5a5d1817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d181e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.222975:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd81669200 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:0.0:1788834933.222979:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd81669200/0xdf60171e5a5d1817 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d181e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.222997:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd81669200/0xdf60171e5a5d1817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d181e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788834933.223004:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd81669200/0xdf60171e5a5d1817 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d181e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788834933.223010:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788834933.223045:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd81669200/0xdf60171e5a5d1817 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d181e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223053:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788834933.223071:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd81669200/0xdf60171e5a5d1817 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d181e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223078:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd81669200/0xdf60171e5a5d1817 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d181e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223097:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788834933.223100:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd81668c00/0xdf60171e5a5d17df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d17e6 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223106:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd81668c00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:0.0:1788834933.223109:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd81668c00/0xdf60171e5a5d17df lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d17e6 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223116:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd81668c00/0xdf60171e5a5d17df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d17e6 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788834933.223122:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd81668c00/0xdf60171e5a5d17df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d17e6 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788834933.223127:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788834933.223151:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd81668c00/0xdf60171e5a5d17df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d17e6 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223158:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788834933.223164:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd81668c00/0xdf60171e5a5d17df lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d17e6 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223171:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd81668c00/0xdf60171e5a5d17df lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d17e6 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223181:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788834933.223185:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdc204a400/0xdf60171e5a5d1768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d176f expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223210:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204a400 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:0.0:1788834933.223213:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdc204a400/0xdf60171e5a5d1768 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d176f expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223219:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdc204a400/0xdf60171e5a5d1768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d176f expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788834933.223225:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdc204a400/0xdf60171e5a5d1768 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d176f expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788834933.223230:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788834933.223244:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdc204a400/0xdf60171e5a5d1768 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d176f expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223249:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788834933.223262:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdc204a400/0xdf60171e5a5d1768 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d176f expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223269:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdc204a400/0xdf60171e5a5d1768 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d176f expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223282:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788834933.223284:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788834933.223286:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788834933.223298:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253944064:0@lo:103: 00000100:00100000:0.0:1788834933.223346:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834933.223374:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788834933.223379:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253944192:0@lo:103: 00000100:00100000:0.0:1788834933.223407:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834933.223428:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788834933.223435:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729253944320:0@lo:103: 00000100:00100000:0.0:1788834933.223456:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834933.223476:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253944064 00000100:00100000:0.0:1788834933.223480:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253944064 00010000:00010000:0.0:1788834933.223497:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd81669e00/0xdf60171e5a5d181e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1817 expref: 17 pid: 6481 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834933.223513:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253944192 00000100:00100000:0.0:1788834933.223515:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253944192 00010000:00010000:0.0:1788834933.223525:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd866f4600/0xdf60171e5a5d17e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d17df expref: 18 pid: 6481 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834933.223534:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253944320 00000100:00100000:0.0:1788834933.223536:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253944320 00010000:00010000:0.0:1788834933.223543:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd80031e00/0xdf60171e5a5d176f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1768 expref: 19 pid: 6483 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834933.223553:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788834933.223559:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82074380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:3616:x1875729253944064:12345-0@lo:103: 00010000:00010000:0.0:1788834933.223567:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788834933.223571:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd81669e00/0xdf60171e5a5d181e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1817 expref: 19 pid: 6481 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223593:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd81669e00/0xdf60171e5a5d181e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1817 expref: 19 pid: 6481 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223607:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788834933.223634:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82074380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:3616:x1875729253944064:12345-0@lo:103: Request processed in 75us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834933.223646:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788834933.223659:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788834933.223665:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82074e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:3616:x1875729253944192:12345-0@lo:103: 00010000:00010000:0.0:1788834933.223673:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788834933.223677:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd866f4600/0xdf60171e5a5d17e6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d17df expref: 18 pid: 6481 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223685:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd866f4600/0xdf60171e5a5d17e6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d17df expref: 18 pid: 6481 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223695:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788834933.223716:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82074e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:3616:x1875729253944192:12345-0@lo:103: Request processed in 52us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834933.223723:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788834933.223735:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788834933.223740:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaae6c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:3615:x1875729253944320:12345-0@lo:103: 00010000:00010000:0.0:1788834933.223747:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788834933.223762:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd80031e00/0xdf60171e5a5d176f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1768 expref: 17 pid: 6483 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223772:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd80031e00/0xdf60171e5a5d176f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1768 expref: 17 pid: 6483 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223783:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18a3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223790:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18a3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223815:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223822:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223829:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18a3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223835:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223840:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80031600 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788834933.223843:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223850:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18a3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223858:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18a3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.223867:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788834933.224519:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaae6c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:3615:x1875729253944320:12345-0@lo:103: Request processed in 774us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834933.224527:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788834933.224665:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253944192:0@lo:103: 00000100:00100000:0.0:1788834933.224674:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253944064:0@lo:103: 00000100:00100000:0.0:1788834933.224702:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82074700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729253944320:0@lo:103: 00010000:00010000:0.0:1788834933.224752:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd81669e00/0xdf60171e5a5d181e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1817 expref: 16 pid: 6481 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834933.224766:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253943424:0@lo:104: 00010000:00010000:0.0:1788834933.224775:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd866f4600/0xdf60171e5a5d17e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d17df expref: 15 pid: 6481 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834933.224783:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82074a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253943808:0@lo:104: 00010000:00010000:0.0:1788834933.224792:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd80031e00/0xdf60171e5a5d176f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1768 expref: 14 pid: 6483 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834933.224800:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82075500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253943936:0@lo:104: 00010000:00010000:0.0:1788834933.224820:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.224828:0:6483:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.224834:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.224840:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18a3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788834933.224851:0:6483:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00010000:00010000:2.0:1788834933.225952:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834933.225962:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788834933.228153:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:8396:x1875729253943040:12345-0@lo:253: Request processed in 22913us (23372us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834933.228167:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788834933.228665:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e811880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253943040:0@lo:253: 10000000:01000000:3.0:1788834933.228684:0:8396:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1788834933.228687:0:8396:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788834933.228689:0:8396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1788834933.228690:0:8396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788834933.228691:0:8396:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1788834933.228692:0:8396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788834933.228693:0:8396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788834933.228695:0:8396:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788834933.228696:0:8396:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1788834933.228698:0:8396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788834933.228699:0:8396:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788834933.228720:0:8396:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9afdba102000 from lustre-OST0000 10000000:01000000:3.0:1788834933.228751:0:8396:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1788834933.228753:0:8396:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1788834933.228761:0:8396:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9afdab4bb370 local copy 10000000:01000000:3.0:1788834933.228766:0:8396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788834933.228798:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdc204ac00/0xdf60171e5a5d18aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.228809:0:8396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.122@tcp lock: ffff9afdc204ac00/0xdf60171e5a5d18aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.228818:0:8396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdc204ac00/0xdf60171e5a5d18aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834933.228836:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253944448:0@lo:101: 00000100:00100000:3.0:1788834933.228966:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834933.229106:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb7235c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788834933.229206:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253944448 00000100:00100000:1.0:1788834933.229212:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253944448 00000100:00100000:3.0:1788834933.229513:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788834933.229524:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:8396:x1875729253944448:12345-0@lo:101: 00010000:00010000:3.0:1788834933.229537:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788834933.229552:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d18b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d18aa expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.229574:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d18b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d18aa expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.229595:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d18b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d18aa expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.229603:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204ae00, rc 0) 00000100:00100000:3.0:1788834933.229647:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:8396:x1875729253944448:12345-0@lo:101: Request processed in 125us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834933.229654:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788834933.229721:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f8e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253944448:0@lo:101: 00010000:00010000:1.0:1788834933.229733:0:8396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdc204ac00/0xdf60171e5a5d18aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdf60171e5a5d18b1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834933.229742:0:8396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdc204ac00/0xdf60171e5a5d18aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdf60171e5a5d18b1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834933.229837:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253944576:0@lo:501: 00000100:00100000:1.0:1788834933.229866:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834933.230144:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2ef5540 going to sleep for 11 seconds 00000100:00100000:2.0:1788834933.230866:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253944576 00000100:00100000:2.0:1788834933.230873:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253944576 00000100:00100000:2.0:1788834933.230907:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788834933.230915:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:8396:x1875729253944576:12345-0@lo:501: 00000100:00100000:2.0:1788834933.231004:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:8396:x1875729253944576:12345-0@lo:501: Request processed in 90us (1136us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788834933.231012:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788834933.231162:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253944576:0@lo:501: 10000000:01000000:1.0:1788834933.231180:0:8396:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788834933.231210:0:8396:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788834933.231218:0:8396:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdc204ac00/0xdf60171e5a5d18aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdf60171e5a5d18b1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834933.231226:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdc204ac00/0xdf60171e5a5d18aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdf60171e5a5d18b1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834933.231244:0:8396:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9afdc204ac00/0xdf60171e5a5d18aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdf60171e5a5d18b1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834933.231271:0:8396:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788834933.231300:0:8396:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9afdba102000 10000000:01000000:1.0:1788834933.231305:0:8396:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788834933.231309:0:8396:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1788834933.231312:0:8396:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788834933.231339:0:8396:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1788834933.231342:0:8396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1788834933.231364:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdc2166000/0xdf60171e5a5d18b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834933.231371:0:8396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdc2166000/0xdf60171e5a5d18b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834933.231379:0:8396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdc2166000/0xdf60171e5a5d18b8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834933.231394:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253944704:0@lo:101: 00000100:00100000:1.0:1788834933.231426:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834933.231448:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2ef5c00 going to sleep for 11 seconds 00010000:00010000:2.0:1788834933.231576:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788834933.231592:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdc204ac00/0xdf60171e5a5d18aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdf60171e5a5d18b1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.231600:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204ac00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788834933.231604:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdc204ac00/0xdf60171e5a5d18aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdf60171e5a5d18b1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.231618:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdc204ac00/0xdf60171e5a5d18aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xdf60171e5a5d18b1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788834933.231626:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdc204ac00/0xdf60171e5a5d18aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xdf60171e5a5d18b1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834933.231633:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788834933.231650:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdc204ac00/0xdf60171e5a5d18aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf60171e5a5d18b1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.231655:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788834933.231676:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdc204ac00/0xdf60171e5a5d18aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf60171e5a5d18b1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.231682:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdc204ac00/0xdf60171e5a5d18aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf60171e5a5d18b1 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.231693:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834933.231695:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834933.231696:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788834933.231715:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253944704 00000100:00100000:2.0:1788834933.231718:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253944704 00000100:00100000:2.0:1788834933.231739:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1788834933.231746:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:8396:x1875729253944704:12345-0@lo:101: 00010000:00010000:2.0:1788834933.231753:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788834933.231764:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd866f5e00/0xdf60171e5a5d18bf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d18b8 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.231781:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd866f5e00/0xdf60171e5a5d18bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d18b8 expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.231798:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd866f5e00/0xdf60171e5a5d18bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d18b8 expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.231806:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5e00, rc 0) 00000100:00100000:2.0:1788834933.231836:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:8396:x1875729253944704:12345-0@lo:101: Request processed in 90us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834933.231842:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788834933.231968:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729253944832:0@lo:103: 00000100:00100000:1.0:1788834933.232009:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834933.232063:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253944704:0@lo:101: 00010000:00010000:1.0:1788834933.232074:0:8396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdc2166000/0xdf60171e5a5d18b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d18bf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834933.232094:0:8396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdc2166000/0xdf60171e5a5d18b8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d18bf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834933.232167:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253944960:0@lo:501: 00000100:00100000:1.0:1788834933.232202:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834933.232214:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2ef5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788834933.232399:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253944832 00000100:00100000:2.0:1788834933.232404:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253944832 00000100:00100000:2.0:1788834933.232435:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788834933.232442:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e813800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:3615:x1875729253944832:12345-0@lo:103: 00010000:00010000:2.0:1788834933.232451:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788834933.232463:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d18b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d18aa expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.232472:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788834933.232502:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e813800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:3615:x1875729253944832:12345-0@lo:103: Request processed in 61us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834933.232508:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788834933.232531:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729253944832:0@lo:103: 00000100:00100000:2.0:1788834933.232546:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253944960 00000100:00100000:2.0:1788834933.232549:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253944960 00000100:00100000:2.0:1788834933.232564:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788834933.232570:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:8396:x1875729253944960:12345-0@lo:501: 00000100:00100000:2.0:1788834933.232729:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:8396:x1875729253944960:12345-0@lo:501: Request processed in 159us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834933.232745:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788834933.232863:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253944960:0@lo:501: 00000100:00100000:1.0:1788834933.232889:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253945088:0@lo:503: 00000100:00100000:1.0:1788834933.232929:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834933.232959:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2ef5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788834933.233517:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253945088 00000100:00100000:2.0:1788834933.233524:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253945088 00000100:00100000:2.0:1788834933.233550:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788834933.233557:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:8396:x1875729253945088:12345-0@lo:503: 00000100:00100000:2.0:1788834933.233662:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:8396:x1875729253945088:12345-0@lo:503: Request processed in 105us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834933.233669:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1788834933.233817:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253945088:0@lo:503: 00000040:00080000:1.0:1788834933.234239:0:8396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788834933.234366:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253945216:0@lo:502: 00000100:00100000:1.0:1788834933.234412:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834933.234437:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2ef5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788834933.234568:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253945216 00000100:00100000:3.0:1788834933.234573:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253945216 00000100:00100000:3.0:1788834933.234674:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788834933.234681:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:8396:x1875729253945216:12345-0@lo:502: 00000100:00100000:3.0:1788834933.234780:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:8396:x1875729253945216:12345-0@lo:502: Request processed in 99us (367us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834933.234788:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788834933.234929:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253945216:0@lo:502: 00000040:00080000:1.0:1788834933.235275:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1788834933.235305:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1788834933.235399:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1788834933.235416:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1788834933.235428:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1788834933.235442:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1788834933.235467:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253945344:0@lo:502: 00000100:00100000:1.0:1788834933.235509:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834933.235534:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2ef5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788834933.236849:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253945344 00000100:00100000:3.0:1788834933.236860:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253945344 00000100:00100000:3.0:1788834933.236916:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788834933.236925:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:8396:x1875729253945344:12345-0@lo:502: 00000100:00100000:3.0:1788834933.237295:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:8396:x1875729253945344:12345-0@lo:502: Request processed in 371us (1785us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834933.237303:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788834933.237417:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253945344:0@lo:502: 00000040:00080000:1.0:1788834933.237491:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1788834933.237502:0:8396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1788834933.238753:0:8419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788834933.238762:0:8419:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788834933.238769:0:8419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788834933.238771:0:8419:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788834933.238778:0:8419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788834933.238811:0:8419:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9afc820cb370) 00000020:00000080:0.0:1788834933.238838:0:8419:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788834933.238845:0:8419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788834933.238928:0:8419:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afdba102000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788834933.238936:0:8419:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788834933.238943:0:8419:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdf60171e5a5d18cd 00010000:00010000:0.0:1788834933.246569:0:8419:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:02000400:0.0:1788834933.246925:0:8419:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:0.0:1788834933.251096:0:8419:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1788834933.251544:0:8419:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1788834933.262406:0:8419:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:0.0:1788834933.262916:0:8419:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:0.0:1788834933.277425:0:8419:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:3.0:1788834933.291967:0:8419:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1788834933.291979:0:8419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788834933.291997:0:8419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788834933.291999:0:8419:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1788834933.292003:0:8419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788834933.292007:0:8419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788834933.292008:0:8419:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788834933.292011:0:8419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788834933.292012:0:8419:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1788834933.292039:0:8419:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788834933.292042:0:8419:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788834933.292043:0:8419:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788834933.292047:0:8419:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:1.0:1788834933.297400:0:8396:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:1.0:1788834933.297456:0:8396:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1788834933.297478:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdc2166000/0xdf60171e5a5d18b8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d18bf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834933.297491:0:8396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdc2166000/0xdf60171e5a5d18b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d18bf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834933.297500:0:8396:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afdba102000 from 1 10000000:01000000:1.0:1788834933.297503:0:8396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788834933.297541:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdc2167e00/0xdf60171e5a5d18d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834933.297549:0:8396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdc2167e00/0xdf60171e5a5d18d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834933.297560:0:8396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdc2167e00/0xdf60171e5a5d18d4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834933.297594:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253945472:0@lo:101: 00000100:00100000:1.0:1788834933.297662:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834933.297716:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2ef5540 going to sleep for 11 seconds 00000100:00100000:0.0:1788834933.298624:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253945472 00000100:00100000:0.0:1788834933.298635:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253945472 00000100:00100000:0.0:1788834933.298689:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788834933.298699:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:8396:x1875729253945472:12345-0@lo:101: 00010000:00010000:0.0:1788834933.298714:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788834933.298728:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18db lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d18d4 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.298753:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d18d4 expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.298763:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d18d4 expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.298772:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd80031600, rc 0) 00000100:00100000:0.0:1788834933.298821:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:8396:x1875729253945472:12345-0@lo:101: Request processed in 124us (1159us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834933.298845:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788834933.299047:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253945472:0@lo:101: 00010000:00010000:1.0:1788834933.299063:0:8396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdc2167e00/0xdf60171e5a5d18d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d18db expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834933.299083:0:8396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdc2167e00/0xdf60171e5a5d18d4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d18db expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834933.299416:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253945600:0@lo:501: 00000100:00100000:1.0:1788834933.299452:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834933.299478:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2ef5540 going to sleep for 11 seconds 00000100:00100000:0.0:1788834933.299558:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253945600 00000100:00100000:0.0:1788834933.299564:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253945600 00000100:00100000:0.0:1788834933.299611:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788834933.299619:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:8396:x1875729253945600:12345-0@lo:501: 00000100:00100000:0.0:1788834933.299718:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:8396:x1875729253945600:12345-0@lo:501: Request processed in 100us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834933.299725:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788834933.300725:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253945600:0@lo:501: 00000100:00100000:1.0:1788834933.300767:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253945728:0@lo:503: 00000100:00100000:1.0:1788834933.300826:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834933.300857:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2ef5540 going to sleep for 11 seconds 00000100:00100000:0.0:1788834933.300955:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253945728 00000100:00100000:0.0:1788834933.300961:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253945728 00000100:00100000:0.0:1788834933.301008:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788834933.301016:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:8396:x1875729253945728:12345-0@lo:503: 00000100:00100000:0.0:1788834933.301123:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:8396:x1875729253945728:12345-0@lo:503: Request processed in 107us (296us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834933.301130:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788834933.302130:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253945728:0@lo:503: 00000040:00080000:1.0:1788834933.302719:0:8396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788834933.302805:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253945856:0@lo:502: 00000100:00100000:1.0:1788834933.302877:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834933.302921:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2ef5540 going to sleep for 11 seconds 00000100:00100000:0.0:1788834933.303010:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253945856 00000100:00100000:0.0:1788834933.303017:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253945856 00000100:00100000:0.0:1788834933.303076:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788834933.303085:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:8396:x1875729253945856:12345-0@lo:502: 00000100:00100000:0.0:1788834933.303208:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:8396:x1875729253945856:12345-0@lo:502: Request processed in 125us (331us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834933.303215:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788834933.308625:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253945856:0@lo:502: 00000040:00080000:2.0:1788834933.308847:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788834933.308875:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788834933.308908:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253945984:0@lo:502: 00000100:00100000:2.0:1788834933.308967:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834933.309021:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd91672000 going to sleep for 11 seconds 00000100:00100000:1.0:1788834933.309297:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253945984 00000100:00100000:1.0:1788834933.309304:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253945984 00000100:00100000:1.0:1788834933.309370:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788834933.309378:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:8396:x1875729253945984:12345-0@lo:502: 00000100:00100000:1.0:1788834933.309491:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:8396:x1875729253945984:12345-0@lo:502: Request processed in 113us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834933.309499:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788834933.309741:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207bb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253945984:0@lo:502: 00000040:00080000:3.0:1788834933.309793:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1788834933.309801:0:8396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1788834933.311691:0:8423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788834933.311705:0:8423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788834933.311707:0:8423:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788834933.311726:0:8423:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afdba102000 00000020:00000080:0.0:1788834933.311729:0:8423:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788834933.311749:0:8423:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788834933.311752:0:8423:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788834933.311754:0:8423:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1788834933.311757:0:8423:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788834933.311898:0:8396:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788834933.311930:0:8396:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788834933.311953:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdc2167e00/0xdf60171e5a5d18d4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d18db expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.311965:0:8396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdc2167e00/0xdf60171e5a5d18d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d18db expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834933.312025:0:8396:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788834933.312029:0:8396:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9afdba102000 10000000:01000000:2.0:1788834933.312032:0:8396:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9afdba102000 10000000:01000000:2.0:1788834933.312036:0:8396:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788834933.312041:0:8396:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afdba102000 from 1 10000000:01000000:2.0:1788834933.312058:0:8396:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788834933.312093:0:8396:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f4e00/0xdf60171e5a5d18e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.312102:0:8396:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd866f4e00/0xdf60171e5a5d18e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.312113:0:8396:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd866f4e00/0xdf60171e5a5d18e2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834933.312395:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253946112:0@lo:101: 00000100:00100000:2.0:1788834933.312462:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834933.312503:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd91672600 going to sleep for 11 seconds 00000100:00100000:0.0:1788834933.312665:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253946112 00000100:00100000:0.0:1788834933.312673:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253946112 00000100:00100000:0.0:1788834933.312722:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788834933.312731:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:8396:x1875729253946112:12345-0@lo:101: 00010000:00010000:0.0:1788834933.312743:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788834933.312756:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd80031e00/0xdf60171e5a5d18e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d18e2 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.312779:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd80031e00/0xdf60171e5a5d18e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d18e2 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.312789:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd80031e00/0xdf60171e5a5d18e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d18e2 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834933.312798:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd80031e00, rc 0) 00000100:00100000:0.0:1788834933.312835:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:8396:x1875729253946112:12345-0@lo:101: Request processed in 105us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834933.312841:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788834933.312923:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253946112:0@lo:101: 00010000:00010000:2.0:1788834933.312935:0:8396:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd866f4e00/0xdf60171e5a5d18e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d18e9 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.312943:0:8396:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd866f4e00/0xdf60171e5a5d18e2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d18e9 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834933.313031:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253946240:0@lo:501: 00000100:00100000:2.0:1788834933.313055:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834933.313080:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd91672600 going to sleep for 11 seconds 00000100:00100000:0.0:1788834933.313352:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253946240 00000100:00100000:0.0:1788834933.313357:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253946240 00000100:00100000:0.0:1788834933.313382:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788834933.313389:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:8396:x1875729253946240:12345-0@lo:501: 00000100:00100000:0.0:1788834933.313485:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:8396:x1875729253946240:12345-0@lo:501: Request processed in 95us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834933.313492:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788834933.314664:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253946240:0@lo:501: 00000100:00100000:2.0:1788834933.314710:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253946368:0@lo:503: 00000100:00100000:2.0:1788834933.314770:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834933.314812:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd91672600 going to sleep for 11 seconds 00000100:00100000:0.0:1788834933.316368:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253946368 00000100:00100000:0.0:1788834933.316390:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253946368 00000100:00100000:0.0:1788834933.316440:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788834933.316450:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd829d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:8396:x1875729253946368:12345-0@lo:503: 00000100:00100000:0.0:1788834933.316602:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd829d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:8396:x1875729253946368:12345-0@lo:503: Request processed in 153us (1830us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834933.316610:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788834933.316909:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207b100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253946368:0@lo:503: 00000040:00080000:3.0:1788834933.317520:0:8396:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788834933.317665:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253946496:0@lo:502: 00000100:00100000:3.0:1788834933.317723:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834933.317803:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb72353c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834933.318048:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253946496 00000100:00100000:2.0:1788834933.318061:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253946496 00000100:00100000:0.0:1788834933.318378:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788834933.318389:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd878e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:8396:x1875729253946496:12345-0@lo:502: 00000100:00100000:0.0:1788834933.318500:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd878e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:8396:x1875729253946496:12345-0@lo:502: Request processed in 113us (775us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834933.318508:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788834933.318659:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253946496:0@lo:502: 00000040:00080000:3.0:1788834933.318853:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1788834933.318882:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1788834933.318896:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1788834933.318919:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1788834933.318930:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1788834933.318941:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1788834933.318952:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1788834933.318963:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1788834933.318977:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1788834933.319007:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1788834933.319019:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1788834933.319033:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1788834933.319047:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1788834933.319063:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1788834933.319077:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1788834933.319089:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1788834933.319102:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1788834933.319130:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1788834933.319155:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1788834933.319170:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1788834933.319184:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1788834933.319209:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1788834933.319223:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1788834933.319254:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1788834933.319267:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:3.0:1788834933.319278:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:3.0:1788834933.319288:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:3.0:1788834933.319299:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:3.0:1788834933.319310:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:3.0:1788834933.319343:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:3.0:1788834933.319355:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:3.0:1788834933.319365:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:3.0:1788834933.319376:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:3.0:1788834933.319386:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:3.0:1788834933.319397:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:3.0:1788834933.319407:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:3.0:1788834933.319426:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000100:00100000:3.0:1788834933.319450:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253946624:0@lo:502: 00000100:00100000:3.0:1788834933.319490:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834933.319927:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb72353c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834933.320046:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253946624 00000100:00100000:2.0:1788834933.320052:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253946624 00000100:00100000:2.0:1788834933.320090:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788834933.320098:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd878e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:8396:x1875729253946624:12345-0@lo:502: 00000100:00100000:2.0:1788834933.320228:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd878e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:8396:x1875729253946624:12345-0@lo:502: Request processed in 130us (736us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834933.320235:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788834933.320421:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253946624:0@lo:502: 00000040:00080000:3.0:1788834933.320473:0:8396:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:3.0:1788834933.320481:0:8396:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1788834933.320976:0:8424:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788834933.321010:0:8424:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9afc823719b8) 00000020:00000080:3.0:1788834933.321032:0:8424:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:3.0:1788834933.321108:0:8424:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afdba102000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788834933.321113:0:8424:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afdba102000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788834933.321128:0:8424:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afdba102000 3 00010000:00080000:3.0:1788834933.321166:0:8424:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afdb34c0000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.122@tcp at head 00010000:00010000:3.0:1788834933.325480:0:8424:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-5 is initialized 00000020:00000080:3.0:1788834933.325777:0:8424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788834933.325827:0:8424:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788834933.325842:0:8424:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdf60171e5a5d18f7 00000100:00080000:3.0:1788834933.325855:0:8424:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788834933.325861:0:8424:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9afdb34c0000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788834933.325911:0:8424:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdb90f8000 x1875729253946752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788834933.325950:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875729253946752:0@lo:38: 00000100:00100000:3.0:1788834933.326033:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788834933.326095:0:8424:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788834933.330171:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253946752 00000100:00100000:0.0:1788834933.330199:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253946752 00000100:00100000:0.0:1788834933.330245:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788834933.330254:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875729253946752:12345-0@lo:38: 00010000:00080000:0.0:1788834933.330285:0:6487:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:0.0:1788834933.330333:0:6487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdf60171e5a5d18fe 00000004:00100000:0.0:1788834933.330350:0:6487:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1788834933.330386:0:6487:0:(import.c:65:import_set_state_nolock()) ffff9afc820d6000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788834933.330471:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1875729253946752:12345-0@lo:38: Request processed in 217us (4437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834933.330478:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788834933.330529:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afdb90f8000 x1875729253946752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788834943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834933.330539:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788834933.330547:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788834933.330555:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788834933.330571:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788834933.330574:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdb34c0000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788834933.330594:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875729253946752:0@lo:38: 00000100:00100000:3.0:1788834933.331209:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253947264:0@lo:400: 00000100:00100000:3.0:1788834933.331253:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834933.331290:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788834933.331296:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729253947136:0@lo:400: 00000100:00100000:3.0:1788834933.331341:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834933.331368:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253947136 00000100:00100000:3.0:1788834933.331373:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253947136 00000100:00100000:3.0:1788834933.331401:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788834933.331408:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729253947136:12345-0@lo:400: 00000100:00100000:3.0:1788834933.331446:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90fad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729253947136:12345-0@lo:400: Request processed in 38us (104us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834933.331452:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1788834933.331480:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afdb90fb800 x1875729253947136/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834933.331490:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729253947136:0@lo:400: 00000100:00100000:0.0:1788834933.333354:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729253946880:0@lo:400: 00000100:00100000:0.0:1788834933.333414:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834933.333445:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788834933.333452:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253947008:0@lo:400: 00000100:00100000:0.0:1788834933.333475:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834933.333512:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253946880 00000100:00100000:0.0:1788834933.333518:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253946880 00000100:00100000:0.0:1788834933.333576:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788834933.334067:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729253946880:12345-0@lo:400: 00000100:00100000:0.0:1788834933.334241:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729253946880:12345-0@lo:400: Request processed in 179us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834933.334249:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788834933.334299:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253947264 00000100:00100000:0.0:1788834933.334305:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253947264 00000100:00100000:0.0:1788834933.334342:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253947008 00000100:00100000:0.0:1788834933.334345:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253947008 00000100:00100000:0.0:1788834933.334359:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788834933.334365:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253947264:12345-0@lo:400: 00000100:00100000:0.0:1788834933.334409:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253947264:12345-0@lo:400: Request processed in 43us (3155us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834933.334415:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788834933.334427:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788834933.334433:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253947008:12345-0@lo:400: 00000100:00100000:0.0:1788834933.334459:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253947008:12345-0@lo:400: Request processed in 27us (983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834933.334472:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788834933.334506:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253947008:0@lo:400: 00010000:00080000:0.0:1788834933.334520:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afdb90faa00 x1875729253946880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834933.334531:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729253946880:0@lo:400: 00000100:00100000:0.0:1788834933.334568:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253947264:0@lo:400: 00000020:01000004:3.0:1788834933.335551:0:8424:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788834933.335566:0:8424:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9afc82374d28) 00000020:00000080:3.0:1788834933.335661:0:8424:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type lwp with refcount 2 00000020:01000004:3.0:1788834933.335738:0:8424:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afdba102000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788834933.335742:0:8424:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afdba102000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788834933.335745:0:8424:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afdba102000 3 00010000:00080000:3.0:1788834933.335771:0:8424:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afdba066000@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.122@tcp at head 00010000:00010000:3.0:1788834933.344251:0:8424:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-6 is initialized 00000020:00000080:3.0:1788834933.344518:0:8424:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788834933.347377:0:8424:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788834933.347395:0:8424:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xdf60171e5a5d190c 00000100:00080000:3.0:1788834933.347406:0:8424:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788834933.347412:0:8424:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9afdba066000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788834933.347444:0:8424:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdb90fb800 x1875729253947392/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788834933.347482:0:8424:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788834933.348715:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875729253947392:0@lo:38: 00000100:00100000:0.0:1788834933.348785:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834933.348879:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253947392 00000100:00100000:2.0:1788834933.348887:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253947392 00000100:00100000:2.0:1788834933.348925:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788834933.348933:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875729253947392:12345-0@lo:38: 00010000:00080000:2.0:1788834933.348957:0:6487:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 175 last 0 00000020:00000080:2.0:1788834933.349000:0:6487:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xdf60171e5a5d1913 00000004:00100000:2.0:1788834933.349014:0:6487:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788834933.349738:0:6487:0:(import.c:65:import_set_state_nolock()) ffff9afc82605000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788834933.349810:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1875729253947392:12345-0@lo:38: Request processed in 875us (1023us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834933.349819:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1788834933.350733:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afdb90fb800 x1875729253947392/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788834943 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834933.350746:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788834933.350755:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1788834933.350764:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788834933.350769:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788834933.350771:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdba066000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788834933.350777:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875729253947392:0@lo:38: 00000040:00080000:0.0:1788834933.351217:0:8424:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:2.0:1788834933.351556:0:8396:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:2.0:1788834933.351660:0:8396:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788834933.351681:0:8396:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f4e00/0xdf60171e5a5d18e2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d18e9 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.351692:0:8396:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd866f4e00/0xdf60171e5a5d18e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d18e9 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788834933.351751:0:8396:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788834933.351757:0:8396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788834933.351758:0:8396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788834933.351759:0:8396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788834933.351760:0:8396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788834933.351761:0:8396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788834933.351762:0:8396:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788834933.351763:0:8396:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788834933.351764:0:8396:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788834933.351766:0:8396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788834933.351767:0:8396:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788834933.351771:0:8396:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:2.0:1788834933.351773:0:8396:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788834933.351774:0:8396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788834933.351775:0:8396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788834933.351776:0:8396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788834933.351777:0:8396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788834933.351778:0:8396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788834933.351778:0:8396:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788834933.351779:0:8396:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1788834933.351780:0:8396:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1788834933.351781:0:8396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788834933.351782:0:8396:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788834933.351806:0:8396:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788834933.351820:0:8396:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253947520:0@lo:253: 00000100:00100000:2.0:1788834933.351885:0:8396:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834933.352847:0:8396:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd916729c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788834933.358507:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253947520 00000100:00100000:3.0:1788834933.358523:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253947520 00000100:00100000:3.0:1788834933.358587:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788834933.358598:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd878e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:8396:x1875729253947520:12345-0@lo:253: 20000000:01000000:3.0:1788834933.358631:0:6483:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788834933.358645:0:6483:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788834933.373049:0:6483:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788834933.373066:0:6483:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1788834933.373222:0:6503:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788834933.373227:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788834933.373248:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afdc204a200/0xdf60171e5a5d191a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.373267:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd80030c00/0xdf60171e5a5d1810 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1809 expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.373274:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd81669a00/0xdf60171e5a5d182c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1825 expref: 16 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.373282:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afdc204a200/0xdf60171e5a5d191a lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834933.373753:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd878e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:8396:x1875729253947520:12345-0@lo:253: Request processed in 15155us (21865us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834933.373764:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788834933.373862:0:8396:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:8396:1875729253947520:0@lo:253: 10000000:01000000:1.0:1788834933.373877:0:8396:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1788834933.373880:0:8396:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788834933.373882:0:8396:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1788834933.373884:0:8396:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788834933.373885:0:8396:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788834933.373898:0:8396:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788834933.373899:0:8396:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788834933.373900:0:8396:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788834933.373902:0:8396:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788834933.373903:0:8396:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788834933.373905:0:8396:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788834933.373906:0:8396:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788834933.373921:0:8396:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1788834933.377726:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd81669a00/0xdf60171e5a5d182c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1825 expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.377748:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afd81669a00/0xdf60171e5a5d182c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1825 expref: 15 pid: 6482 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834933.377763:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875729253947648:0@lo:104: 00000100:00100000:3.0:1788834933.377826:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788834933.377893:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd80030c00/0xdf60171e5a5d1810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1809 expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.377901:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afd80030c00/0xdf60171e5a5d1810 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1809 expref: 15 pid: 6483 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834933.377910:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875729253947776:0@lo:104: 00000100:00100000:3.0:1788834933.377925:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb7235c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788834933.378046:0:6471:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788834933.378063:0:6471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834933.378078:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253947648 00000100:00100000:2.0:1788834933.378084:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253947648 00000100:00100000:2.0:1788834933.378116:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253947776 00000100:00100000:2.0:1788834933.378118:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253947776 00000100:00100000:2.0:1788834933.378137:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788834933.378144:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdc11fac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:6503:x1875729253947648:12345-0@lo:104: 00010000:00010000:2.0:1788834933.378156:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afd81668800/0xdf60171e5a5d1825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d182c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.378213:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788834933.378218:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdc11fac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:6503:x1875729253947648:12345-0@lo:104: Request processed in 75us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834933.378225:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788834933.378257:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788834933.378262:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82078700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:6503:x1875729253947776:12345-0@lo:104: 00010000:00010000:2.0:1788834933.378269:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afd81668000/0xdf60171e5a5d1809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1810 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.378296:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788834933.378301:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82078700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:6503:x1875729253947776:12345-0@lo:104: Request processed in 39us (238us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834933.378306:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:2.0:1788834933.378334:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788834933.378340:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd81668800/0xdf60171e5a5d1825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d182c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.378348:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd81668800 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788834933.378352:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd81668800/0xdf60171e5a5d1825 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d182c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.378360:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd81668800/0xdf60171e5a5d1825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d182c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788834933.378377:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd81668800/0xdf60171e5a5d1825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d182c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834933.378383:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788834933.378413:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd81668800/0xdf60171e5a5d1825 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d182c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.378418:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788834933.378446:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd81668800/0xdf60171e5a5d1825 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d182c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.378453:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd81668800/0xdf60171e5a5d1825 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d182c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.378466:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788834933.378469:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd81668000/0xdf60171e5a5d1809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1810 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.378474:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd81668000 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788834933.378477:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd81668000/0xdf60171e5a5d1809 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1810 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.378484:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd81668000/0xdf60171e5a5d1809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1810 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788834933.378490:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd81668000/0xdf60171e5a5d1809 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1810 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834933.378495:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788834933.378510:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd81668000/0xdf60171e5a5d1809 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1810 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.378516:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788834933.378521:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd81668000/0xdf60171e5a5d1809 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1810 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.378527:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd81668000/0xdf60171e5a5d1809 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1810 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834933.378539:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834933.378541:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834933.378542:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834933.378549:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788834933.378869:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875729253947648:0@lo:104: 00000100:00100000:3.0:1788834933.378879:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fbb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875729253947776:0@lo:104: 00010000:00010000:3.0:1788834933.378899:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afdc204a200/0xdf60171e5a5d191a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834933.378974:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82078380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253947904:0@lo:103: 00000100:00100000:0.0:1788834933.379019:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834933.379056:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788834933.379061:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253948032:0@lo:103: 00000100:00100000:0.0:1788834933.379078:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00080000:10000000:1.0:1788834933.379793:0:8396:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:1.0:1788834933.379975:0:8396:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00080000:10000000:1.0:1788834933.380753:0:8396:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:1.0:1788834933.380930:0:8396:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00000100:00100000:3.0:1788834933.381087:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253947904 00000100:00100000:3.0:1788834933.381095:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253947904 00010000:00010000:3.0:1788834933.381128:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd81669a00/0xdf60171e5a5d182c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1825 expref: 16 pid: 6482 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834933.381175:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253948032 00000100:00100000:3.0:1788834933.381179:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253948032 00010000:00010000:3.0:1788834933.381200:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd80030c00/0xdf60171e5a5d1810 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1809 expref: 17 pid: 6483 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834933.381225:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788834933.381234:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82077100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:3616:x1875729253947904:12345-0@lo:103: 00010000:00010000:3.0:1788834933.381248:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788834933.381253:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd81669a00/0xdf60171e5a5d182c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1825 expref: 17 pid: 6482 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.381264:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd81669a00/0xdf60171e5a5d182c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1825 expref: 17 pid: 6482 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.381288:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd81669a00/0xdf60171e5a5d182c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1825 expref: 17 pid: 6482 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.381304:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788834933.381386:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82077100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:3616:x1875729253947904:12345-0@lo:103: Request processed in 152us (2365us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834933.381393:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788834933.381411:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788834933.381417:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82076300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:3616:x1875729253948032:12345-0@lo:103: 00010000:00010000:3.0:1788834933.381424:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788834933.381440:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd80030c00/0xdf60171e5a5d1810 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1809 expref: 15 pid: 6483 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.381448:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd80030c00/0xdf60171e5a5d1810 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1809 expref: 15 pid: 6483 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.381458:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd80030c00/0xdf60171e5a5d1810 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1809 expref: 15 pid: 6483 timeout: 325 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.381471:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afdc204a200/0xdf60171e5a5d191a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.381479:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdc204a200/0xdf60171e5a5d191a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788834933.381495:0:6474:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.014516741s 00010000:00010000:3.0:1788834933.381500:0:6474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afdc204a200/0xdf60171e5a5d191a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.381517:0:6474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afdc204a200/0xdf60171e5a5d191a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.381524:0:6474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afdc204a200/0xdf60171e5a5d191a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.381531:0:6474:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afdc204a200/0xdf60171e5a5d191a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.381537:0:6474:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204a200 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:3.0:1788834933.381541:0:6474:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afdc204a200/0xdf60171e5a5d191a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.381550:0:6474:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afdc204a200/0xdf60171e5a5d191a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.381564:0:6474:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afdc204a200/0xdf60171e5a5d191a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.381574:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788834933.381797:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82076300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:3616:x1875729253948032:12345-0@lo:103: Request processed in 380us (2716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834933.381804:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788834933.381850:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82078e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253948032:0@lo:103: 00000100:00100000:3.0:1788834933.381861:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82078380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253947904:0@lo:103: 00010000:00010000:3.0:1788834933.381888:0:6503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afdc204a200/0xdf60171e5a5d191a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.381897:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afdc204a200/0xdf60171e5a5d191a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834933.381909:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdc204a200/0xdf60171e5a5d191a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:1.0:1788834933.382552:0:8396:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:1.0:1788834933.382883:0:8396:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:1.0:1788834933.384801:0:8396:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1788834933.408857:0:8396:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1788834933.408870:0:8396:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1788834933.408919:0:8396:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788834933.408981:0:8396:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788834933.409007:0:8396:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1788834933.409041:0:8396:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:1.0:1788834933.410047:0:8396:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788834933.410280:0:8396:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00000100:00100000:1.0:1788834933.548446:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253948160:0@lo:41: 00000100:00100000:1.0:1788834933.548520:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834933.549431:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253948160 00000100:00100000:2.0:1788834933.549443:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253948160 00000100:00100000:2.0:1788834933.549499:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788834933.549510:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253948160:12345-0@lo:41: 00000004:00000024:2.0:1788834933.549548:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446416384 avail 1300176896 00000100:00100000:2.0:1788834933.549618:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253948160:12345-0@lo:41: Request processed in 110us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834933.549627:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788834933.557427:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253948160:0@lo:41: 00010000:00010000:0.0:1788834934.246240:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788834934.351908:0:8481:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788834934.352123:0:8481:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788834935.269895:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788834936.293621:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1788834937.066721:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788834937.066729:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afdb279f000 from 30 10000000:01000000:3.0:1788834937.066733:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788834937.066772:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdc204a200/0xdf60171e5a5d1921 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834937.066784:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdc204a200/0xdf60171e5a5d1921 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834937.066794:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdc204a200/0xdf60171e5a5d1921 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834937.066815:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253948288:0@lo:101: 00000100:00100000:3.0:1788834937.066878:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834937.066930:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82e76600 going to sleep for 11 seconds 00000100:00100000:1.0:1788834937.066986:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253948288 00000100:00100000:1.0:1788834937.066993:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253948288 00000100:00100000:1.0:1788834937.067044:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788834937.067054:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd878d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:6485:x1875729253948288:12345-0@lo:101: 00010000:00010000:1.0:1788834937.067078:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788834937.067091:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdc2166600/0xdf60171e5a5d1928 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1921 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834937.067113:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdc2166600/0xdf60171e5a5d1928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1921 expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834937.067124:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdc2166600/0xdf60171e5a5d1928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1921 expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834937.067133:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc2166600, rc 0) 00000100:00100000:1.0:1788834937.067186:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd878d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:6485:x1875729253948288:12345-0@lo:101: Request processed in 133us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834937.067193:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788834937.067341:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253948288:0@lo:101: 00010000:00010000:3.0:1788834937.067355:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdc204a200/0xdf60171e5a5d1921 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1928 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834937.067364:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdc204a200/0xdf60171e5a5d1921 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1928 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834937.067417:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253948416:0@lo:501: 00000100:00100000:3.0:1788834937.067444:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834937.067472:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82e76600 going to sleep for 11 seconds 00000100:00100000:0.0:1788834937.067551:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253948416 00000100:00100000:0.0:1788834937.067556:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253948416 00000100:00100000:0.0:1788834937.067590:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788834937.067598:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:6485:x1875729253948416:12345-0@lo:501: 00000100:00100000:0.0:1788834937.067713:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:6485:x1875729253948416:12345-0@lo:501: Request processed in 116us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834937.067720:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788834937.068022:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253948416:0@lo:501: 00000100:00100000:3.0:1788834937.068049:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253948544:0@lo:503: 00000100:00100000:3.0:1788834937.068089:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834937.068119:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82e76600 going to sleep for 11 seconds 00000100:00100000:0.0:1788834937.068178:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253948544 00000100:00100000:0.0:1788834937.068182:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253948544 00000100:00100000:0.0:1788834937.068215:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788834937.068222:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:6485:x1875729253948544:12345-0@lo:503: 00000100:00100000:0.0:1788834937.068332:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:6485:x1875729253948544:12345-0@lo:503: Request processed in 91us (223us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834937.068340:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788834937.068630:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253948544:0@lo:503: 00000100:00100000:0.0:1788834937.069696:0:8598:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82074380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8598:1875729253948672:0@lo:502: 00000100:00100000:0.0:1788834937.069757:0:8598:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834937.069799:0:8598:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd90861840 going to sleep for 11 seconds 00000100:00100000:1.0:1788834937.070194:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253948672 00000100:00100000:1.0:1788834937.070200:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253948672 00000100:00100000:1.0:1788834937.070240:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788834937.070248:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:8598:x1875729253948672:12345-0@lo:502: 00000100:00100000:1.0:1788834937.070407:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:8598:x1875729253948672:12345-0@lo:502: Request processed in 159us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834937.070414:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788834937.073437:0:8598:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82074380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8598:1875729253948672:0@lo:502: 00000100:00100000:0.0:1788834937.073510:0:8598:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82074380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8598:1875729253948800:0@lo:502: 00000100:00100000:0.0:1788834937.073577:0:8598:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834937.073614:0:8598:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd90861840 going to sleep for 11 seconds 00000100:00100000:2.0:1788834937.074478:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253948800 00000100:00100000:2.0:1788834937.074488:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253948800 00000100:00100000:2.0:1788834937.074543:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788834937.074552:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:8598:x1875729253948800:12345-0@lo:502: 00000100:00100000:2.0:1788834937.074684:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:8598:x1875729253948800:12345-0@lo:502: Request processed in 131us (1105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.074692:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788834937.074776:0:8598:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82074380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8598:1875729253948800:0@lo:502: 00000040:00080000:0.0:1788834937.074805:0:8598:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788834937.075221:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788834937.075243:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788834937.075252:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdc204a200/0xdf60171e5a5d1921 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1928 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.075262:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdc204a200/0xdf60171e5a5d1921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1928 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834937.075271:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788834937.075273:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afdb279f000 from 5 10000000:01000000:2.0:1788834937.075276:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788834937.075303:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f4400/0xdf60171e5a5d192f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.075310:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd866f4400/0xdf60171e5a5d192f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.075350:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd866f4400/0xdf60171e5a5d192f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834937.075365:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253948928:0@lo:101: 00000100:00100000:2.0:1788834937.075398:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.075432:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda0a8c600 going to sleep for 11 seconds 00000100:00100000:1.0:1788834937.075477:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253948928 00000100:00100000:1.0:1788834937.075483:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253948928 00000100:00100000:1.0:1788834937.075519:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788834937.075526:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:6485:x1875729253948928:12345-0@lo:101: 00010000:00010000:1.0:1788834937.075535:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788834937.075549:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdc2166c00/0xdf60171e5a5d1936 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d192f expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834937.075582:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdc2166c00/0xdf60171e5a5d1936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d192f expref: 16 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834937.075593:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdc2166c00/0xdf60171e5a5d1936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d192f expref: 16 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834937.075601:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc2166c00, rc 0) 00000100:00100000:1.0:1788834937.075640:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253948928:12345-0@lo:101: Request processed in 114us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834937.075647:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788834937.076373:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253948928:0@lo:101: 00010000:00010000:0.0:1788834937.076387:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd866f4400/0xdf60171e5a5d192f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1936 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834937.076409:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd866f4400/0xdf60171e5a5d192f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1936 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834937.076462:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82074380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253949056:0@lo:256: 00000100:00100000:0.0:1788834937.076506:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834937.076530:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd90861840 going to sleep for 11 seconds 00000100:00100000:1.0:1788834937.076585:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253949056 00000100:00100000:1.0:1788834937.076590:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253949056 00000100:00100000:1.0:1788834937.076627:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788834937.076634:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253949056:12345-0@lo:256: 20000000:01000000:1.0:1788834937.076648:0:6481:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788834937.076664:0:6481:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788834937.076667:0:6481:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1788834937.076742:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253949056:12345-0@lo:256: Request processed in 108us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834937.076750:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788834937.077203:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82074380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253949056:0@lo:256: 10000000:01000000:0.0:1788834937.077248:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788834937.077256:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f4400/0xdf60171e5a5d192f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1936 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834937.077264:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd866f4400/0xdf60171e5a5d192f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1936 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788834937.077272:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788834937.077275:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 25 10000000:01000000:0.0:1788834937.077277:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788834937.077298:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d193d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834937.077306:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d193d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834937.077342:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d193d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834937.077355:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82074380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253949184:0@lo:101: 00000100:00100000:0.0:1788834937.077391:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834937.077415:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd90861840 going to sleep for 11 seconds 00000100:00100000:1.0:1788834937.078231:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253949184 00000100:00100000:1.0:1788834937.078238:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253949184 00000100:00100000:1.0:1788834937.078277:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788834937.078285:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253949184:12345-0@lo:101: 00010000:00010000:1.0:1788834937.078296:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788834937.078308:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdc2166800/0xdf60171e5a5d1944 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d193d expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834937.078363:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdc2166800/0xdf60171e5a5d1944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d193d expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834937.078373:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdc2166800/0xdf60171e5a5d1944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d193d expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834937.078382:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc2166800, rc 0) 00000100:00100000:1.0:1788834937.078425:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253949184:12345-0@lo:101: Request processed in 141us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834937.078431:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788834937.078470:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82074380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253949184:0@lo:101: 00010000:00010000:1.0:1788834937.078481:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d193d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1944 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834937.078490:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d193d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1944 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834937.078544:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253949312:0@lo:501: 00000100:00100000:1.0:1788834937.078570:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834937.078591:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8663ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788834937.078603:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253949312 00000100:00100000:1.0:1788834937.078606:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253949312 00000100:00100000:1.0:1788834937.078630:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788834937.078636:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253949312:12345-0@lo:501: 00000100:00100000:1.0:1788834937.078743:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253949312:12345-0@lo:501: Request processed in 106us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834937.078749:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788834937.078783:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253949312:0@lo:501: 00000100:00100000:1.0:1788834937.078808:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253949440:0@lo:503: 00000100:00100000:1.0:1788834937.078845:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834937.078859:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8663ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788834937.078869:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253949440 00000100:00100000:1.0:1788834937.078873:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253949440 00000100:00100000:1.0:1788834937.078894:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788834937.078900:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253949440:12345-0@lo:503: 00000100:00100000:1.0:1788834937.078967:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253949440:12345-0@lo:503: Request processed in 67us (121us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834937.078973:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788834937.079008:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e813480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253949440:0@lo:503: 00000100:00100000:2.0:1788834937.088547:0:8599:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82078000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8599:1875729253949568:0@lo:502: 00000100:00100000:2.0:1788834937.088629:0:8599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.088672:0:8599:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda0a8ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788834937.088726:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253949568 00000100:00100000:1.0:1788834937.088735:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253949568 00000100:00100000:1.0:1788834937.088785:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788834937.088793:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:8599:x1875729253949568:12345-0@lo:502: 00000100:00100000:1.0:1788834937.088913:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:8599:x1875729253949568:12345-0@lo:502: Request processed in 120us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834937.088921:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788834937.089232:0:8599:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82078000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8599:1875729253949568:0@lo:502: 00000020:01000000:0.0:1788834937.089262:0:8599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788834937.089270:0:8599:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:0.0:1788834937.089277:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788834937.089279:0:8599:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1788834937.089287:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788834937.089290:0:8599:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:0.0:1788834937.089311:0:8599:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:0.0:1788834937.089332:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788834937.089346:0:8599:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9afc820c8000) 00000020:00000080:0.0:1788834937.089366:0:8599:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type osp with refcount 2 00000020:00000080:0.0:1788834937.089370:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788834937.089442:0:8599:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:0.0:1788834937.089449:0:8599:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:0.0:1788834937.089457:0:8599:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdf60171e5a5d1952 00010000:00080000:0.0:1788834937.089485:0:8599:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afc820d4000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.122@tcp at head 00010000:00010000:0.0:1788834937.089694:0:8599:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788834937.111493:0:8599:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788834937.111517:0:8599:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:2.0:1788834937.111760:0:8599:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788834937.111979:0:8599:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788834937.112075:0:8599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788834937.112193:0:8599:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1788834937.117562:0:8602:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788834937.117570:0:8602:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1788834937.118153:0:8599:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788834937.118173:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788834937.118208:0:8599:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1788834937.118230:0:8599:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdf60171e5a5d1959 00000100:00080000:0.0:1788834937.118239:0:8599:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788834937.118244:0:8599:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9afc820d4000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1788834937.118274:0:8599:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afc82074e00 x1875729253949696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788834937.118332:0:8599:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1788834937.118393:0:8599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788834937.118397:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788834937.118399:0:8599:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1788834937.118403:0:8599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788834937.118407:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788834937.118408:0:8599:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788834937.118411:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788834937.118412:0:8599:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1788834937.118438:0:8599:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82077480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8599:1875729253949824:0@lo:502: 00000100:00100000:0.0:1788834937.118512:0:8599:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834937.118545:0:8599:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd88592300 going to sleep for 11 seconds 00000100:00100000:1.0:1788834937.118607:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729253949696:0@lo:8: 00000100:00100000:1.0:1788834937.118641:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834937.118717:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253949696 00000100:00100000:0.0:1788834937.118723:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253949696 00000100:00100000:0.0:1788834937.118756:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788834937.118763:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875729253949696:12345-0@lo:8: 00010000:00080000:0.0:1788834937.118784:0:8402:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1788834937.118805:0:8402:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdf60171e5a5d1960 00002000:00100000:0.0:1788834937.118832:0:8402:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9afc820d1000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:0.0:1788834937.118837:0:8402:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00000001:00000004:0.0:1788834937.118841:0:8402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1788834937.118897:0:8402:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788834937.119087:0:8402:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:0.0:1788834937.119108:0:8402:0:(import.c:65:import_set_state_nolock()) ffff9afc820d7800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788834937.119155:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e813480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3613:x1875729253949696:12345-0@lo:8: Request processed in 391us (511us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834937.119174:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788834937.119255:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc82074e00 x1875729253949696/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788834947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834937.119264:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788834937.119271:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 1 00000100:00080000:1.0:1788834937.119277:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1788834937.119287:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1788834937.119289:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc820d4000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1788834937.119306:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1788834937.119311:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729253949696:0@lo:8: 00000100:00100000:0.0:1788834937.119409:0:8603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82075c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8603:1875729253949952:0@lo:700: 00000100:00100000:0.0:1788834937.119438:0:8603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834937.119462:0:8603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77000 going to sleep for 11 seconds 00000004:00080000:0.0:1788834937.119475:0:8602:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788834937.119522:0:8602:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 179161206449ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788834937.119529:0:8602:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:2.0:1788834937.119697:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875729253950080:0@lo:400: 00000100:00100000:2.0:1788834937.119727:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.119747:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875729253950592:0@lo:400: 00000100:00100000:2.0:1788834937.119769:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.119786:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788834937.119791:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253950464:0@lo:400: 00000100:00100000:2.0:1788834937.119815:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.119840:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253950208:0@lo:400: 00000100:00100000:2.0:1788834937.119864:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.119879:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729253950720:0@lo:400: 00000100:00100000:2.0:1788834937.119902:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.119919:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788834937.119924:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729253950336:0@lo:400: 00000100:00100000:2.0:1788834937.119944:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.119966:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253950080 00000100:00100000:2.0:1788834937.119971:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253950080 00000100:00100000:2.0:1788834937.119996:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253950592 00000100:00100000:2.0:1788834937.119999:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253950592 00000100:00100000:2.0:1788834937.120017:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253950720 00000100:00100000:2.0:1788834937.120019:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253950720 00000100:00100000:2.0:1788834937.120033:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253950336 00000100:00100000:2.0:1788834937.120035:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253950336 00000100:00100000:2.0:1788834937.120046:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788834937.120052:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875729253950080:12345-0@lo:400: 00000100:00100000:2.0:1788834937.120089:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82078a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875729253950080:12345-0@lo:400: Request processed in 36us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.120106:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788834937.120119:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788834937.120125:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875729253950592:12345-0@lo:400: 00000100:00100000:2.0:1788834937.120152:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82078000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875729253950592:12345-0@lo:400: Request processed in 27us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.120157:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788834937.120180:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788834937.120186:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729253950720:12345-0@lo:400: 00000100:00100000:2.0:1788834937.120215:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82078380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729253950720:12345-0@lo:400: Request processed in 29us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.120221:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788834937.120231:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788834937.120236:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82078e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729253950336:12345-0@lo:400: 00000100:00100000:2.0:1788834937.120263:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82078e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729253950336:12345-0@lo:400: Request processed in 26us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.120270:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788834937.120288:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253950464 00000100:00100000:2.0:1788834937.120291:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253950464 00000100:00100000:2.0:1788834937.120307:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253950208 00000100:00100000:2.0:1788834937.120309:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253950208 00000100:00100000:2.0:1788834937.120345:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788834937.120351:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253950464:12345-0@lo:400: 00000100:00100000:2.0:1788834937.120382:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82079c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253950464:12345-0@lo:400: Request processed in 32us (567us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.120388:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788834937.120399:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788834937.120411:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8207b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253950208:12345-0@lo:400: 00000100:00100000:2.0:1788834937.120440:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8207b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253950208:12345-0@lo:400: Request processed in 29us (575us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.120445:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788834937.120478:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253950464:0@lo:400: 00010000:00080000:2.0:1788834937.120490:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc82079f80 x1875729253950080/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834937.120497:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875729253950080:0@lo:400: 00010000:00080000:2.0:1788834937.120505:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc8207a680 x1875729253950592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834937.120512:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875729253950592:0@lo:400: 00010000:00080000:2.0:1788834937.120536:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc82079180 x1875729253950336/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834937.120543:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729253950336:0@lo:400: 00000100:00100000:2.0:1788834937.120550:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253950208:0@lo:400: 00010000:00080000:2.0:1788834937.120558:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc82079880 x1875729253950720/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834953 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834937.120565:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729253950720:0@lo:400: 00000100:00100000:2.0:1788834937.120584:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253949824 00000100:00100000:2.0:1788834937.120588:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253949824 00000100:00100000:2.0:1788834937.120613:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788834937.120618:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:8599:x1875729253949824:12345-0@lo:502: 00000100:00100000:2.0:1788834937.120726:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:8599:x1875729253949824:12345-0@lo:502: Request processed in 106us (2213us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.120737:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788834937.120798:0:8599:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82077480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8599:1875729253949824:0@lo:502: 00000020:01000000:2.0:1788834937.120824:0:8599:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788834937.120831:0:8599:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788834937.120834:0:8599:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788834937.120838:0:8599:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 34 count 34 00000020:01000000:2.0:1788834937.120951:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 25-33 (rc=0) 10000000:01000000:2.0:1788834937.120969:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788834937.120978:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d193d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1944 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.120988:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d193d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1944 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834937.120997:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788834937.120999:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afd85554000 from 30 10000000:01000000:2.0:1788834937.121002:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788834937.121025:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1967 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.121032:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1967 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.121040:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1967 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834937.121053:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253950848:0@lo:101: 00000100:00100000:2.0:1788834937.121079:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.121103:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda0a8c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788834937.121122:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253950848 00000100:00100000:2.0:1788834937.121126:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253950848 00000100:00100000:2.0:1788834937.121146:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788834937.121152:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253950848:12345-0@lo:101: 00010000:00010000:2.0:1788834937.121170:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788834937.121181:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd866f4600/0xdf60171e5a5d196e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1967 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.121201:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd866f4600/0xdf60171e5a5d196e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1967 expref: 18 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.121210:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd866f4600/0xdf60171e5a5d196e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1967 expref: 18 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.121218:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f4600, rc 0) 00000100:00100000:2.0:1788834937.121246:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253950848:12345-0@lo:101: Request processed in 94us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.121252:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788834937.121278:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253950848:0@lo:101: 00010000:00010000:2.0:1788834937.121288:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1967 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d196e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.121296:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1967 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d196e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834937.121359:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253950976:0@lo:501: 00000100:00100000:2.0:1788834937.121381:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.121392:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda0a8c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788834937.121402:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253950976 00000100:00100000:2.0:1788834937.121411:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253950976 00000100:00100000:2.0:1788834937.121431:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788834937.121436:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253950976:12345-0@lo:501: 00000100:00100000:2.0:1788834937.121522:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253950976:12345-0@lo:501: Request processed in 85us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.121529:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788834937.121556:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253950976:0@lo:501: 00000100:00100000:2.0:1788834937.121577:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253951104:0@lo:503: 00000100:00100000:2.0:1788834937.121609:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.121622:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda0a8c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788834937.121632:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253951104 00000100:00100000:2.0:1788834937.121635:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253951104 00000100:00100000:2.0:1788834937.121650:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788834937.121655:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253951104:12345-0@lo:503: 00000100:00100000:2.0:1788834937.121717:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253951104:12345-0@lo:503: Request processed in 61us (106us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.121723:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788834937.121756:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253951104:0@lo:503: 00000100:00100000:2.0:1788834937.121917:0:8604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8604:1875729253951232:0@lo:502: 00000100:00100000:2.0:1788834937.121948:0:8604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.121964:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253951232 00000100:00100000:2.0:1788834937.121967:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253951232 00000100:00100000:2.0:1788834937.121988:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788834937.121993:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:8604:x1875729253951232:12345-0@lo:502: 00000100:00100000:2.0:1788834937.122054:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:8604:x1875729253951232:12345-0@lo:502: Request processed in 59us (105us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.122068:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788834937.122095:0:8604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda0a8c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834937.122106:0:8604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8604:1875729253951232:0@lo:502: 00000100:00100000:2.0:1788834937.122142:0:8604:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8604:1875729253951360:0@lo:502: 00000100:00100000:2.0:1788834937.122187:0:8604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.122204:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253951360 00000100:00100000:2.0:1788834937.122208:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253951360 00000100:00100000:2.0:1788834937.122227:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788834937.122233:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:8604:x1875729253951360:12345-0@lo:502: 00000100:00100000:2.0:1788834937.122285:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:8604:x1875729253951360:12345-0@lo:502: Request processed in 51us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.122291:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788834937.122339:0:8604:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda0a8c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834937.122351:0:8604:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8604:1875729253951360:0@lo:502: 00000040:00080000:2.0:1788834937.122368:0:8604:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1788834937.122407:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1788834937.122422:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788834937.122429:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1967 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d196e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.122437:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d196e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834937.122445:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788834937.122447:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afd85554000 from 5 10000000:01000000:2.0:1788834937.122449:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788834937.122465:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f4800/0xdf60171e5a5d1975 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.122478:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd866f4800/0xdf60171e5a5d1975 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.122486:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd866f4800/0xdf60171e5a5d1975 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834937.122497:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253951488:0@lo:101: 00000100:00100000:2.0:1788834937.122522:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.122534:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda0a8c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834937.122545:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253951488 00000100:00100000:2.0:1788834937.122548:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253951488 00000100:00100000:2.0:1788834937.122568:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788834937.122573:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253951488:12345-0@lo:101: 00010000:00010000:2.0:1788834937.122581:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788834937.122591:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d197c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1975 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.122607:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d197c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1975 expref: 19 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.122616:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d197c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1975 expref: 19 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.122623:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5a00, rc 0) 00000100:00100000:2.0:1788834937.122649:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:6485:x1875729253951488:12345-0@lo:101: Request processed in 75us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.122654:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1788834937.122680:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253951488:0@lo:101: 00010000:00010000:2.0:1788834937.122695:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd866f4800/0xdf60171e5a5d1975 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d197c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.122703:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd866f4800/0xdf60171e5a5d1975 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d197c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834937.122741:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253951616:0@lo:256: 00000100:00100000:2.0:1788834937.122769:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.122782:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda0a8c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834937.122793:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253951616 00000100:00100000:2.0:1788834937.122795:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253951616 00000100:00100000:2.0:1788834937.122815:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788834937.122821:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:6485:x1875729253951616:12345-0@lo:256: 20000000:01000000:2.0:1788834937.122832:0:6482:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788834937.122846:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788834937.122848:0:6482:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1788834937.122917:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:6485:x1875729253951616:12345-0@lo:256: Request processed in 95us (146us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.122923:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788834937.122951:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253951616:0@lo:256: 10000000:01000000:2.0:1788834937.122987:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788834937.122992:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f4800/0xdf60171e5a5d1975 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d197c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.122999:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd866f4800/0xdf60171e5a5d1975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d197c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834937.123005:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788834937.123012:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1788834937.123014:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788834937.123029:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f5000/0xdf60171e5a5d1983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.123036:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd866f5000/0xdf60171e5a5d1983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.123043:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd866f5000/0xdf60171e5a5d1983 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834937.123053:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253951744:0@lo:101: 00000100:00100000:2.0:1788834937.123075:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.123088:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda0a8c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834937.123098:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253951744 00000100:00100000:2.0:1788834937.123101:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253951744 00000100:00100000:2.0:1788834937.123120:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788834937.123125:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:6485:x1875729253951744:12345-0@lo:101: 00010000:00010000:2.0:1788834937.123131:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788834937.123138:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd866f4a00/0xdf60171e5a5d198a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1983 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.123151:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd866f4a00/0xdf60171e5a5d198a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1983 expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.123159:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd866f4a00/0xdf60171e5a5d198a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1983 expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834937.127511:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253949952 00000100:00100000:1.0:1788834937.127522:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253949952 00000100:00100000:1.0:1788834937.127581:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788834937.127591:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:8603:x1875729253949952:12345-0@lo:700: 00000100:00100000:1.0:1788834937.127645:0:8411:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e811880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8411:1875729253951872:0@lo:700: 00000100:00100000:1.0:1788834937.127704:0:8411:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834937.127733:0:8411:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda0feb480 going to sleep for 11 seconds 00000100:00080000:1.0:1788834937.128043:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788834937.128047:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788834937.128051:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788834937.128077:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253951872 00000100:00100000:1.0:1788834937.128081:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253951872 00000100:00100000:1.0:1788834937.128108:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788834937.128115:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8411:x1875729253951872:12345-0@lo:700: 00000100:00100000:3.0:1788834937.133767:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253952000:0@lo:41: 00000100:00100000:3.0:1788834937.133836:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788834937.133984:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f4a00, rc 0) 00000100:00100000:2.0:1788834937.134035:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:6485:x1875729253951744:12345-0@lo:101: Request processed in 10909us (10957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.134049:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1788834937.134093:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253951744:0@lo:101: 00010000:00010000:2.0:1788834937.134113:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd866f5000/0xdf60171e5a5d1983 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d198a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.134124:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd866f5000/0xdf60171e5a5d1983 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d198a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834937.134190:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253952128:0@lo:501: 00000100:00100000:2.0:1788834937.134214:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.134236:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda0a8c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834937.134250:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253952128 00000100:00100000:2.0:1788834937.134255:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253952128 00000100:00100000:2.0:1788834937.134288:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788834937.134296:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:6485:x1875729253952128:12345-0@lo:501: 00000100:00100000:2.0:1788834937.134425:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:6485:x1875729253952128:12345-0@lo:501: Request processed in 129us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.134431:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788834937.134462:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253952128:0@lo:501: 00000100:00100000:2.0:1788834937.134485:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253952256:0@lo:503: 00000100:00100000:2.0:1788834937.134523:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.134536:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda0a8c6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834937.134546:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253952256 00000100:00100000:2.0:1788834937.134549:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253952256 00000100:00100000:2.0:1788834937.134568:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788834937.134574:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:6485:x1875729253952256:12345-0@lo:503: 00000100:00100000:2.0:1788834937.134654:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:6485:x1875729253952256:12345-0@lo:503: Request processed in 79us (129us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.134661:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788834937.134697:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253952256:0@lo:503: 00000100:00100000:0.0:1788834937.134969:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253952000 00000100:00100000:0.0:1788834937.134974:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253952000 00000100:00100000:0.0:1788834937.135003:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788834937.135011:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253952000:12345-0@lo:41: 00000004:00000024:0.0:1788834937.135046:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788834937.135085:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253952000:12345-0@lo:41: Request processed in 75us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834937.135091:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788834937.136034:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253952000:0@lo:41: 00000004:00080000:1.0:1788834937.140156:0:7417:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 40000000:02000000:3.0:1788834937.151711:0:6494:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:0:ost 00000100:00100000:2.0:1788834937.161567:0:8606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8606:1875729253952384:0@lo:502: 00000100:00100000:2.0:1788834937.161658:0:8606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.161708:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253952384 00000100:00100000:2.0:1788834937.161715:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253952384 00000100:00100000:2.0:1788834937.161758:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788834937.161767:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:8606:x1875729253952384:12345-0@lo:502: 00000100:00100000:2.0:1788834937.161887:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:8606:x1875729253952384:12345-0@lo:502: Request processed in 121us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.161894:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788834937.161944:0:8606:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda0a8c900 going to sleep for 11 seconds 00000100:00100000:2.0:1788834937.161966:0:8606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8606:1875729253952384:0@lo:502: 00000020:01000000:2.0:1788834937.161995:0:8606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788834937.162003:0:8606:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:2.0:1788834937.162010:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788834937.162013:0:8606:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788834937.162017:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788834937.162021:0:8606:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:2.0:1788834937.162043:0:8606:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1788834937.162045:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788834937.162069:0:8606:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9afdbf93b370) 00000020:00000080:2.0:1788834937.162091:0:8606:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type osp with refcount 2 00000020:00000080:2.0:1788834937.162097:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788834937.162193:0:8606:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1788834937.162203:0:8606:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:2.0:1788834937.162210:0:8606:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf60171e5a5d1998 00010000:00080000:2.0:1788834937.162246:0:8606:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afdbf96a800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1788834937.162504:0:8606:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-8 is initialized 00000100:00100000:3.0:1788834937.166179:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e810380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:8411:x1875729253951872:12345-0@lo:700: Request processed in 38048us (38458us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834937.166196:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788834937.167246:0:8411:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afd9e811880 x1875729253951872/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788834953 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834937.167262:0:8411:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e811880 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:8411:1875729253951872:0@lo:700: 40000000:02000000:1.0:1788834937.167276:0:8411:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:0:ost] 00000040:01000000:2.0:1788834937.181064:0:8606:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1788834937.181085:0:8606:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1788834937.185382:0:8606:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788834937.185655:0:8606:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788834937.185747:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1788834937.185831:0:8606:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000001:00100000:3.0:1788834937.186402:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:3.0:1788834937.186516:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82074000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:8603:x1875729253949952:12345-0@lo:700: Request processed in 58922us (67072us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834937.186533:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788834937.186589:0:8603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc82075c00 x1875729253949952/t0(0) o700->lustre-OST0000-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788834953 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834937.186602:0:8603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82075c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8603:1875729253949952:0@lo:700: 00000040:00080000:0.0:1788834937.186958:0:8608:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788834937.186963:0:8608:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788834937.187731:0:8606:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788834937.187743:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788834937.187780:0:8606:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788834937.187801:0:8606:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf60171e5a5d199f 00000100:00080000:2.0:1788834937.187810:0:8606:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788834937.187815:0:8606:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9afdbf96a800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788834937.187847:0:8606:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afc82079880 x1875729253952512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788834937.187900:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729253952512:0@lo:8: 00000100:00100000:3.0:1788834937.187954:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834937.188030:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253952512 00000100:00100000:0.0:1788834937.188036:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253952512 00000100:00100000:0.0:1788834937.188063:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788834937.188069:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3613:x1875729253952512:12345-0@lo:8: 00010000:00080000:0.0:1788834937.188090:0:8405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 179 last 0 00000020:00000080:0.0:1788834937.188128:0:8405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf60171e5a5d19a6 00002000:00100000:0.0:1788834937.188140:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9afdbf90a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1788834937.188144:0:8405:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1788834937.188147:0:8405:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788834937.188218:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1788834937.188239:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9afdbf908800 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1788834937.189988:0:8606:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788834937.190092:0:8606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788834937.190099:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788834937.190101:0:8606:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788834937.190105:0:8606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788834937.190189:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788834937.190191:0:8606:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788834937.190195:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788834937.190196:0:8606:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788834937.190231:0:8606:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8606:1875729253952640:0@lo:502: 00000100:00100000:2.0:1788834937.190296:0:8606:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.190340:0:8606:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd85428540 going to sleep for 11 seconds 00000100:00100000:0.0:1788834937.193373:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3613:x1875729253952512:12345-0@lo:8: Request processed in 5292us (5408us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834937.193392:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788834937.194375:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253952640 00000100:00100000:0.0:1788834937.194385:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253952640 00000100:00100000:0.0:1788834937.194431:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1788834937.194441:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:8606:x1875729253952640:12345-0@lo:502: 00000100:00100000:0.0:1788834937.194591:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:8606:x1875729253952640:12345-0@lo:502: Request processed in 151us (4294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834937.194599:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788834937.194738:0:8606:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:8606:1875729253952640:0@lo:502: 00000020:01000000:2.0:1788834937.194772:0:8606:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788834937.194779:0:8606:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788834937.194781:0:8606:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788834937.194785:0:8606:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00010000:00080000:3.0:1788834937.195414:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc82079880 x1875729253952512/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788834947 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834937.195426:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788834937.195440:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1788834937.195448:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788834937.195453:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788834937.195457:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdbf96a800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788834937.195506:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788834937.195513:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729253952512:0@lo:8: 00000004:00080000:3.0:1788834937.198545:0:8603:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788834937.198576:0:8603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8603:1875729253952896:0@lo:7: 00000100:00100000:3.0:1788834937.198639:0:8603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834937.198686:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253952896 00000100:00100000:3.0:1788834937.198692:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253952896 00000100:00100000:3.0:1788834937.198736:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788834937.198744:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8603:x1875729253952896:12345-0@lo:7: 00000020:01000000:0.0:1788834937.199234:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1788834937.199265:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1788834937.199274:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f5000/0xdf60171e5a5d1983 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d198a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834937.199285:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd866f5000/0xdf60171e5a5d1983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d198a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788834937.199340:0:8608:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788834937.199397:0:8608:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 179241081436ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788834937.199404:0:8608:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:2.0:1788834937.199506:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253952768:0@lo:13: 00000100:00100000:2.0:1788834937.199552:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834937.200205:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253952768 00000100:00100000:0.0:1788834937.200212:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253952768 00000100:00100000:0.0:1788834937.200247:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788834937.200255:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8207aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3614:x1875729253952768:12345-0@lo:13: 00002000:00000024:0.0:1788834937.200277:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923922944 avail 3692400640 00000100:00100000:0.0:1788834937.200389:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8207aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+6:3614:x1875729253952768:12345-0@lo:13: Request processed in 98us (799us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834937.200397:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1788834937.200490:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdb90fa300 x1875729253952768/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834937.200509:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253952768:0@lo:13: 10000000:01000000:1.0:1788834937.200633:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1788834937.200637:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9afdab4bb370 from 1 10000000:01000000:1.0:1788834937.200640:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1788834937.200683:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d19ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834937.200696:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d19ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834937.200705:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d19ad lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834937.200719:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e811880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253953024:0@lo:101: 00000100:00100000:1.0:1788834937.200751:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834937.200781:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd88ed3300 going to sleep for 11 seconds 00000100:00100000:2.0:1788834937.201920:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253953024 00000100:00100000:2.0:1788834937.201929:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253953024 00000100:00100000:2.0:1788834937.201976:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788834937.201984:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:6485:x1875729253953024:12345-0@lo:101: 00010000:00010000:2.0:1788834937.201997:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788834937.202024:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e62000/0xdf60171e5a5d19b4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d19ad expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.202050:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e62000/0xdf60171e5a5d19b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d19ad expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.202061:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e62000/0xdf60171e5a5d19b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d19ad expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.202069:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e62000, rc 0) 00000100:00100000:2.0:1788834937.202385:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729253953024:12345-0@lo:101: Request processed in 400us (1632us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.202391:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788834937.203637:0:8603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82e76300 going to sleep for 11 seconds 00000100:00100000:0.0:1788834937.204056:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e811880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253953024:0@lo:101: 00010000:00010000:0.0:1788834937.204078:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d19ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d19b4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834937.204092:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d19ad lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d19b4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834937.205090:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82076a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253953152:0@lo:501: 00000100:00100000:0.0:1788834937.205307:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834937.205358:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8b5da6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834937.205527:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253953152 00000100:00100000:2.0:1788834937.205533:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253953152 00000100:00100000:2.0:1788834937.205580:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788834937.205588:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729253953152:12345-0@lo:501: 00000100:00100000:2.0:1788834937.205673:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729253953152:12345-0@lo:501: Request processed in 85us (365us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788834937.205680:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788834937.205719:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82076a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253953152:0@lo:501: 10000000:01000000:2.0:1788834937.205748:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788834937.205756:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d19ad lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d19b4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834937.205766:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d19ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d19b4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:3.0:1788834937.210707:0:8403:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788834937.210716:0:8403:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x1:0x0] 00000100:00100000:3.0:1788834937.210812:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8603:x1875729253952896:12345-0@lo:7: Request processed in 12064us (12169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834937.210823:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788834937.211432:0:8603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdb90f8700 x1875729253952896/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788834953 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834937.211450:0:8603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8603:1875729253952896:0@lo:7: 00000004:00080000:2.0:1788834937.211465:0:8603:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x1:0x0] 00000100:00100000:2.0:1788834937.211504:0:8603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8603:1875729253953280:0@lo:5: 00000100:00100000:2.0:1788834937.211543:0:8603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.211573:0:8603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd85428180 going to sleep for 11 seconds 00000100:00100000:3.0:1788834937.216355:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253953280 00000100:00100000:3.0:1788834937.216371:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253953280 00000100:00100000:3.0:1788834937.216432:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788834937.216442:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8207a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8603:x1875729253953280:12345-0@lo:5: 00002000:00080000:3.0:1788834937.216472:0:8405:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:3.0:1788834937.216552:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8207a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:8603:x1875729253953280:12345-0@lo:5: Request processed in 111us (5007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834937.216559:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000004:00080000:0.0:1788834937.218281:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00080000:0.0:1788834937.219432:0:8603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc82079180 x1875729253953280/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788834953 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834937.219448:0:8603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8603:1875729253953280:0@lo:5: 00000004:00080000:0.0:1788834937.219462:0:8603:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x1:0x0] from OST, last_created [0x280000400:0x1:0x0]last_used is [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788834937.219504:0:8603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82075180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8603:1875729253953408:0@lo:5: 00000100:00100000:0.0:1788834937.219560:0:8603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834937.219593:0:8603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8b5da3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788834937.219640:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253953408 00000100:00100000:3.0:1788834937.219647:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253953408 00000100:00100000:3.0:1788834937.219707:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788834937.219715:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:8603:x1875729253953408:12345-0@lo:5: 00002000:00080000:3.0:1788834937.219749:0:8403:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1788834937.222628:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82077800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:8603:x1875729253953408:12345-0@lo:5: Request processed in 2908us (3062us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1788834937.222641:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1788834937.222743:0:8603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc82075180 x1875729253953408/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788834953 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834937.222758:0:8603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82075180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:8603:1875729253953408:0@lo:5: 00000004:00080000:3.0:1788834937.222772:0:8603:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:3.0:1788834937.222808:0:8603:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8603:1875729253953536:0@lo:900: 00000100:00100000:3.0:1788834937.222840:0:8603:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834937.222862:0:8603:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82e76180 going to sleep for 11 seconds 00000100:00100000:1.0:1788834937.223980:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253953536 00000100:00100000:1.0:1788834937.223989:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253953536 00000100:00100000:1.0:1788834937.224038:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788834937.224047:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8603:x1875729253953536:12345-0@lo:900: 00000100:00100000:1.0:1788834937.224121:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90fb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:8603:x1875729253953536:12345-0@lo:900: Request processed in 75us (1280us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834937.224128:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788834937.224171:0:8603:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdb90f9500 x1875729253953536/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788834953 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834937.224182:0:8603:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:8603:1875729253953536:0@lo:900: 00000100:00100000:2.0:1788834937.224459:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788834937.224471:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253953664:0@lo:13: 00000100:00100000:2.0:1788834937.224510:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1788834937.224538:0:8609:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1788834937.224566:0:8609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8609:1875729253953792:0@lo:7: 00000100:00100000:2.0:1788834937.224590:0:8609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834937.224602:0:8609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd85428d80 going to sleep for 11 seconds 00000100:00100000:3.0:1788834937.224647:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253953792 00000100:00100000:3.0:1788834937.224652:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253953792 00000100:00100000:3.0:1788834937.224698:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788834937.224705:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8207b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8609:x1875729253953792:12345-0@lo:7: 00000100:00080000:2.0:1788834937.225188:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788834937.225425:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253953664 00000100:00100000:1.0:1788834937.225430:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253953664 00000100:00100000:1.0:1788834937.225469:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788834937.225477:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8207b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3614:x1875729253953664:12345-0@lo:13: 00002000:00000024:1.0:1788834937.225492:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923808256 avail 3692285952 00000100:00100000:1.0:1788834937.225541:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8207b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3614:x1875729253953664:12345-0@lo:13: Request processed in 65us (1031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834937.225557:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788834937.225770:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc82079f80 x1875729253953664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834953 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834937.225788:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253953664:0@lo:13: 00002000:00080000:2.0:1788834937.232917:0:8402:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1788834937.232927:0:8402:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1788834937.233060:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8207b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8609:x1875729253953792:12345-0@lo:7: Request processed in 8351us (8464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834937.233073:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788834937.235405:0:8609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc8207a300 x1875729253953792/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788834953 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834937.235424:0:8609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8609:1875729253953792:0@lo:7: 00000004:00080000:0.0:1788834937.235440:0:8609:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1788834937.237137:0:8609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8609:1875729253953920:0@lo:5: 00000100:00100000:3.0:1788834937.237210:0:8609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834937.237401:0:8609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb92973c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788834937.237917:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253953920 00000100:00100000:1.0:1788834937.237925:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253953920 00000100:00100000:0.0:1788834937.238510:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788834937.238521:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:8609:x1875729253953920:12345-0@lo:5: 00002000:00080000:0.0:1788834937.238549:0:8403:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1788834937.238562:0:8403:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000001:00080000:3.0:1788834937.246939:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000001:00080000:3.0:1788834937.246956:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1788834937.246965:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788834937.249203:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:8609:x1875729253953920:12345-0@lo:5: Request processed in 10676us (11984us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788834937.249216:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788834937.249482:0:8609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdb90f9500 x1875729253953920/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788834953 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834937.249495:0:8609:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1788834937.249509:0:8609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8609:1875729253953920:0@lo:5: 00000004:00080000:3.0:1788834937.249523:0:8609:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1788834937.249569:0:8609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8609:1875729253954048:0@lo:700: 00000100:00100000:3.0:1788834937.249609:0:8609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834937.249643:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253954048 00000100:00100000:3.0:1788834937.249648:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253954048 00000100:00100000:3.0:1788834937.249686:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788834937.249694:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8609:x1875729253954048:12345-0@lo:700: 00000100:00100000:3.0:1788834937.251628:0:8609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb92973c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788834937.268007:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90fa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8609:x1875729253954048:12345-0@lo:700: Request processed in 18305us (18389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834937.268022:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1788834937.268190:0:8609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdb90f9500 x1875729253954048/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788834953 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834937.268204:0:8609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8609:1875729253954048:0@lo:700: 00000004:02000040:1.0:1788834937.281818:0:8609:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x280000401 00000100:00100000:1.0:1788834937.289704:0:8609:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e811880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8609:1875729253954176:0@lo:5: 00000100:00100000:1.0:1788834937.289786:0:8609:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834937.289871:0:8609:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd88ed3c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788834937.290017:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253954176 00000100:00100000:3.0:1788834937.290025:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253954176 00000100:00100000:3.0:1788834937.290121:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788834937.290130:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8609:x1875729253954176:12345-0@lo:5: 00002000:00080000:3.0:1788834937.294415:0:8402:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788834937.294435:0:8402:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 2 00000100:00100000:3.0:1788834937.296542:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9309180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8609:x1875729253954176:12345-0@lo:5: Request processed in 6406us (6749us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1788834937.296553:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788834937.296689:0:8609:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afd9e811880 x1875729253954176/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788834953 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834937.296707:0:8609:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e811880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:8609:1875729253954176:0@lo:5: 00000004:00080000:1.0:1788834937.296721:0:8609:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x1:0x0]-[0x280000401:0x21:0x0] 00010000:00010000:2.0:1788834937.318855:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788834938.348920:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788834938.662507:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788834938.662532:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253954304:0@lo:41: 00000100:00100000:1.0:1788834938.662608:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834938.662764:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253954304 00000100:00100000:2.0:1788834938.662772:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253954304 00000100:00100000:2.0:1788834938.662824:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788834938.662834:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb930b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253954304:12345-0@lo:41: 00000004:00000024:2.0:1788834938.662867:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:2.0:1788834938.662916:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb930b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253954304:12345-0@lo:41: Request processed in 83us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834938.662923:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788834938.662967:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253954304:0@lo:41: 00010000:00010000:3.0:1788834939.366312:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834940.392460:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788834940.463911:0:8778:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788834941.413930:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788834941.499666:0:8831:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788834941.499891:0:8831:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:0.0:1788834942.248584:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253954432:0@lo:41: 00000100:00100000:0.0:1788834942.248692:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834942.248780:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253954432 00000100:00100000:1.0:1788834942.250328:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253954560:0@lo:13: 00000100:00100000:1.0:1788834942.250400:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834942.250467:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788834942.250475:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253954688:0@lo:13: 00000100:00100000:1.0:1788834942.250501:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834942.250538:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253954560 00000100:00100000:1.0:1788834942.250545:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253954560 00000100:00100000:1.0:1788834942.250603:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253954688 00000100:00100000:1.0:1788834942.250607:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253954688 00000100:00100000:1.0:1788834942.250627:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788834942.250637:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253954560:12345-0@lo:13: 00002000:00000024:1.0:1788834942.250676:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788834942.250728:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9308a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253954560:12345-0@lo:13: Request processed in 92us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834942.250736:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788834942.250756:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788834942.250763:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb930ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729253954688:12345-0@lo:13: 00002000:00000024:1.0:1788834942.250775:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788834942.250800:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb930ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729253954688:12345-0@lo:13: Request processed in 38us (298us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834942.250806:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:1.0:1788834942.250828:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788834942.250861:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdb9309880 x1875729253954688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834942.250885:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9309880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253954688:0@lo:13: 00010000:00080000:1.0:1788834942.250897:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdb930a680 x1875729253954560/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834958 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834942.251031:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253954432 00000100:00100000:0.0:1788834942.251211:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788834942.251222:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253954432:12345-0@lo:41: 00000004:00000024:0.0:1788834942.251253:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788834942.251298:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253954432:12345-0@lo:41: Request processed in 80us (2607us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834942.251306:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788834942.251366:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253954432:0@lo:41: 00000100:00100000:0.0:1788834942.251469:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253954816:0@lo:400: 00000100:00100000:0.0:1788834942.251508:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834942.251548:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729253955328:0@lo:400: 00000100:00100000:0.0:1788834942.251577:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834942.251601:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788834942.251606:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729253954944:0@lo:400: 00000100:00100000:0.0:1788834942.251629:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834942.251647:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729253955456:0@lo:400: 00000100:00100000:0.0:1788834942.251668:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834942.251710:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253955328 00000100:00100000:0.0:1788834942.251717:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253955328 00000100:00100000:0.0:1788834942.251768:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253954944 00000100:00100000:0.0:1788834942.251772:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253954944 00000100:00100000:0.0:1788834942.251784:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253955456 00000100:00100000:0.0:1788834942.251798:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253955456 00000100:00100000:0.0:1788834942.251814:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788834942.251821:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729253955328:12345-0@lo:400: 00000100:00100000:0.0:1788834942.251864:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729253955328:12345-0@lo:400: Request processed in 42us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834942.251870:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788834942.251883:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788834942.251889:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729253954944:12345-0@lo:400: 00000100:00100000:0.0:1788834942.251914:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729253954944:12345-0@lo:400: Request processed in 26us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834942.251920:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788834942.251930:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788834942.251937:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729253955456:12345-0@lo:400: 00000100:00100000:0.0:1788834942.251961:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729253955456:12345-0@lo:400: Request processed in 25us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834942.251966:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788834942.252002:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc82075c00 x1875729253954944/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834942.252013:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729253954944:0@lo:400: 00010000:00080000:0.0:1788834942.252022:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc82074380 x1875729253955456/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834942.252030:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82074380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729253955456:0@lo:400: 00010000:00080000:0.0:1788834942.252038:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc82074e00 x1875729253955328/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834942.252055:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729253955328:0@lo:400: 00000100:00100000:2.0:1788834942.253236:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253954816 00000100:00100000:2.0:1788834942.253251:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253954816 00000100:00100000:2.0:1788834942.253331:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788834942.253342:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:3616:x1875729253954816:12345-0@lo:400: 00000100:00100000:1.0:1788834942.256396:0:3614:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1788834942.256452:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253954560:0@lo:13: 00000100:00100000:1.0:1788834942.256524:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253955072:0@lo:400: 00000100:00100000:1.0:1788834942.256616:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834942.257736:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788834942.257751:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729253955200:0@lo:400: 00000100:00100000:1.0:1788834942.257811:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788834942.258020:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788834942.258027:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788834942.258046:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253955200 00000100:00100000:0.0:1788834942.258055:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253955200 00000100:00100000:2.0:1788834942.258162:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:3616:x1875729253954816:12345-0@lo:400: Request processed in 4820us (6650us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834942.258176:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788834942.258488:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788834942.258499:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729253955200:12345-0@lo:400: 00000100:00100000:0.0:1788834942.258574:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9309880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729253955200:12345-0@lo:400: Request processed in 77us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834942.258580:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788834942.258631:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253954816:0@lo:400: 00010000:00080000:0.0:1788834942.258687:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc82077480 x1875729253955200/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834958 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834942.258699:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729253955200:0@lo:400: 00000100:00100000:0.0:1788834942.258720:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253955072 00000100:00100000:0.0:1788834942.258725:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253955072 00000100:00100000:0.0:1788834942.258752:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788834942.258758:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb930a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253955072:12345-0@lo:400: 00000100:00100000:0.0:1788834942.258810:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb930a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253955072:12345-0@lo:400: Request processed in 51us (2194us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834942.258816:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788834942.258844:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253955072:0@lo:400: 00010000:00010000:2.0:1788834942.443079:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788834942.593941:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00010000:00010000:2.0:1788834943.462473:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788834943.781898:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253955584:0@lo:41: 00000100:00100000:0.0:1788834943.782076:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834943.782160:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253955584 00000100:00100000:1.0:1788834943.782172:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253955584 00000100:00100000:1.0:1788834943.782248:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788834943.782260:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253955584:12345-0@lo:41: 00000004:00000024:1.0:1788834943.782399:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788834943.782472:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253955584:12345-0@lo:41: Request processed in 213us (395us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834943.782488:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788834943.782570:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253955584:0@lo:41: 00010000:00010000:3.0:1788834944.485620:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788834944.752568:0:8932:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788834944.752811:0:8932:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788834945.509969:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788834945.770020:0:8980:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788834945.770029:0:8980:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:2.0:1788834946.535365:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788834947.366339:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253955840:0@lo:13: 00000100:00100000:3.0:1788834947.366385:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788834947.366411:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834947.366412:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253955712:0@lo:41: 00000100:00100000:3.0:1788834947.366443:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834947.366468:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788834947.366474:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253955968:0@lo:13: 00000100:00100000:3.0:1788834947.366481:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253955712 00000100:00100000:3.0:1788834947.366488:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253955712 00000100:00100000:1.0:1788834947.366495:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834947.366523:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253955840 00000100:00100000:1.0:1788834947.366527:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253955840 00000100:00100000:3.0:1788834947.366530:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788834947.366538:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729253955712:12345-0@lo:41: 00000100:00100000:1.0:1788834947.366555:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253955968 00000100:00100000:1.0:1788834947.366558:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253955968 00000100:00100000:1.0:1788834947.366570:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000004:00000024:3.0:1788834947.366571:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:1.0:1788834947.366575:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb930b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253955840:12345-0@lo:13: 00002000:00000024:1.0:1788834947.366594:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788834947.366625:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb930b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253955840:12345-0@lo:13: Request processed in 49us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834947.366627:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729253955712:12345-0@lo:41: Request processed in 90us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834947.366634:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788834947.366645:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788834947.366657:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788834947.366663:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb930a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253955968:12345-0@lo:13: 00002000:00000024:1.0:1788834947.366671:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788834947.366680:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253955712:0@lo:41: 00000100:00100000:1.0:1788834947.366695:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb930a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253955968:12345-0@lo:13: Request processed in 32us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834947.366700:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788834947.366714:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788834947.366734:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdb930bb80 x1875729253955968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834947.366744:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:1.0:1788834947.366758:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253955968:0@lo:13: 00000100:00100000:3.0:1788834947.366791:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729253956480:0@lo:400: 00000100:00100000:3.0:1788834947.366819:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834947.366840:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788834947.366846:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253956352:0@lo:400: 00000100:00100000:3.0:1788834947.366865:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834947.366889:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253956480 00000100:00100000:3.0:1788834947.366892:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253956480 00000100:00100000:3.0:1788834947.366919:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788834947.366926:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729253956480:12345-0@lo:400: 00000100:00100000:3.0:1788834947.366961:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729253956480:12345-0@lo:400: Request processed in 35us (141us total) trans 0 rc 0/0 00010000:00080000:1.0:1788834947.366962:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdb9309500 x1875729253955840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834963 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834947.366967:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788834947.366975:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253955840:0@lo:13: 00010000:00080000:3.0:1788834947.366994:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdb90f9500 x1875729253956480/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834947.367003:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729253956480:0@lo:400: 00000100:00100000:3.0:1788834947.367028:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253956096:0@lo:400: 00000100:00100000:2.0:1788834947.367051:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875729253956224:0@lo:400: 00000100:00100000:2.0:1788834947.367079:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834947.367116:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729253956736:0@lo:400: 00000100:00100000:2.0:1788834947.367136:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834947.367169:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253956352 00000100:00100000:2.0:1788834947.367172:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253956352 00000100:00100000:3.0:1788834947.367189:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834947.367194:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788834947.367199:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253956352:12345-0@lo:400: 00000100:00100000:3.0:1788834947.367210:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729253956608:0@lo:400: 00000100:00100000:3.0:1788834947.367229:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834947.367232:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253956352:12345-0@lo:400: Request processed in 33us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834947.367239:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788834947.367249:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253956224 00000100:00100000:3.0:1788834947.367252:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253956224 00000100:00100000:2.0:1788834947.367261:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253956736 00000100:00100000:2.0:1788834947.367263:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253956736 00000100:00100000:3.0:1788834947.367267:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253956608 00000100:00100000:3.0:1788834947.367269:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253956608 00000100:00100000:2.0:1788834947.367280:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788834947.367285:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8207ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875729253956224:12345-0@lo:400: 00000100:00100000:3.0:1788834947.367374:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788834947.367383:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729253956736:12345-0@lo:400: 00000100:00100000:3.0:1788834947.367418:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82079500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729253956736:12345-0@lo:400: Request processed in 37us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834947.367424:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788834947.367431:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8207ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875729253956224:12345-0@lo:400: Request processed in 146us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834947.367436:0:6489:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788834947.367437:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788834947.367443:0:6489:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788834947.367447:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788834947.367452:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729253956608:12345-0@lo:400: 00000100:00100000:2.0:1788834947.367483:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729253956608:12345-0@lo:400: Request processed in 30us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834947.367488:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1788834947.367527:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdba3e3480 x1875729253956608/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:2.0:1788834947.367527:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdb90faa00 x1875729253956224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834947.367538:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729253956608:0@lo:400: 00000100:00100000:2.0:1788834947.367538:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875729253956224:0@lo:400: 00010000:00080000:2.0:1788834947.367547:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdba3e1c00 x1875729253956736/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834963 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834947.367554:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729253956736:0@lo:400: 00000100:00100000:2.0:1788834947.367575:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253956352:0@lo:400: 00000100:00100000:0.0:1788834947.371520:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253956096 00000100:00100000:0.0:1788834947.371535:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253956096 00000100:00100000:0.0:1788834947.371608:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788834947.371619:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:3614:x1875729253956096:12345-0@lo:400: 00000100:00100000:0.0:1788834947.371717:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:3614:x1875729253956096:12345-0@lo:400: Request processed in 100us (4527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834947.371724:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:1.0:1788834947.372232:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788834947.372239:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788834947.374603:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253956096:0@lo:400: 00010000:00010000:2.0:1788834947.559519:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788834948.582482:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788834948.907943:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253956864:0@lo:41: 00000100:00100000:1.0:1788834948.908009:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834948.908080:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253956864 00000100:00100000:1.0:1788834948.908096:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253956864 00000100:00100000:1.0:1788834948.908141:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788834948.908159:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb930bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253956864:12345-0@lo:41: 00000004:00000024:1.0:1788834948.908189:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788834948.908230:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb930bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253956864:12345-0@lo:41: Request processed in 81us (221us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834948.908243:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788834948.908286:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253956864:0@lo:41: 00010000:00010000:0.0:1788834949.609935:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834950.653307:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788834951.654768:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788834952.486906:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729253956992:0@lo:400: 00000100:00100000:3.0:1788834952.486972:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834952.487047:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253956992 00000100:00100000:3.0:1788834952.487054:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253956992 00000100:00100000:3.0:1788834952.487101:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788834952.487115:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:3617:x1875729253956992:12345-0@lo:400: 00000100:00100000:3.0:1788834952.487169:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:3617:x1875729253956992:12345-0@lo:400: Request processed in 55us (197us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834952.487176:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788834952.487218:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729253956992:0@lo:400: 00000100:00100000:3.0:1788834952.487256:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729253957120:0@lo:400: 00000100:00100000:3.0:1788834952.487281:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834952.487329:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253957120 00000100:00100000:3.0:1788834952.487333:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253957120 00000100:00100000:3.0:1788834952.487359:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788834952.487366:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729253957120:12345-0@lo:400: 00000100:00100000:3.0:1788834952.487397:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729253957120:12345-0@lo:400: Request processed in 32us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834952.487403:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:3.0:1788834952.487428:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdba3e3480 x1875729253957120/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834952.487439:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729253957120:0@lo:400: 00000100:00100000:3.0:1788834952.487462:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253957248:0@lo:400: 00000100:00100000:3.0:1788834952.487484:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834952.487507:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253957248 00000100:00100000:3.0:1788834952.487510:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253957248 00000100:00100000:3.0:1788834952.487531:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788834952.487536:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253957248:12345-0@lo:400: 00000100:00100000:3.0:1788834952.487566:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253957248:12345-0@lo:400: Request processed in 30us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834952.487582:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788834952.487609:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253957248:0@lo:400: 00000100:00100000:3.0:1788834952.487637:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729253957376:0@lo:400: 00000100:00100000:3.0:1788834952.487832:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834952.487860:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253957376 00000100:00100000:3.0:1788834952.487863:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253957376 00000100:00100000:3.0:1788834952.487884:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788834952.487891:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729253957376:12345-0@lo:400: 00000100:00100000:3.0:1788834952.487924:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729253957376:12345-0@lo:400: Request processed in 33us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834952.487930:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788834952.487956:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdba3e3480 x1875729253957376/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834952.487966:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729253957376:0@lo:400: 00000100:00100000:3.0:1788834952.487993:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253957504:0@lo:400: 00000100:00100000:3.0:1788834952.488026:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834952.488045:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253957504 00000100:00100000:3.0:1788834952.488047:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253957504 00000100:00100000:3.0:1788834952.488075:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788834952.488080:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253957504:12345-0@lo:400: 00000100:00100000:3.0:1788834952.488107:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253957504:12345-0@lo:400: Request processed in 28us (81us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834952.488113:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788834952.488221:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253957504:0@lo:400: 00000100:00100000:3.0:1788834952.488249:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729253957632:0@lo:400: 00000100:00100000:3.0:1788834952.488278:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834952.488304:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253957632 00000100:00100000:3.0:1788834952.488307:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253957632 00000100:00100000:3.0:1788834952.488355:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788834952.488360:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729253957632:12345-0@lo:400: 00000100:00100000:3.0:1788834952.488393:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729253957632:12345-0@lo:400: Request processed in 32us (114us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834952.488398:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1788834952.488420:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdba3e3480 x1875729253957632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834952.488428:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729253957632:0@lo:400: 00000100:00100000:3.0:1788834952.488453:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729253957760:0@lo:400: 00000100:00100000:3.0:1788834952.488477:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834952.488496:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253957760 00000100:00100000:3.0:1788834952.488499:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253957760 00000100:00100000:3.0:1788834952.488520:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788834952.488525:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729253957760:12345-0@lo:400: 00000100:00100000:3.0:1788834952.488552:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729253957760:12345-0@lo:400: Request processed in 27us (74us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834952.488558:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788834952.488581:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdba3e3480 x1875729253957760/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834952.488590:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729253957760:0@lo:400: 00000100:00100000:3.0:1788834952.488617:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253957888:0@lo:400: 00000100:00100000:3.0:1788834952.488640:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788834952.489034:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788834952.489038:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788834952.489091:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788834952.489098:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253958016:0@lo:13: 00000100:00100000:3.0:1788834952.489191:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834952.489219:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253957888 00000100:00100000:3.0:1788834952.489224:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253957888 00000100:00100000:3.0:1788834952.489255:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788834952.489263:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253957888:12345-0@lo:400: 00000100:00100000:3.0:1788834952.489300:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253957888:12345-0@lo:400: Request processed in 38us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834952.489306:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1788834952.489354:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdba3e3480 x1875729253957888/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788834968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834952.489364:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253957888:0@lo:400: 00000100:00100000:1.0:1788834952.489468:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253958016 00000100:00100000:1.0:1788834952.489472:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253958016 00000100:00100000:1.0:1788834952.489499:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788834952.489505:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253958016:12345-0@lo:13: 00002000:00000024:1.0:1788834952.489525:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788834952.489625:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253958016:12345-0@lo:13: Request processed in 120us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834952.489632:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:1.0:1788834952.489646:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788834952.489657:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253958272:0@lo:400: 00000100:00100000:1.0:1788834952.489682:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834952.489699:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788834952.489704:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253958144:0@lo:13: 00000100:00100000:1.0:1788834952.489723:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834952.489819:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253958272 00000100:00100000:1.0:1788834952.489823:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253958272 00000100:00100000:1.0:1788834952.489847:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788834952.490003:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253958272:12345-0@lo:400: 00000100:00100000:1.0:1788834952.490041:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253958272:12345-0@lo:400: Request processed in 189us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834952.490048:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788834952.490072:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253958144 00000100:00100000:1.0:1788834952.490082:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253958144 00000100:00100000:1.0:1788834952.490101:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788834952.490106:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253958144:12345-0@lo:13: 00002000:00000024:1.0:1788834952.490129:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788834952.490156:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253958144:12345-0@lo:13: Request processed in 49us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834952.490161:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:1.0:1788834952.490174:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788834952.490193:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdb9308700 x1875729253958144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834952.490207:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9308700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253958144:0@lo:13: 00010000:00080000:1.0:1788834952.490421:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdba3e3480 x1875729253958272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788834968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834952.490429:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253958272:0@lo:400: 00000100:00100000:1.0:1788834952.490455:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253958400:0@lo:41: 00000100:00100000:1.0:1788834952.490480:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788834952.490544:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdb9309500 x1875729253958016/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834968 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834952.490565:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253958016:0@lo:13: 00000100:00100000:0.0:1788834952.490663:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253958400 00000100:00100000:0.0:1788834952.490668:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253958400 00000100:00100000:0.0:1788834952.490741:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788834952.490748:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253958400:12345-0@lo:41: 00000004:00000024:0.0:1788834952.490769:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788834952.490806:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253958400:12345-0@lo:41: Request processed in 59us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834952.490812:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1788834952.490989:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253958400:0@lo:41: 00010000:00010000:1.0:1788834952.677824:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834953.702398:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788834954.022458:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788834954.022481:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253958528:0@lo:41: 00000100:00100000:2.0:1788834954.022547:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834954.022640:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253958528 00000100:00100000:1.0:1788834954.022648:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253958528 00000100:00100000:1.0:1788834954.022692:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788834954.022701:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8207bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253958528:12345-0@lo:41: 00000004:00000024:1.0:1788834954.022748:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446371328 avail 1300131840 00000100:00100000:1.0:1788834954.022806:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8207bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253958528:12345-0@lo:41: Request processed in 105us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834954.022813:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1788834954.022888:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253958528:0@lo:41: 00010000:00010000:1.0:1788834954.726861:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788834955.470123:0:9479:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788834955.470127:0:9479:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788834955.470128:0:9479:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788834955.470264:0:9479:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9afc82611000 00000020:01000004:1.0:1788834955.470280:0:9479:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1788834955.470294:0:9479:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788834955.470307:0:9479:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9afdab4f4d28) 00000020:00000080:1.0:1788834955.471923:0:9479:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type osd-ldiskfs with refcount 2 00100000:10000000:1.0:1788834955.544398:0:9479:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1788834955.544469:0:9479:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00080000:01000000:1.0:1788834955.575846:0:9479:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788834955.577765:0:9479:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1788834955.577780:0:9479:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788834955.577792:0:9479:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdf60171e5a5d19c2 00000020:01000004:1.0:1788834955.577799:0:9479:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:1.0:1788834955.577822:0:9479:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.122@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788834955.577825:0:9479:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788834955.577831:0:9479:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1788834955.577860:0:9479:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:1.0:1788834955.577864:0:9479:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:1.0:1788834955.602829:0:9479:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:1.0:1788834955.602873:0:9479:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.122@tcp, index=0001, flags=0x20062 00000020:01000004:1.0:1788834955.602878:0:9479:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1788834955.602880:0:9479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788834955.602881:0:9479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788834955.602882:0:9479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788834955.602888:0:9479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788834955.602890:0:9479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788834955.602891:0:9479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788834955.602892:0:9479:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788834955.602894:0:9479:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788834955.602895:0:9479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788834955.602896:0:9479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788834955.602900:0:9479:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:1.0:1788834955.602902:0:9479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788834955.602904:0:9479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1788834955.602905:0:9479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788834955.602905:0:9479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788834955.602906:0:9479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788834955.602907:0:9479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788834955.602908:0:9479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1788834955.602909:0:9479:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1788834955.602910:0:9479:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1788834955.602911:0:9479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788834955.602912:0:9479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1788834955.602939:0:9479:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1788834955.602956:0:9479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253958656:0@lo:253: 00000100:00100000:1.0:1788834955.603102:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834955.603197:0:9479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd84c156c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788834955.603251:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253958656 00000100:00100000:0.0:1788834955.603261:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253958656 00000100:00100000:0.0:1788834955.603408:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788834955.603418:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:9479:x1875729253958656:12345-0@lo:253: 20000000:01000000:0.0:1788834955.603447:0:6483:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788834955.603452:0:6483:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1788834955.603457:0:6483:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1788834955.603461:0:6483:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1788834955.603910:0:6483:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788834955.604052:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 20000000:01000000:1.0:1788834955.604066:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1788834955.604082:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 128 off8544 20000000:01000000:1.0:1788834955.604087:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1788834955.604097:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 112 off8656 00000040:00080000:1.0:1788834955.604113:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8880 00000040:00080000:1.0:1788834955.604208:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 20000000:01000000:1.0:1788834955.604224:0:6483:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.122@tcp 20000000:01000000:1.0:1788834955.604227:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:1.0:1788834955.604241:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 88 off14232 20000000:01000000:1.0:1788834955.604247:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788834955.604260:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 144 off14376 20000000:01000000:1.0:1788834955.604273:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:1.0:1788834955.604289:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 152 off14528 20000000:01000000:1.0:1788834955.604296:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788834955.604309:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 136 off14664 00000040:00080000:1.0:1788834955.604355:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14888 00000040:00080000:1.0:1788834955.604427:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].34, 224 off14176 20000000:01000000:1.0:1788834955.604438:0:6483:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.122@tcp 20000000:01000000:1.0:1788834955.604440:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:1.0:1788834955.604453:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].35, 88 off14264 20000000:01000000:1.0:1788834955.604459:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf001 osc lustre-MDT0001-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1788834955.604472:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].36, 144 off14408 20000000:01000000:1.0:1788834955.604477:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0001 0xcf003 lustre-OST0001_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:1.0:1788834955.604489:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].37, 152 off14560 20000000:01000000:1.0:1788834955.604494:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0001-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788834955.604506:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].38, 136 off14696 00000040:00080000:1.0:1788834955.604521:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].39, 224 off14920 00000040:00080000:1.0:1788834955.605187:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14912 20000000:01000000:1.0:1788834955.605203:0:6483:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.122@tcp 20000000:01000000:1.0:1788834955.605205:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.122@tcp (null) (null) (null) 00000040:00080000:1.0:1788834955.605220:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 88 off15000 20000000:01000000:1.0:1788834955.605227:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1788834955.605240:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 128 off15128 20000000:01000000:1.0:1788834955.605245:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.122@tcp (null) (null) 00000040:00080000:1.0:1788834955.605259:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].42, 144 off15272 20000000:01000000:1.0:1788834955.605265:0:6483:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1788834955.605294:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].43, 128 off15400 00000040:00080000:1.0:1788834955.605311:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].44, 224 off15624 20000000:01000000:1.0:1788834955.605484:0:6483:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1788834955.605488:0:6483:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1788834955.605491:0:6483:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1788834955.605603:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:1.0:1788834955.605674:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.timeout fl=4 20000000:01000000:0.0:1788834955.606666:0:9486:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 25 1->4: lustre sys.timeout 20000000:01000000:0.0:1788834955.606702:0:9486:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 25 2->4: lustre sys.timeout 00000040:00080000:0.0:1788834955.606738:0:9486:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 40 count 40 00000040:00080000:1.0:1788834955.606941:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].40, 224 off15144 00000040:00080000:1.0:1788834955.606964:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].41, 80 off15224 00000040:00080000:1.0:1788834955.606977:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].42, 224 off15448 20000000:01000000:1.0:1788834955.607063:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1788834955.607066:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1788834955.607865:0:9487:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 5 count 5 00000040:00080000:1.0:1788834955.608171:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9104 00000040:00080000:1.0:1788834955.608197:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 80 off9184 00000040:00080000:1.0:1788834955.608214:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9408 20000000:01000000:1.0:1788834955.608225:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1788834955.608227:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788834955.608827:0:9488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 31 marker 26 1->4: lustre sys.timeout 20000000:01000000:3.0:1788834955.608851:0:9488:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 33 marker 26 2->4: lustre sys.timeout 00000040:00080000:3.0:1788834955.608867:0:9488:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 40 count 40 00000040:00080000:1.0:1788834955.609090:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 224 off15112 00000040:00080000:1.0:1788834955.609110:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 80 off15192 00000040:00080000:1.0:1788834955.609126:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 224 off15416 20000000:01000000:1.0:1788834955.609134:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1788834955.609136:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1788834955.609577:0:9489:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 27 1->4: lustre sys.timeout 20000000:01000000:3.0:1788834955.609605:0:9489:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 27 2->4: lustre sys.timeout 00000040:00080000:3.0:1788834955.609690:0:9489:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:1.0:1788834955.609824:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:1.0:1788834955.609844:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 80 off9712 00000040:00080000:1.0:1788834955.609858:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9936 20000000:01000000:1.0:1788834955.609866:0:6483:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1788834955.609868:0:6483:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1788834955.610224:0:9490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 36 marker 28 1->4: lustre sys.timeout 20000000:01000000:1.0:1788834955.610242:0:9490:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 38 marker 28 2->4: lustre sys.timeout 00000040:00080000:1.0:1788834955.610257:0:9490:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 45 count 45 00000040:00080000:0.0:1788834955.610443:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].45, 224 off15848 00000040:00080000:0.0:1788834955.610464:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].46, 80 off15928 00000040:00080000:0.0:1788834955.610478:0:6483:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].47, 224 off16152 10000000:01000000:0.0:1788834955.610493:0:6483:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1788834955.610513:0:6483:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afd80031800/0xdf60171e5a5d19c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.610530:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd866f5e00/0xdf60171e5a5d18bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d18b8 expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.610537:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd80031e00/0xdf60171e5a5d18e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d18e2 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.610545:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdc2166600/0xdf60171e5a5d1928 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1921 expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.610552:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdc2166800/0xdf60171e5a5d1944 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d193d expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.610558:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd866f4600/0xdf60171e5a5d196e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1967 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.610565:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd866f4a00/0xdf60171e5a5d198a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1983 expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.610571:0:6483:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdb2e62000/0xdf60171e5a5d19b4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d19ad expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.610578:0:6483:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afd80031800/0xdf60171e5a5d19c9 lrc: 10/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.610705:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdb2e62000/0xdf60171e5a5d19b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d19ad expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.610720:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afdb2e62000/0xdf60171e5a5d19b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d19ad expref: 21 pid: 6482 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834955.610735:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82074e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253958784:0@lo:104: 00000100:00100000:0.0:1788834955.610799:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788834955.610848:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd866f4a00/0xdf60171e5a5d198a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1983 expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.610857:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afd866f4a00/0xdf60171e5a5d198a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1983 expref: 21 pid: 6483 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834955.610865:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82075c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253958912:0@lo:104: 00000100:00100000:0.0:1788834955.610887:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788834955.610918:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd866f4600/0xdf60171e5a5d196e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1967 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.610926:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afd866f4600/0xdf60171e5a5d196e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1967 expref: 21 pid: 6481 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834955.610934:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82077480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253959040:0@lo:104: 00000100:00100000:0.0:1788834955.610953:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788834955.610977:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdc2166800/0xdf60171e5a5d1944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d193d expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.610995:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afdc2166800/0xdf60171e5a5d1944 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d193d expref: 21 pid: 6481 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834955.611015:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e816300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253959168:0@lo:104: 00000100:00100000:0.0:1788834955.611046:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788834955.611065:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdc2166600/0xdf60171e5a5d1928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1921 expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.611072:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afdc2166600/0xdf60171e5a5d1928 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1921 expref: 21 pid: 6482 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834955.611081:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e817b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253959296:0@lo:104: 00000100:00100000:0.0:1788834955.611099:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788834955.611115:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd80031e00/0xdf60171e5a5d18e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d18e2 expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.611122:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afd80031e00/0xdf60171e5a5d18e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d18e2 expref: 21 pid: 6481 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834955.611130:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253959424:0@lo:104: 00000100:00100000:0.0:1788834955.611151:0:6483:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788834955.611167:0:6483:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd866f5e00/0xdf60171e5a5d18bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d18b8 expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.611175:0:6483:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afd866f5e00/0xdf60171e5a5d18bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d18b8 expref: 21 pid: 6482 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834955.611183:0:6483:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253959552:0@lo:104: 00000100:00100000:0.0:1788834955.611200:0:6483:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8109bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788834955.611228:0:6471:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788834955.611242:0:6471:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834955.611259:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253958784 00000100:00100000:0.0:1788834955.611264:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253958784 00000100:00100000:0.0:1788834955.611294:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253958912 00000100:00100000:0.0:1788834955.611297:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253958912 00000100:00100000:0.0:1788834955.611307:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253959040 00000100:00100000:0.0:1788834955.611310:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253959040 00000100:00100000:0.0:1788834955.611346:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253959168 00000100:00100000:0.0:1788834955.611349:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253959168 00000100:00100000:0.0:1788834955.611357:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253959296 00000100:00100000:0.0:1788834955.611360:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253959296 00000100:00100000:0.0:1788834955.611367:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253959424 00000100:00100000:0.0:1788834955.611369:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253959424 00000100:00100000:0.0:1788834955.611391:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253959552 00000100:00100000:0.0:1788834955.611393:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253959552 00000100:00100000:0.0:1788834955.611407:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788834955.611414:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82074380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+9:6483:x1875729253958784:12345-0@lo:104: 00010000:00010000:0.0:1788834955.611425:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d19ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d19b4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.611475:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788834955.611481:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82074380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+9:6483:x1875729253958784:12345-0@lo:104: Request processed in 68us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834955.611488:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788834955.611504:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788834955.611510:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82076680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+8:6483:x1875729253958912:12345-0@lo:104: 00010000:00010000:0.0:1788834955.611516:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afd866f5000/0xdf60171e5a5d1983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d198a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.611548:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788834955.611553:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82076680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+8:6483:x1875729253958912:12345-0@lo:104: Request processed in 45us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834955.611570:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788834955.611582:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788834955.611588:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82075180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+7:6483:x1875729253959040:12345-0@lo:104: 00010000:00010000:0.0:1788834955.611595:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d196e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834955.611778:0:7440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788834955.611787:0:7440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e815c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+7:6483:x1875729253959168:12345-0@lo:104: 00010000:00010000:1.0:1788834955.611796:0:7440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d193d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1944 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.611834:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1788834955.611840:0:7440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e815c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+7:6483:x1875729253959168:12345-0@lo:104: Request processed in 55us (803us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834955.611854:0:7440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788834955.611867:0:7440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788834955.611873:0:7440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e814380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+6:6483:x1875729253959296:12345-0@lo:104: 00010000:00010000:1.0:1788834955.611880:0:7440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdc204a200/0xdf60171e5a5d1921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1928 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.611908:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1788834955.611912:0:7440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e814380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+6:6483:x1875729253959296:12345-0@lo:104: Request processed in 40us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834955.611918:0:7440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788834955.611929:0:7440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788834955.611934:0:7440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbc36b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+5:6483:x1875729253959424:12345-0@lo:104: 00010000:00010000:1.0:1788834955.611941:0:7440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afd866f4e00/0xdf60171e5a5d18e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d18e9 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.611965:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1788834955.611970:0:7440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbc36b450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+5:6483:x1875729253959424:12345-0@lo:104: Request processed in 37us (819us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834955.611976:0:7440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788834955.611999:0:7440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788834955.612005:0:7440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e816d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:6483:x1875729253959552:12345-0@lo:104: 00010000:00010000:1.0:1788834955.612012:0:7440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdc2166000/0xdf60171e5a5d18b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d18bf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612051:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1788834955.612056:0:7440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e816d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:6483:x1875729253959552:12345-0@lo:104: Request processed in 52us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834955.612068:0:7440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1788834955.612085:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1788834955.612090:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d19ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d19b4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612097:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61000 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:1.0:1788834955.612101:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d19ad lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d19b4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612110:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d19ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d19b4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788834955.612116:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d19ad lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d19b4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834955.612122:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788834955.612150:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d19ad lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d19b4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612156:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788834955.612171:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d19ad lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d19b4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612177:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d19ad lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d19b4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612189:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1788834955.612193:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd866f5000/0xdf60171e5a5d1983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d198a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612208:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5000 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:1.0:1788834955.612211:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f5000/0xdf60171e5a5d1983 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d198a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612217:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd866f5000/0xdf60171e5a5d1983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d198a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788834955.612223:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f5000/0xdf60171e5a5d1983 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d198a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834955.612228:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788834955.612241:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd866f5000/0xdf60171e5a5d1983 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d198a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612246:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788834955.612252:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd866f5000/0xdf60171e5a5d1983 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d198a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612257:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd866f5000/0xdf60171e5a5d1983 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d198a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612268:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1788834955.612272:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d193d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1944 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612277:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80031000 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:1.0:1788834955.612281:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d193d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1944 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612298:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d193d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1944 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788834955.612304:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d193d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1944 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834955.612310:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788834955.612343:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d193d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1944 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612349:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788834955.612365:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d193d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1944 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612372:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d193d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1944 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612382:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1788834955.612384:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdc204a200/0xdf60171e5a5d1921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1928 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612390:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204a200 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:1.0:1788834955.612393:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdc204a200/0xdf60171e5a5d1921 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1928 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612399:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdc204a200/0xdf60171e5a5d1921 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1928 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788834955.612405:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdc204a200/0xdf60171e5a5d1921 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1928 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834955.612417:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788834955.612432:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdc204a200/0xdf60171e5a5d1921 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1928 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612438:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788834955.612444:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdc204a200/0xdf60171e5a5d1921 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1928 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612451:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdc204a200/0xdf60171e5a5d1921 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1928 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612460:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788834955.612463:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd866f4e00/0xdf60171e5a5d18e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d18e9 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612468:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4e00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:1.0:1788834955.612471:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f4e00/0xdf60171e5a5d18e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d18e9 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612477:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd866f4e00/0xdf60171e5a5d18e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d18e9 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788834955.612482:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f4e00/0xdf60171e5a5d18e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d18e9 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834955.612487:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788834955.612499:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd866f4e00/0xdf60171e5a5d18e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d18e9 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612505:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788834955.612515:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd866f4e00/0xdf60171e5a5d18e2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d18e9 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612521:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd866f4e00/0xdf60171e5a5d18e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d18e9 expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612530:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788834955.612533:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdc2166000/0xdf60171e5a5d18b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d18bf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612539:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc2166000 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:1.0:1788834955.612542:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdc2166000/0xdf60171e5a5d18b8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d18bf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612549:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdc2166000/0xdf60171e5a5d18b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d18bf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788834955.612555:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdc2166000/0xdf60171e5a5d18b8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d18bf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834955.612560:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1788834955.612575:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdc2166000/0xdf60171e5a5d18b8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d18bf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612580:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788834955.612584:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdc2166000/0xdf60171e5a5d18b8 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d18bf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612589:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdc2166000/0xdf60171e5a5d18b8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d18bf expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.612600:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834955.612606:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788834955.612756:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788834955.612763:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82075180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:6483:x1875729253959040:12345-0@lo:104: Request processed in 1175us (1808us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834955.612769:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:0.0:1788834955.612804:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788834955.612809:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d196e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.612815:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5600 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:0.0:1788834955.612818:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1967 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d196e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.612825:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d196e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788834955.612831:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1967 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d196e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788834955.612837:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788834955.612852:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1967 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d196e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.612857:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788834955.612869:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1967 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d196e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.612875:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1967 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d196e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.612889:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788834955.612890:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788834955.612892:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788834955.612899:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788834955.612934:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82074e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253958784:0@lo:104: 00000100:00100000:0.0:1788834955.612943:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82075c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253958912:0@lo:104: 00000100:00100000:0.0:1788834955.612949:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82077480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253959040:0@lo:104: 00000100:00100000:0.0:1788834955.612955:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e816300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253959168:0@lo:104: 00000100:00100000:0.0:1788834955.612961:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e817b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253959296:0@lo:104: 00000100:00100000:0.0:1788834955.612968:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253959424:0@lo:104: 00000100:00100000:0.0:1788834955.612975:0:6483:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:6483:1875729253959552:0@lo:104: 00010000:00010000:1.0:1788834955.613073:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788834955.613088:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9309c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253959680:0@lo:103: 00000100:00100000:1.0:1788834955.613136:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834955.613168:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253960192:0@lo:103: 00000100:00100000:1.0:1788834955.613190:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834955.613215:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788834955.613222:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253959808:0@lo:103: 00000100:00100000:1.0:1788834955.613256:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834955.613275:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253960320:0@lo:103: 00000100:00100000:1.0:1788834955.613295:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834955.613401:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729253960064:0@lo:103: 00000100:00100000:3.0:1788834955.613430:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834955.613443:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788834955.613449:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729253959936:0@lo:103: 00000100:00100000:3.0:1788834955.613467:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834955.613476:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729253960448:0@lo:103: 00000100:00100000:3.0:1788834955.613493:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834955.613524:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253959680 00000100:00100000:3.0:1788834955.613530:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253959680 00010000:00010000:3.0:1788834955.613554:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdb2e62000/0xdf60171e5a5d19b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d19ad expref: 22 pid: 6482 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834955.613571:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253960192 00000100:00100000:3.0:1788834955.613574:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253960192 00010000:00010000:3.0:1788834955.613583:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd80031e00/0xdf60171e5a5d18e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d18e2 expref: 23 pid: 6481 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834955.613591:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253959808 00000100:00100000:3.0:1788834955.613593:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253959808 00010000:00010000:3.0:1788834955.613600:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd866f4a00/0xdf60171e5a5d198a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1983 expref: 24 pid: 6483 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.613719:0:6483:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afd80031800/0xdf60171e5a5d19c9 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834955.613737:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253960320 00000100:00100000:0.0:1788834955.613740:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253960320 00010000:00010000:0.0:1788834955.613754:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd866f5e00/0xdf60171e5a5d18bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d18b8 expref: 25 pid: 6482 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834955.613765:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253960064 00000100:00100000:0.0:1788834955.613768:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253960064 00010000:00010000:0.0:1788834955.613776:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdc2166600/0xdf60171e5a5d1928 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1921 expref: 26 pid: 6482 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834955.613798:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253959936 00000100:00100000:0.0:1788834955.613801:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253959936 00010000:00010000:0.0:1788834955.613812:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdc2166800/0xdf60171e5a5d1944 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d193d expref: 27 pid: 6481 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834955.613822:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253960448 00000100:00100000:0.0:1788834955.613824:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253960448 00010000:00010000:0.0:1788834955.613833:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd866f4600/0xdf60171e5a5d196e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1967 expref: 28 pid: 6481 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834955.613845:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788834955.613852:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83108380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+28:3614:x1875729253959680:12345-0@lo:103: 00010000:00010000:0.0:1788834955.613863:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788834955.613868:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdb2e62000/0xdf60171e5a5d19b4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d19ad expref: 28 pid: 6482 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.613877:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdb2e62000/0xdf60171e5a5d19b4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d19ad expref: 28 pid: 6482 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.613891:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e62000/0xdf60171e5a5d19b4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d19ad expref: 28 pid: 6482 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.613903:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788834955.613976:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788834955.614054:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83108e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f0122c5-c616-4176-9ca1-6fdce4068f64+27:3614:x1875729253960192:12345-0@lo:103: 00010000:00010000:1.0:1788834955.614065:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788834955.614070:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd80031e00/0xdf60171e5a5d18e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d18e2 expref: 27 pid: 6481 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614079:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd80031e00/0xdf60171e5a5d18e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d18e2 expref: 27 pid: 6481 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614089:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd80031e00/0xdf60171e5a5d18e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d18e2 expref: 27 pid: 6481 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614098:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788834955.614136:0:6473:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788834955.614144:0:6473:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:3.0:1788834955.614160:0:6474:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1788834955.614169:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1788834955.614175:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+26:3614:x1875729253959808:12345-0@lo:103: 00010000:00010000:3.0:1788834955.614182:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788834955.614186:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd866f4a00/0xdf60171e5a5d198a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1983 expref: 26 pid: 6483 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.614195:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd866f4a00/0xdf60171e5a5d198a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1983 expref: 26 pid: 6483 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.614206:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd866f4a00/0xdf60171e5a5d198a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1983 expref: 26 pid: 6483 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.614216:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788834955.614271:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83108380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+25:3614:x1875729253959680:12345-0@lo:103: Request processed in 418us (1134us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834955.614279:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788834955.614295:0:6475:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:0.0:1788834955.614302:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788834955.614307:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaae6d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3614:x1875729253960320:12345-0@lo:103: 00010000:00010000:0.0:1788834955.614338:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788834955.614342:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd866f5e00/0xdf60171e5a5d18bf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d18b8 expref: 24 pid: 6482 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.614350:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd866f5e00/0xdf60171e5a5d18bf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d18b8 expref: 24 pid: 6482 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.614360:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd866f5e00/0xdf60171e5a5d18bf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d18b8 expref: 24 pid: 6482 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.614369:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788834955.614537:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83108e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:3614:x1875729253960192:12345-0@lo:103: Request processed in 551us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834955.614544:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788834955.614557:0:7430:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788834955.614571:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788834955.614577:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:3617:x1875729253960064:12345-0@lo:103: 00010000:00010000:1.0:1788834955.614585:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788834955.614589:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdc2166600/0xdf60171e5a5d1928 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1921 expref: 22 pid: 6482 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614598:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdc2166600/0xdf60171e5a5d1928 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1921 expref: 22 pid: 6482 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614617:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdc2166600/0xdf60171e5a5d1928 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1921 expref: 22 pid: 6482 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614628:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788834955.614657:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:3617:x1875729253960064:12345-0@lo:103: Request processed in 81us (1225us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834955.614663:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788834955.614674:0:7430:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788834955.614680:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788834955.614686:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:3617:x1875729253959936:12345-0@lo:103: 00010000:00010000:1.0:1788834955.614693:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788834955.614697:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdc2166800/0xdf60171e5a5d1944 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d193d expref: 20 pid: 6481 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614705:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdc2166800/0xdf60171e5a5d1944 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d193d expref: 20 pid: 6481 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614715:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdc2166800/0xdf60171e5a5d1944 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d193d expref: 20 pid: 6481 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614723:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788834955.614753:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:3617:x1875729253959936:12345-0@lo:103: Request processed in 67us (1285us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834955.614759:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788834955.614769:0:7430:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:1.0:1788834955.614775:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788834955.614780:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:3617:x1875729253960448:12345-0@lo:103: 00010000:00010000:1.0:1788834955.614787:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788834955.614791:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd866f4600/0xdf60171e5a5d196e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1967 expref: 18 pid: 6481 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614799:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd866f4600/0xdf60171e5a5d196e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1967 expref: 18 pid: 6481 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614808:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd866f4600/0xdf60171e5a5d196e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1967 expref: 18 pid: 6481 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614819:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afd80031800/0xdf60171e5a5d19c9 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614828:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd80031800/0xdf60171e5a5d19c9 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614840:0:7430:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afd80031800/0xdf60171e5a5d19c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614847:0:7430:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afd80031800/0xdf60171e5a5d19c9 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614853:0:7430:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afd80031800/0xdf60171e5a5d19c9 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614860:0:7430:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afd80031800/0xdf60171e5a5d19c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614873:0:7430:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80031800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:1.0:1788834955.614878:0:7430:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afd80031800/0xdf60171e5a5d19c9 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614885:0:7430:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afd80031800/0xdf60171e5a5d19c9 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614894:0:7430:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afd80031800/0xdf60171e5a5d19c9 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.614905:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788834955.614929:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:3617:x1875729253960448:12345-0@lo:103: Request processed in 148us (1435us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834955.614935:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788834955.615129:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729253959936:0@lo:103: 00000100:00100000:2.0:1788834955.615139:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729253960448:0@lo:103: 00000100:00100000:2.0:1788834955.615147:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729253960064:0@lo:103: 00000100:00100000:3.0:1788834955.615247:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:3614:x1875729253959808:12345-0@lo:103: Request processed in 1071us (1989us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834955.615260:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:1.0:1788834955.615557:0:6483:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afd80031800/0xdf60171e5a5d19c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.615567:0:6483:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afd80031800/0xdf60171e5a5d19c9 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.615573:0:6483:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd80031800/0xdf60171e5a5d19c9 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788834955.615586:0:6483:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1788834955.616657:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253959808:0@lo:103: 00000100:00100000:0.0:1788834955.616802:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaae6d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:3614:x1875729253960320:12345-0@lo:103: Request processed in 2492us (3503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834955.616811:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788834955.618111:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:9479:x1875729253958656:12345-0@lo:253: Request processed in 14690us (15004us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834955.618121:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1788834955.618202:0:9479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253958656:0@lo:253: 10000000:01000000:0.0:1788834955.618215:0:9479:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788834955.618218:0:9479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788834955.618220:0:9479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788834955.618222:0:9479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788834955.618223:0:9479:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1788834955.618224:0:9479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788834955.618225:0:9479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788834955.618227:0:9479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788834955.618228:0:9479:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1788834955.618230:0:9479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788834955.618231:0:9479:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1788834955.618251:0:9479:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9afc82611000 from lustre-OST0001 10000000:01000000:0.0:1788834955.618279:0:9479:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1788834955.618282:0:9479:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1788834955.618292:0:9479:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9afdab4bb370 local copy 10000000:01000000:0.0:1788834955.618296:0:9479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788834955.618366:0:9479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80030a00/0xdf60171e5a5d19d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.618387:0:9479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.122@tcp lock: ffff9afd80030a00/0xdf60171e5a5d19d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.618397:0:9479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd80030a00/0xdf60171e5a5d19d0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834955.618415:0:9479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253960576:0@lo:101: 00000100:00100000:0.0:1788834955.618451:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834955.618478:0:9479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8109b3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834955.618532:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253960576 00000100:00100000:2.0:1788834955.618538:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253960576 00000100:00100000:2.0:1788834955.618578:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788834955.618587:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:9479:x1875729253960576:12345-0@lo:101: 00010000:00010000:2.0:1788834955.618600:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788834955.618672:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e62e00/0xdf60171e5a5d19d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d19d0 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834955.618695:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e62e00/0xdf60171e5a5d19d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d19d0 expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834955.618712:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e62e00/0xdf60171e5a5d19d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d19d0 expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834955.618720:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e62e00, rc 0) 00000100:00100000:2.0:1788834955.618756:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:9479:x1875729253960576:12345-0@lo:101: Request processed in 170us (305us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834955.618762:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:1.0:1788834955.618852:0:9479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253960576:0@lo:101: 00010000:00010000:1.0:1788834955.618864:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd80030a00/0xdf60171e5a5d19d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xdf60171e5a5d19d7 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.618880:0:9479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd80030a00/0xdf60171e5a5d19d0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdf60171e5a5d19d7 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834955.618961:0:9479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253960704:0@lo:501: 00000100:00100000:1.0:1788834955.619060:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834955.619080:0:9479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd84c156c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834955.619123:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253960704 00000100:00100000:2.0:1788834955.619128:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253960704 00000100:00100000:2.0:1788834955.619154:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1788834955.619183:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:9479:x1875729253960704:12345-0@lo:501: 00000100:00100000:2.0:1788834955.619247:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:9479:x1875729253960704:12345-0@lo:501: Request processed in 65us (186us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788834955.619254:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:1.0:1788834955.619423:0:9479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253960704:0@lo:501: 10000000:01000000:1.0:1788834955.619435:0:9479:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1788834955.619452:0:9479:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1788834955.619457:0:9479:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80030a00/0xdf60171e5a5d19d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xdf60171e5a5d19d7 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.619465:0:9479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80030a00/0xdf60171e5a5d19d0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdf60171e5a5d19d7 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.619472:0:9479:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9afd80030a00/0xdf60171e5a5d19d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xdf60171e5a5d19d7 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.619494:0:9479:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788834955.619517:0:9479:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9afc82611000 10000000:01000000:1.0:1788834955.619522:0:9479:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1788834955.619526:0:9479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1788834955.619529:0:9479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1788834955.619533:0:9479:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:1.0:1788834955.619535:0:9479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:1.0:1788834955.619550:0:9479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61a00/0xdf60171e5a5d19de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.619569:0:9479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61a00/0xdf60171e5a5d19de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.619577:0:9479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61a00/0xdf60171e5a5d19de lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834955.619588:0:9479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253960832:0@lo:101: 00010000:00010000:0.0:1788834955.619677:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788834955.619684:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd80030a00/0xdf60171e5a5d19d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdf60171e5a5d19d7 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.619691:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80030a00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:0.0:1788834955.619695:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd80030a00/0xdf60171e5a5d19d0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xdf60171e5a5d19d7 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.619703:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd80030a00/0xdf60171e5a5d19d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xdf60171e5a5d19d7 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788834955.619711:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd80030a00/0xdf60171e5a5d19d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xdf60171e5a5d19d7 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788834955.619716:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1788834955.619734:0:6476:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd80030a00/0xdf60171e5a5d19d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf60171e5a5d19d7 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.619739:0:6476:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788834955.619755:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd80030a00/0xdf60171e5a5d19d0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf60171e5a5d19d7 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.619768:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd80030a00/0xdf60171e5a5d19d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xdf60171e5a5d19d7 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.619780:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788834955.619782:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788834955.619784:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788834955.619792:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788834955.619804:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253960960:0@lo:103: 00000100:00100000:0.0:1788834955.619834:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834955.619868:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253960960 00000100:00100000:0.0:1788834955.619872:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253960960 00000100:00100000:0.0:1788834955.619904:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788834955.619911:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:3616:x1875729253960960:12345-0@lo:103: 00010000:00010000:0.0:1788834955.619921:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788834955.619933:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e62e00/0xdf60171e5a5d19d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d19d0 expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.619947:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788834955.619974:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:3616:x1875729253960960:12345-0@lo:103: Request processed in 63us (139us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834955.619980:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788834955.620086:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253960960:0@lo:103: 00000100:00100000:1.0:1788834955.620126:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834955.620147:0:9479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd84c150c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788834955.620187:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253960832 00000100:00100000:0.0:1788834955.620191:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253960832 00000100:00100000:0.0:1788834955.620220:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1788834955.620226:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:9479:x1875729253960832:12345-0@lo:101: 00010000:00010000:0.0:1788834955.620243:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788834955.620255:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d19e5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d19de expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.620271:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d19e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d19de expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.620281:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d19e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d19de expref: 15 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.620287:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd80031c00, rc 0) 00000100:00100000:0.0:1788834955.620338:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:9479:x1875729253960832:12345-0@lo:101: Request processed in 112us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834955.620344:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788834955.620419:0:9479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253960832:0@lo:101: 00010000:00010000:1.0:1788834955.620429:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61a00/0xdf60171e5a5d19de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d19e5 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.620437:0:9479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61a00/0xdf60171e5a5d19de lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d19e5 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834955.620492:0:9479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253961088:0@lo:501: 00000100:00100000:1.0:1788834955.620517:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834955.620541:0:9479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd84c150c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788834955.620555:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253961088 00000100:00100000:1.0:1788834955.620558:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253961088 00000100:00100000:1.0:1788834955.620579:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788834955.620586:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:9479:x1875729253961088:12345-0@lo:501: 00000100:00100000:3.0:1788834955.620841:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253960320:0@lo:103: 00000100:00100000:3.0:1788834955.620854:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9309c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253959680:0@lo:103: 00000100:00100000:3.0:1788834955.620863:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253960192:0@lo:103: 00000100:00100000:1.0:1788834955.621109:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:9479:x1875729253961088:12345-0@lo:501: Request processed in 522us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834955.621116:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788834955.621173:0:9479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253961088:0@lo:501: 00000100:00100000:2.0:1788834955.621201:0:9479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253961216:0@lo:503: 00000100:00100000:2.0:1788834955.621241:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834955.621262:0:9479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82aacd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788834955.621349:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253961216 00000100:00100000:0.0:1788834955.621354:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253961216 00000100:00100000:0.0:1788834955.621384:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1788834955.621391:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:9479:x1875729253961216:12345-0@lo:503: 00000100:00100000:0.0:1788834955.621475:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:9479:x1875729253961216:12345-0@lo:503: Request processed in 84us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834955.621482:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788834955.621687:0:9479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253961216:0@lo:503: 00000040:00080000:3.0:1788834955.621932:0:9479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788834955.622205:0:9479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253961344:0@lo:502: 00000100:00100000:3.0:1788834955.622248:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834955.622310:0:9479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd93e3ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788834955.622434:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253961344 00000100:00100000:1.0:1788834955.622440:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253961344 00000100:00100000:1.0:1788834955.622500:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788834955.622508:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:9479:x1875729253961344:12345-0@lo:502: 00000100:00100000:1.0:1788834955.622604:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:9479:x1875729253961344:12345-0@lo:502: Request processed in 97us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834955.622698:0:9479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253961344:0@lo:502: 00000040:00080000:3.0:1788834955.622896:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1788834955.622922:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1788834955.622939:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1788834955.622952:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1788834955.622965:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1788834955.622976:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1788834955.623007:0:9479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253961472:0@lo:502: 00000100:00100000:3.0:1788834955.623052:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834955.623075:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788834955.623213:0:9479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd93e3ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1788834955.623266:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253961472 00000100:00100000:1.0:1788834955.623271:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253961472 00000100:00100000:1.0:1788834955.623291:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788834955.623297:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:9479:x1875729253961472:12345-0@lo:502: 00000100:00100000:1.0:1788834955.623403:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:9479:x1875729253961472:12345-0@lo:502: Request processed in 105us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834955.623409:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788834955.623491:0:9479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253961472:0@lo:502: 00000040:00080000:3.0:1788834955.623531:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1788834955.623539:0:9479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 7 count 8 00000020:01000000:3.0:1788834955.624129:0:9492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788834955.624142:0:9492:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:3.0:1788834955.624148:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788834955.624151:0:9492:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1788834955.624156:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788834955.624170:0:9492:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9afc82373370) 00000020:00000080:3.0:1788834955.624194:0:9492:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type obdfilter with refcount 2 00000020:00000080:3.0:1788834955.624200:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788834955.624279:0:9492:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afc82611000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1788834955.624287:0:9492:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788834955.624295:0:9492:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdf60171e5a5d19f3 00010000:00010000:3.0:1788834955.630145:0:9492:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:02000400:3.0:1788834955.630599:0:9492:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1788834955.634053:0:9492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1788834955.634563:0:9492:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1788834955.639817:0:9492:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00000001:00000400:3.0:1788834955.640115:0:9492:0:(osd_compat.c:1353:osd_object_spec_find()) UNKNOWN COMPAT FID [0x200000001:0x101e:0x0] 00080000:10000000:2.0:1788834955.646247:0:9492:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x2:0x0] (8/32) registered 00000020:00000080:2.0:1788834955.648597:0:9492:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788834955.648703:0:9492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788834955.648712:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788834955.648714:0:9492:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788834955.648717:0:9492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788834955.648721:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788834955.648723:0:9492:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788834955.648725:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788834955.648734:0:9492:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788834955.648759:0:9492:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788834955.648762:0:9492:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788834955.648763:0:9492:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788834955.648766:0:9492:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1788834955.648930:0:9479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1788834955.648958:0:9479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1788834955.649085:0:9479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61a00/0xdf60171e5a5d19de lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d19e5 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.649097:0:9479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61a00/0xdf60171e5a5d19de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d19e5 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788834955.649106:0:9479:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afc82611000 from 1 10000000:01000000:3.0:1788834955.649109:0:9479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788834955.649144:0:9479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdc204bc00/0xdf60171e5a5d19fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.649153:0:9479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdc204bc00/0xdf60171e5a5d19fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.649175:0:9479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdc204bc00/0xdf60171e5a5d19fa lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834955.649197:0:9479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253961600:0@lo:101: 00000100:00100000:3.0:1788834955.649263:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834955.649308:0:9479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd852343c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834955.649390:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253961600 00000100:00100000:2.0:1788834955.649397:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253961600 00000100:00100000:2.0:1788834955.649443:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788834955.649453:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:9479:x1875729253961600:12345-0@lo:101: 00010000:00010000:2.0:1788834955.649467:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788834955.649479:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e63600/0xdf60171e5a5d1a01 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d19fa expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834955.649501:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e63600/0xdf60171e5a5d1a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d19fa expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834955.649511:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e63600/0xdf60171e5a5d1a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d19fa expref: 16 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834955.649519:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e63600, rc 0) 00000100:00100000:2.0:1788834955.649557:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:9479:x1875729253961600:12345-0@lo:101: Request processed in 105us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834955.649563:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788834955.651227:0:9479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253961600:0@lo:101: 00010000:00010000:3.0:1788834955.651251:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdc204bc00/0xdf60171e5a5d19fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a01 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.651263:0:9479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdc204bc00/0xdf60171e5a5d19fa lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1a01 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834955.651715:0:9479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253961728:0@lo:501: 00000100:00100000:3.0:1788834955.652165:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834955.652202:0:9479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd852343c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788834955.652446:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253961728 00000100:00100000:1.0:1788834955.652454:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253961728 00000100:00100000:1.0:1788834955.653632:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788834955.653648:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:9479:x1875729253961728:12345-0@lo:501: 00000100:00100000:1.0:1788834955.653797:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:9479:x1875729253961728:12345-0@lo:501: Request processed in 155us (1633us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834955.653805:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788834955.654027:0:9479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253961728:0@lo:501: 00000100:00100000:3.0:1788834955.654077:0:9479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253961856:0@lo:503: 00000100:00100000:3.0:1788834955.654123:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834955.654493:0:9479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd852343c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834955.657200:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253961856 00000100:00100000:2.0:1788834955.657213:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253961856 00000100:00100000:2.0:1788834955.657261:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788834955.657270:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:9479:x1875729253961856:12345-0@lo:503: 00000100:00100000:2.0:1788834955.657448:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:9479:x1875729253961856:12345-0@lo:503: Request processed in 178us (3323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834955.657456:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788834955.657827:0:9479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253961856:0@lo:503: 00000040:00080000:3.0:1788834955.658175:0:9479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788834955.658270:0:9479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253961984:0@lo:502: 00000100:00100000:3.0:1788834955.658347:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834955.658381:0:9479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd85ecba80 going to sleep for 11 seconds 00000100:00100000:2.0:1788834955.658774:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253961984 00000100:00100000:2.0:1788834955.658780:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253961984 00000100:00100000:2.0:1788834955.658808:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788834955.658816:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:9479:x1875729253961984:12345-0@lo:502: 00000100:00100000:2.0:1788834955.658922:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:9479:x1875729253961984:12345-0@lo:502: Request processed in 105us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834955.658930:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1788834955.659639:0:9479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e0380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253961984:0@lo:502: 00000040:00080000:2.0:1788834955.659867:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1788834955.659896:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1788834955.659924:0:9479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253962112:0@lo:502: 00000100:00100000:2.0:1788834955.659971:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834955.660161:0:9479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82aac300 going to sleep for 11 seconds 00000100:00100000:2.0:1788834955.660186:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253962112 00000100:00100000:2.0:1788834955.660190:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253962112 00000100:00100000:2.0:1788834955.660219:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788834955.660225:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:9479:x1875729253962112:12345-0@lo:502: 00000100:00100000:2.0:1788834955.660414:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:9479:x1875729253962112:12345-0@lo:502: Request processed in 187us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834955.660422:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1788834955.660461:0:9479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253962112:0@lo:502: 00000040:00080000:2.0:1788834955.660502:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1788834955.660511:0:9479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1788834955.661841:0:9496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788834955.661852:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788834955.661855:0:9496:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788834955.661862:0:9496:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afc82611000 00000020:00000080:1.0:1788834955.661864:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788834955.661876:0:9496:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788834955.661879:0:9496:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788834955.661881:0:9496:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1788834955.661890:0:9496:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1788834955.662094:0:9479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1788834955.662119:0:9479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788834955.662141:0:9479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdc204bc00/0xdf60171e5a5d19fa lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a01 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834955.662164:0:9479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdc204bc00/0xdf60171e5a5d19fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a01 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834955.662213:0:9479:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788834955.662217:0:9479:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9afc82611000 10000000:01000000:2.0:1788834955.662220:0:9479:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9afc82611000 10000000:01000000:2.0:1788834955.662224:0:9479:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788834955.662229:0:9479:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afc82611000 from 1 10000000:01000000:2.0:1788834955.662232:0:9479:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788834955.662264:0:9479:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63000/0xdf60171e5a5d1a08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834955.662271:0:9479:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63000/0xdf60171e5a5d1a08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834955.662281:0:9479:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63000/0xdf60171e5a5d1a08 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834955.662297:0:9479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253962240:0@lo:101: 00000100:00100000:2.0:1788834955.662721:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834955.662757:0:9479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82aacf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788834955.662779:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253962240 00000100:00100000:2.0:1788834955.662785:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253962240 00000100:00100000:2.0:1788834955.662820:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788834955.662828:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:9479:x1875729253962240:12345-0@lo:101: 00010000:00010000:2.0:1788834955.662841:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788834955.662853:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e63c00/0xdf60171e5a5d1a0f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1a08 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834955.662886:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e63c00/0xdf60171e5a5d1a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1a08 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834955.662896:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e63c00/0xdf60171e5a5d1a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1a08 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834955.662905:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e63c00, rc 0) 00000100:00100000:2.0:1788834955.662938:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:9479:x1875729253962240:12345-0@lo:101: Request processed in 111us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834955.662945:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1788834955.663442:0:9479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253962240:0@lo:101: 00010000:00010000:2.0:1788834955.663458:0:9479:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63000/0xdf60171e5a5d1a08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a0f expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834955.663467:0:9479:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63000/0xdf60171e5a5d1a08 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1a0f expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834955.663553:0:9479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253962368:0@lo:501: 00000100:00100000:2.0:1788834955.663584:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834955.663606:0:9479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82aacf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788834955.663705:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253962368 00000100:00100000:0.0:1788834955.663710:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253962368 00000100:00100000:1.0:1788834955.663799:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788834955.663806:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:9479:x1875729253962368:12345-0@lo:501: 00000100:00100000:1.0:1788834955.663885:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:9479:x1875729253962368:12345-0@lo:501: Request processed in 80us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834955.663892:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1788834955.664433:0:9479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253962368:0@lo:501: 00000100:00100000:2.0:1788834955.664462:0:9479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253962496:0@lo:503: 00000100:00100000:2.0:1788834955.664510:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834955.664534:0:9479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82aacf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788834955.664552:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253962496 00000100:00100000:2.0:1788834955.664556:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253962496 00000100:00100000:2.0:1788834955.664586:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788834955.664593:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:9479:x1875729253962496:12345-0@lo:503: 00000100:00100000:2.0:1788834955.665115:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:9479:x1875729253962496:12345-0@lo:503: Request processed in 521us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834955.665122:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1788834955.665896:0:9479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253962496:0@lo:503: 00000040:00080000:0.0:1788834955.666155:0:9479:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788834955.666239:0:9479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253962624:0@lo:502: 00000100:00100000:0.0:1788834955.666296:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834955.666516:0:9479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8109bcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788834955.666586:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253962624 00000100:00100000:3.0:1788834955.666592:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253962624 00000100:00100000:3.0:1788834955.666743:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788834955.666753:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:9479:x1875729253962624:12345-0@lo:502: 00000100:00100000:3.0:1788834955.666866:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:9479:x1875729253962624:12345-0@lo:502: Request processed in 115us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834955.666874:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788834955.667000:0:9479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253962624:0@lo:502: 00000040:00080000:2.0:1788834955.667191:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:2.0:1788834955.667219:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1788834955.667232:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1788834955.667245:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1788834955.667257:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1788834955.667271:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1788834955.667283:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1788834955.667294:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1788834955.667305:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1788834955.667373:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1788834955.667388:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1788834955.667402:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1788834955.667416:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1788834955.667429:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1788834955.667441:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1788834955.667454:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1788834955.667466:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:2.0:1788834955.667490:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1788834955.667502:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1788834955.667512:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1788834955.667523:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1788834955.667536:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1788834955.667547:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1788834955.667559:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1788834955.667572:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 160 off12472 00000040:00080000:2.0:1788834955.667596:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12696 00000040:00080000:2.0:1788834955.667621:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12920 00000040:00080000:2.0:1788834955.667637:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off13000 00000040:00080000:2.0:1788834955.667650:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13224 00000040:00080000:2.0:1788834955.667661:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13448 00000040:00080000:2.0:1788834955.667671:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13536 00000040:00080000:2.0:1788834955.667682:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13664 00000040:00080000:2.0:1788834955.667692:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13808 00000040:00080000:2.0:1788834955.667712:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13936 00000040:00080000:2.0:1788834955.667723:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14160 00000040:00080000:2.0:1788834955.667733:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14384 00000040:00080000:2.0:1788834955.667743:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14464 00000040:00080000:2.0:1788834955.667754:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14688 00000040:00080000:2.0:1788834955.667763:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].39, 224 off14912 00000040:00080000:2.0:1788834955.667773:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].40, 88 off15000 00000040:00080000:2.0:1788834955.667783:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].41, 128 off15128 00000040:00080000:2.0:1788834955.667793:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].42, 144 off15272 00000040:00080000:2.0:1788834955.667803:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 128 off15400 00000040:00080000:2.0:1788834955.667813:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 224 off15624 00000040:00080000:2.0:1788834955.667823:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15848 00000040:00080000:2.0:1788834955.667833:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].46, 80 off15928 00000100:00100000:2.0:1788834955.667854:0:9479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253962752:0@lo:502: 00000100:00100000:2.0:1788834955.667897:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834955.668254:0:9479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd93e3ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1788834955.668341:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253962752 00000100:00100000:0.0:1788834955.668346:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253962752 00000100:00100000:0.0:1788834955.668375:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1788834955.668382:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:9479:x1875729253962752:12345-0@lo:502: 00000100:00100000:0.0:1788834955.668479:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:9479:x1875729253962752:12345-0@lo:502: Request processed in 96us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834955.668485:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788834955.668672:0:9479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253962752:0@lo:502: 00000040:00080000:2.0:1788834955.668716:0:9479:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].47, 224 off16152 00000040:00080000:2.0:1788834955.668724:0:9479:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 47 count 48 00000020:01000004:2.0:1788834955.669299:0:9497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788834955.669311:0:9497:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9afdbf938000) 00000020:00000080:2.0:1788834955.669522:0:9497:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type lwp with refcount 2 00000020:01000004:2.0:1788834955.669593:0:9497:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afc82611000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788834955.669604:0:9497:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afc82611000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788834955.669678:0:9497:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afc82611000 3 00010000:00080000:2.0:1788834955.669708:0:9497:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afc82607800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1788834955.674303:0:9497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-9 is initialized 00000020:00000080:2.0:1788834955.674875:0:9497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1788834955.674922:0:9497:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788834955.674936:0:9497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdf60171e5a5d1a1d 00000100:00080000:2.0:1788834955.674956:0:9497:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788834955.674961:0:9497:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9afc82607800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788834955.675008:0:9497:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afc82079180 x1875729253962880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788834955.675046:0:9497:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788834955.675192:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875729253962880:0@lo:38: 00000100:00100000:0.0:1788834955.675257:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834955.675715:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253962880 00000100:00100000:2.0:1788834955.675722:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253962880 00000100:00100000:2.0:1788834955.675755:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788834955.675762:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875729253962880:12345-0@lo:38: 00010000:00080000:2.0:1788834955.675784:0:6488:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:2.0:1788834955.675813:0:6488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdf60171e5a5d1a24 00000004:00100000:2.0:1788834955.675828:0:6488:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788834955.675858:0:6488:0:(import.c:65:import_set_state_nolock()) ffff9afc82601800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788834955.675909:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1875729253962880:12345-0@lo:38: Request processed in 146us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834955.675917:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1788834955.676004:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc82079180 x1875729253962880/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788834965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834955.676014:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788834955.676021:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788834955.676027:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788834955.676030:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788834955.676032:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc82607800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788834955.676047:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875729253962880:0@lo:38: 00000100:00100000:3.0:1788834955.676359:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729253963264:0@lo:400: 00000100:00100000:3.0:1788834955.676404:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834955.676581:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253963776:0@lo:400: 00000100:00100000:3.0:1788834955.676666:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834955.676688:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788834955.676694:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253963392:0@lo:400: 00000100:00100000:3.0:1788834955.676718:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834955.676734:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253963904:0@lo:400: 00000100:00100000:3.0:1788834955.676754:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834955.676780:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253963264 00000100:00100000:3.0:1788834955.676785:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253963264 00000100:00100000:3.0:1788834955.676818:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788834955.676825:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729253963264:12345-0@lo:400: 00000100:00100000:3.0:1788834955.676861:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729253963264:12345-0@lo:400: Request processed in 36us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834955.676867:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788834955.676885:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253963776 00000100:00100000:3.0:1788834955.676888:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253963776 00000100:00100000:3.0:1788834955.676915:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253963904 00000100:00100000:3.0:1788834955.676918:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253963904 00000100:00100000:3.0:1788834955.677064:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788834955.677072:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253963776:12345-0@lo:400: 00000100:00100000:3.0:1788834955.677107:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253963776:12345-0@lo:400: Request processed in 36us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834955.677113:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788834955.677124:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788834955.677130:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253963904:12345-0@lo:400: 00000100:00100000:3.0:1788834955.677154:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253963904:12345-0@lo:400: Request processed in 25us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834955.677159:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788834955.677187:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdb90f9500 x1875729253963904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788834971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834955.677199:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253963904:0@lo:400: 00010000:00080000:3.0:1788834955.677209:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdba3e3480 x1875729253963264/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834955.677218:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729253963264:0@lo:400: 00010000:00080000:3.0:1788834955.677227:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdb90faa00 x1875729253963776/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788834971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834955.677235:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253963776:0@lo:400: 00000100:00100000:2.0:1788834955.677550:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729253963008:0@lo:400: 00000100:00100000:2.0:1788834955.677581:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834955.677601:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729253963520:0@lo:400: 00000100:00100000:2.0:1788834955.677700:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834955.677728:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788834955.677734:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253963136:0@lo:400: 00000100:00100000:2.0:1788834955.677757:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834955.677771:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729253963648:0@lo:400: 00000100:00100000:2.0:1788834955.677790:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834955.677819:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253963008 00000100:00100000:2.0:1788834955.677824:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253963008 00000100:00100000:2.0:1788834955.677848:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253963520 00000100:00100000:2.0:1788834955.677851:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253963520 00000100:00100000:2.0:1788834955.677864:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253963648 00000100:00100000:2.0:1788834955.677866:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253963648 00000100:00100000:2.0:1788834955.677883:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788834955.677889:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82079880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729253963008:12345-0@lo:400: 00000100:00100000:2.0:1788834955.677926:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82079880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729253963008:12345-0@lo:400: Request processed in 36us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834955.677932:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788834955.677954:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788834955.677961:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729253963520:12345-0@lo:400: 00000100:00100000:2.0:1788834955.678069:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82079180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729253963520:12345-0@lo:400: Request processed in 109us (368us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834955.678076:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788834955.678088:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788834955.678094:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8207a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729253963648:12345-0@lo:400: 00000100:00100000:2.0:1788834955.678124:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8207a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729253963648:12345-0@lo:400: Request processed in 30us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834955.678130:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:2.0:1788834955.678156:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdb90f9180 x1875729253963648/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834955.678179:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729253963648:0@lo:400: 00010000:00080000:2.0:1788834955.678191:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdba3e0e00 x1875729253963008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834955.678197:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729253963008:0@lo:400: 00010000:00080000:2.0:1788834955.678205:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdb90f8000 x1875729253963520/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834955.678212:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729253963520:0@lo:400: 00000100:00100000:3.0:1788834955.678573:0:9498:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345df80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9498:1875729253964032:0@lo:901: 00000020:01000004:2.0:1788834955.678744:0:9497:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1788834955.678760:0:9497:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9afdbf9399b8) 00000020:00000080:2.0:1788834955.678783:0:9497:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type lwp with refcount 2 00000020:01000004:2.0:1788834955.678876:0:9497:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afc82611000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788834955.678880:0:9497:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afc82611000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1788834955.678882:0:9497:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afc82611000 3 00010000:00080000:2.0:1788834955.678921:0:9497:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afc8346e000@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.122@tcp at head 00000100:00100000:0.0:1788834955.679102:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253963392 00000100:00100000:0.0:1788834955.679108:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253963392 00000100:00100000:0.0:1788834955.679134:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253963136 00000100:00100000:0.0:1788834955.679137:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253963136 00000100:00100000:0.0:1788834955.679150:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788834955.679157:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253963392:12345-0@lo:400: 00000100:00100000:0.0:1788834955.679217:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253963392:12345-0@lo:400: Request processed in 60us (2497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834955.679224:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788834955.679238:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788834955.679252:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253963136:12345-0@lo:400: 00000100:00100000:0.0:1788834955.679289:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253963136:12345-0@lo:400: Request processed in 38us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834955.679295:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788834955.679386:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253963136:0@lo:400: 00000100:00100000:3.0:1788834955.679740:0:9498:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834955.679780:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253963392:0@lo:400: 00000100:00100000:3.0:1788834955.679798:0:9498:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2e0e6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788834955.679885:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253964032 00000100:00100000:0.0:1788834955.679890:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253964032 00000100:00100000:0.0:1788834955.679930:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788834955.679938:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9498:x1875729253964032:12345-0@lo:901: 00000100:00100000:0.0:1788834955.680146:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:lustre-MDT0000-lwp-OST0001_UUID+5:9498:x1875729253964032:12345-0@lo:901: Request processed in 210us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834955.680153:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1788834955.680550:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788834955.680555:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788834955.680558:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788834955.680692:0:9498:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc8345df80 x1875729253964032/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1788834971 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834955.680711:0:9498:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345df80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:9498:1875729253964032:0@lo:901: 00010000:00010000:2.0:1788834955.684527:0:9497:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-10 is initialized 00000020:00000080:2.0:1788834955.684726:0:9497:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:2.0:1788834955.684786:0:9497:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788834955.684800:0:9497:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xdf60171e5a5d1a32 00000100:00080000:2.0:1788834955.684812:0:9497:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788834955.684818:0:9497:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9afc8346e000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788834955.684855:0:9497:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afc82078700 x1875729253964160/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788834955.684876:0:9497:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788834955.685306:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875729253964160:0@lo:38: 00000100:00100000:0.0:1788834955.685429:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834955.685827:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253964160 00000100:00100000:2.0:1788834955.685835:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253964160 00000100:00100000:2.0:1788834955.685875:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788834955.685883:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875729253964160:12345-0@lo:38: 00010000:00080000:2.0:1788834955.685908:0:6488:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:2.0:1788834955.685941:0:6488:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xdf60171e5a5d1a39 00000004:00100000:2.0:1788834955.685956:0:6488:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1788834955.686069:0:6488:0:(import.c:65:import_set_state_nolock()) ffff9afc8346c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788834955.686124:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e814380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1875729253964160:12345-0@lo:38: Request processed in 241us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834955.686132:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1788834955.686579:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc82078700 x1875729253964160/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788834965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834955.686591:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788834955.686598:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1788834955.686605:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788834955.687072:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788834955.687075:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc8346e000 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788834955.687083:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875729253964160:0@lo:38: 00000040:00080000:2.0:1788834955.696856:0:9497:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000020:01000000:0.0:1788834955.697840:0:9479:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-47 (rc=0) 10000000:01000000:0.0:1788834955.697884:0:9479:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788834955.697899:0:9479:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63000/0xdf60171e5a5d1a08 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a0f expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834955.697911:0:9479:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63000/0xdf60171e5a5d1a08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a0f expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788834955.697959:0:9479:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788834955.697961:0:9479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788834955.697962:0:9479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788834955.697963:0:9479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788834955.697964:0:9479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788834955.697966:0:9479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788834955.697967:0:9479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788834955.697969:0:9479:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788834955.697970:0:9479:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788834955.697972:0:9479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788834955.697973:0:9479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788834955.697976:0:9479:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:0.0:1788834955.697979:0:9479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788834955.697980:0:9479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788834955.697981:0:9479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788834955.697982:0:9479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788834955.697983:0:9479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788834955.697985:0:9479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788834955.697985:0:9479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788834955.697986:0:9479:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788834955.697987:0:9479:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788834955.697988:0:9479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788834955.697989:0:9479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788834955.698017:0:9479:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788834955.698046:0:9479:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253964288:0@lo:253: 00000100:00100000:0.0:1788834955.698113:0:9479:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834955.698151:0:9479:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8109bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788834955.698436:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253964288 00000100:00100000:2.0:1788834955.698443:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253964288 00000100:00100000:2.0:1788834955.698484:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788834955.698491:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:9479:x1875729253964288:12345-0@lo:253: 20000000:01000000:2.0:1788834955.698514:0:6481:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1788834955.698537:0:6481:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1788834955.710238:0:6481:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788834955.710255:0:6481:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1788834955.710814:0:6503:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788834955.710820:0:6503:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788834955.710843:0:6503:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1a40 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.710862:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdc2166c00/0xdf60171e5a5d1936 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d192f expref: 17 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.710870:0:6503:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d197c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1975 expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.710878:0:6503:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1a40 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.710994:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d197c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1975 expref: 17 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.711008:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d197c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1975 expref: 17 pid: 6481 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834955.711024:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875729253964416:0@lo:104: 00000100:00100000:3.0:1788834955.711093:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788834955.711186:0:6503:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdc2166c00/0xdf60171e5a5d1936 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d192f expref: 17 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.711195:0:6503:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afdc2166c00/0xdf60171e5a5d1936 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d192f expref: 17 pid: 6482 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834955.711204:0:6503:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875729253964544:0@lo:104: 00000100:00100000:3.0:1788834955.711241:0:6503:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834955.712127:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:9479:x1875729253964288:12345-0@lo:253: Request processed in 13632us (14009us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834955.712139:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1788834955.712303:0:9479:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:5f0122c5-c616-4176-9ca1-6fdce4068f64:9479:1875729253964288:0@lo:253: 10000000:01000000:0.0:1788834955.712351:0:9479:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788834955.712362:0:9479:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788834955.712364:0:9479:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788834955.712366:0:9479:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788834955.712367:0:9479:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788834955.712368:0:9479:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788834955.712369:0:9479:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788834955.712371:0:9479:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788834955.712372:0:9479:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1788834955.712373:0:9479:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1788834955.712375:0:9479:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788834955.712376:0:9479:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788834955.712389:0:9479:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:3.0:1788834955.716964:0:6503:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2e0e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788834955.722519:0:7440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253964416 00000100:00100000:1.0:1788834955.722536:0:7440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253964416 00000100:00100000:1.0:1788834955.723696:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253964544 00000100:00100000:1.0:1788834955.723705:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253964544 00000100:00100000:1.0:1788834955.723727:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788834955.723736:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:6503:x1875729253964416:12345-0@lo:104: 00010000:00010000:1.0:1788834955.723756:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afd866f4800/0xdf60171e5a5d1975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d197c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.723847:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788834955.723853:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:6503:x1875729253964416:12345-0@lo:104: Request processed in 118us (12760us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834955.723861:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788834955.723878:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788834955.723885:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:6503:x1875729253964544:12345-0@lo:104: 00010000:00010000:1.0:1788834955.723892:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afd866f4400/0xdf60171e5a5d192f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1936 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.723927:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788834955.723933:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:6503:x1875729253964544:12345-0@lo:104: Request processed in 49us (12692us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834955.723938:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1788834955.723966:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788834955.723972:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd866f4800/0xdf60171e5a5d1975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d197c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.723979:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4800 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:1.0:1788834955.723983:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f4800/0xdf60171e5a5d1975 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d197c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.723990:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd866f4800/0xdf60171e5a5d1975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d197c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788834955.723997:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f4800/0xdf60171e5a5d1975 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d197c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834955.724003:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788834955.724677:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd866f4800/0xdf60171e5a5d1975 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d197c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.724686:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788834955.724707:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd866f4800/0xdf60171e5a5d1975 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d197c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.724714:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd866f4800/0xdf60171e5a5d1975 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d197c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.724729:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788834955.724732:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd866f4400/0xdf60171e5a5d192f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1936 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.724738:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4400 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:1.0:1788834955.724741:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f4400/0xdf60171e5a5d192f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1936 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.724757:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd866f4400/0xdf60171e5a5d192f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1936 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788834955.724763:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f4400/0xdf60171e5a5d192f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1936 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834955.724768:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788834955.724786:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd866f4400/0xdf60171e5a5d192f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1936 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.724792:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788834955.724798:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd866f4400/0xdf60171e5a5d192f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1936 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.724804:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd866f4400/0xdf60171e5a5d192f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1936 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834955.724816:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834955.724818:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834955.724819:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788834955.724835:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253964672:0@lo:103: 00000100:00100000:1.0:1788834955.724880:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834955.724924:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788834955.724930:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253964800:0@lo:103: 00000100:00100000:1.0:1788834955.724953:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834955.725176:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253964672 00000100:00100000:1.0:1788834955.725183:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253964672 00010000:00010000:1.0:1788834955.725208:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d197c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1975 expref: 17 pid: 6481 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834955.726291:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253964800 00000100:00100000:1.0:1788834955.726301:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253964800 00010000:00010000:1.0:1788834955.726346:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdc2166c00/0xdf60171e5a5d1936 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d192f expref: 18 pid: 6482 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00080000:10000000:0.0:1788834955.729788:0:9479:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00080000:10000000:0.0:1788834955.729970:0:9479:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00000100:00100000:2.0:1788834955.730131:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788834955.730149:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:3614:x1875729253964672:12345-0@lo:103: 00010000:00010000:2.0:1788834955.730166:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788834955.730175:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d197c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1975 expref: 18 pid: 6481 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834955.730190:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d197c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1975 expref: 18 pid: 6481 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834955.730217:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788834955.730298:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:3614:x1875729253964672:12345-0@lo:103: Request processed in 156us (5418us total) trans 0 rc 0/0 00080000:10000000:0.0:1788834955.730602:0:9479:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:10000000:0.0:1788834955.730759:0:9479:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00080000:10000000:0.0:1788834955.730977:0:9479:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:10000000:0.0:1788834955.731206:0:9479:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00000001:00000004:0.0:1788834955.731915:0:9479:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1788834955.734466:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788834955.734487:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83109180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:3614:x1875729253964800:12345-0@lo:103: 00010000:00010000:3.0:1788834955.734507:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788834955.734517:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdc2166c00/0xdf60171e5a5d1936 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d192f expref: 18 pid: 6482 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.734534:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdc2166c00/0xdf60171e5a5d1936 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d192f expref: 18 pid: 6482 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.734556:0:9491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1a40 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.734563:0:9491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1a40 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1788834955.734580:0:9491:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.023761053s 00010000:00010000:3.0:1788834955.734585:0:9491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1a40 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.734592:0:9491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1a40 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.734598:0:9491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1a40 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.734605:0:9491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1a40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.734623:0:9491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204ae00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:3.0:1788834955.734636:0:9491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1a40 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.734646:0:9491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1a40 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.734656:0:9491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1a40 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834955.734666:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788834955.734734:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83109180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:3614:x1875729253964800:12345-0@lo:103: Request processed in 256us (9778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834955.734742:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1788834955.735437:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1788834955.737725:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d197c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1975 expref: 16 pid: 6481 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834955.737745:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345df80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875729253964416:0@lo:104: 00010000:00010000:2.0:1788834955.737760:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdc2166c00/0xdf60171e5a5d1936 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d192f expref: 15 pid: 6482 timeout: 347 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834955.737771:0:6503:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345f800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:6503:1875729253964544:0@lo:104: 00010000:00010000:2.0:1788834955.737793:0:6503:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1a40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834955.737801:0:6503:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1a40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834955.737806:0:6503:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1a40 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834955.737812:0:6503:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1a40 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6503 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834955.737832:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788834955.739122:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253964800:0@lo:103: 00000100:00100000:1.0:1788834955.739134:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253964672:0@lo:103: 00010000:00010000:0.0:1788834955.751781:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:1.0:1788834955.758175:0:9479:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788834955.758185:0:9479:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788834955.758219:0:9479:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788834955.758267:0:9479:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788834955.758288:0:9479:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:0.0:1788834955.758949:0:9479:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:0.0:1788834955.760886:0:9479:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788834955.762942:0:9479:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=41009432 00010000:00010000:2.0:1788834956.783138:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788834956.943179:0:9554:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788834956.943811:0:9554:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788834957.607946:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253965056:0@lo:13: 00000100:00100000:3.0:1788834957.608011:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834957.608079:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788834957.608086:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253964928:0@lo:13: 00000100:00100000:3.0:1788834957.608110:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834957.608150:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253965056 00000100:00100000:3.0:1788834957.608157:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253965056 00000100:00100000:3.0:1788834957.608195:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253964928 00000100:00100000:3.0:1788834957.608198:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253964928 00000100:00100000:3.0:1788834957.608214:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788834957.608222:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253965056:12345-0@lo:13: 00002000:00000024:3.0:1788834957.608247:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788834957.608288:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253965056:12345-0@lo:13: Request processed in 66us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834957.608295:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788834957.608347:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788834957.608355:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253964928:12345-0@lo:13: 00002000:00000024:3.0:1788834957.608381:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788834957.608408:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253964928:12345-0@lo:13: Request processed in 54us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834957.608414:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1788834957.608431:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788834957.608456:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc82078700 x1875729253964928/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834957.608473:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253964928:0@lo:13: 00010000:00080000:3.0:1788834957.608497:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8345d880 x1875729253965056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834973 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834957.608509:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253965056:0@lo:13: 00000100:00100000:2.0:1788834957.613284:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788834957.613308:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253965184:0@lo:41: 00000100:00100000:2.0:1788834957.613408:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834957.613526:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253965184 00000100:00100000:0.0:1788834957.613533:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253965184 00000100:00100000:0.0:1788834957.613872:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788834957.613883:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253965184:12345-0@lo:41: 00000004:00000024:0.0:1788834957.613917:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:0.0:1788834957.613976:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82078700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253965184:12345-0@lo:41: Request processed in 94us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834957.613983:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788834957.614063:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253965184:0@lo:41: 00010000:00010000:3.0:1788834957.798702:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834958.821456:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788834959.142867:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788834959.142902:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253965312:0@lo:41: 00000100:00100000:3.0:1788834959.142981:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834959.143185:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253965312 00000100:00100000:0.0:1788834959.143206:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253965312 00000100:00100000:0.0:1788834959.143259:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788834959.143268:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253965312:12345-0@lo:41: 00000004:00000024:0.0:1788834959.143301:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446354944 avail 1300115456 00000100:00100000:0.0:1788834959.143398:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253965312:12345-0@lo:41: Request processed in 130us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834959.143405:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788834959.143722:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83108000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253965312:0@lo:41: 00010000:00010000:2.0:1788834959.848526:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788834960.869672:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788834961.189558:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729253965568:0@lo:400: 00000100:00100000:1.0:1788834961.189624:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834961.189680:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729253966080:0@lo:400: 00000100:00100000:1.0:1788834961.189703:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834961.189726:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729253966592:0@lo:400: 00000100:00100000:1.0:1788834961.189749:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834961.189770:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788834961.189776:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729253965440:0@lo:400: 00000100:00100000:1.0:1788834961.189802:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834961.189824:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253965952:0@lo:400: 00000100:00100000:1.0:1788834961.189848:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834961.189867:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253966464:0@lo:400: 00000100:00100000:1.0:1788834961.189901:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834961.189943:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253965696:0@lo:400: 00000100:00100000:1.0:1788834961.189982:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834961.190013:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729253966208:0@lo:400: 00000100:00100000:1.0:1788834961.190037:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834961.190052:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729253966720:0@lo:400: 00000100:00100000:1.0:1788834961.190072:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834961.190085:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788834961.190090:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729253965824:0@lo:400: 00000100:00100000:1.0:1788834961.190110:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834961.190120:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253966336:0@lo:400: 00000100:00100000:1.0:1788834961.190137:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834961.190163:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253965568 00000100:00100000:1.0:1788834961.190171:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253965568 00000100:00100000:1.0:1788834961.190216:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253966080 00000100:00100000:1.0:1788834961.190220:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253966080 00000100:00100000:1.0:1788834961.190244:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253966592 00000100:00100000:1.0:1788834961.190247:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253966592 00000100:00100000:1.0:1788834961.190260:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253966208 00000100:00100000:1.0:1788834961.190262:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253966208 00000100:00100000:1.0:1788834961.190275:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253966720 00000100:00100000:1.0:1788834961.190277:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253966720 00000100:00100000:1.0:1788834961.190287:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253965824 00000100:00100000:1.0:1788834961.190290:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253965824 00000100:00100000:1.0:1788834961.190302:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788834961.190309:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729253965568:12345-0@lo:400: 00000100:00100000:1.0:1788834961.190380:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729253965568:12345-0@lo:400: Request processed in 71us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834961.190387:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1788834961.190404:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788834961.190418:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729253966080:12345-0@lo:400: 00000100:00100000:1.0:1788834961.190448:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729253966080:12345-0@lo:400: Request processed in 32us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834961.190454:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788834961.190466:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788834961.190473:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729253966592:12345-0@lo:400: 00000100:00100000:1.0:1788834961.190500:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83108380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729253966592:12345-0@lo:400: Request processed in 28us (749us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834961.190505:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1788834961.190516:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788834961.190522:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729253966208:12345-0@lo:400: 00000100:00100000:1.0:1788834961.190552:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83741180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729253966208:12345-0@lo:400: Request processed in 30us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834961.190557:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1788834961.190569:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788834961.190575:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729253966720:12345-0@lo:400: 00000100:00100000:1.0:1788834961.190600:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83743800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729253966720:12345-0@lo:400: Request processed in 26us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834961.190604:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788834961.190615:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788834961.190620:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729253965824:12345-0@lo:400: 00000100:00100000:1.0:1788834961.190645:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83742680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729253965824:12345-0@lo:400: Request processed in 25us (534us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834961.190650:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788834961.190672:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253965440 00000100:00100000:1.0:1788834961.190676:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253965440 00000100:00100000:1.0:1788834961.190710:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788834961.190716:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:3617:x1875729253965440:12345-0@lo:400: 00000100:00100000:1.0:1788834961.190747:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:3617:x1875729253965440:12345-0@lo:400: Request processed in 32us (944us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834961.190753:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1788834961.190780:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253965952 00000100:00100000:1.0:1788834961.190784:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253965952 00000100:00100000:1.0:1788834961.190800:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253965696 00000100:00100000:1.0:1788834961.190803:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253965696 00000100:00100000:1.0:1788834961.190815:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788834961.190821:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253965952:12345-0@lo:400: 00000100:00100000:1.0:1788834961.190856:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253965952:12345-0@lo:400: Request processed in 34us (1007us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834961.190861:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788834961.190872:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788834961.190878:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253965696:12345-0@lo:400: 00000100:00100000:1.0:1788834961.190904:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253965696:12345-0@lo:400: Request processed in 26us (922us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834961.190909:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788834961.190926:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253966464 00000100:00100000:1.0:1788834961.190929:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253966464 00000100:00100000:1.0:1788834961.190952:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253966336 00000100:00100000:1.0:1788834961.190955:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253966336 00000100:00100000:1.0:1788834961.190970:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788834961.190975:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253966464:12345-0@lo:400: 00000100:00100000:1.0:1788834961.191016:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253966464:12345-0@lo:400: Request processed in 40us (1113us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834961.191021:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788834961.191042:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788834961.191047:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253966336:12345-0@lo:400: 00000100:00100000:1.0:1788834961.191074:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83741880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253966336:12345-0@lo:400: Request processed in 27us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834961.191079:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1788834961.191105:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788834961.191109:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788834961.191111:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1788834961.191141:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83109880 x1875729253965824/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834961.191156:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729253965824:0@lo:400: 00010000:00080000:1.0:1788834961.191168:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8310bb80 x1875729253966336/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788834977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834961.191177:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253966336:0@lo:400: 00000100:00100000:1.0:1788834961.191187:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253965696:0@lo:400: 00010000:00080000:1.0:1788834961.191198:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83109500 x1875729253966208/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834961.191207:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729253966208:0@lo:400: 00010000:00080000:1.0:1788834961.191216:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83108700 x1875729253966720/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834961.191224:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729253966720:0@lo:400: 00000100:00100000:1.0:1788834961.191257:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729253965440:0@lo:400: 00000100:00100000:1.0:1788834961.191267:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253965952:0@lo:400: 00010000:00080000:1.0:1788834961.191276:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8310b100 x1875729253966464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788834977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834961.191293:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253966464:0@lo:400: 00010000:00080000:1.0:1788834961.191306:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8310b800 x1875729253965568/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834961.191333:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729253965568:0@lo:400: 00010000:00080000:1.0:1788834961.191346:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8310ad80 x1875729253966080/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834961.191355:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729253966080:0@lo:400: 00010000:00080000:1.0:1788834961.191365:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8310a300 x1875729253966592/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834977 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834961.191372:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729253966592:0@lo:400: 00010000:00010000:1.0:1788834961.894552:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788834962.725744:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253966848:0@lo:13: 00000100:00100000:3.0:1788834962.725805:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:2.0:1788834962.726094:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788834962.726098:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afdba102000 from 39 10000000:01000000:2.0:1788834962.726102:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788834962.726126:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.726136:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.726147:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1a47 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834962.726160:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9309c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253967104:0@lo:101: 00000100:00100000:2.0:1788834962.726195:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834962.726217:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba07d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788834962.726229:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253966976:0@lo:13: 00000100:00100000:2.0:1788834962.726255:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834962.726294:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253966848 00000100:00100000:2.0:1788834962.726298:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253967104 00000100:00100000:3.0:1788834962.726302:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253966848 00000100:00100000:2.0:1788834962.726305:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253967104 00000100:00100000:3.0:1788834962.726362:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253966976 00000100:00100000:3.0:1788834962.726366:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253966976 00000100:00100000:2.0:1788834962.726372:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1788834962.726384:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:6485:x1875729253967104:12345-0@lo:101: 00000100:00100000:3.0:1788834962.726389:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788834962.726399:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253966848:12345-0@lo:13: 00010000:00010000:2.0:1788834962.726401:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788834962.726415:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e62c00/0xdf60171e5a5d1a4e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1a47 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00000024:3.0:1788834962.726434:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00010000:2.0:1788834962.726439:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e62c00/0xdf60171e5a5d1a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1a47 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.726460:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e62c00/0xdf60171e5a5d1a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1a47 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.726468:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e62c00, rc 0) 00000100:00100000:3.0:1788834962.726484:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253966848:12345-0@lo:13: Request processed in 84us (676us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834962.726494:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788834962.726511:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253967104:12345-0@lo:101: Request processed in 128us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834962.726514:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788834962.726522:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788834962.726528:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253966976:12345-0@lo:13: 00002000:00000024:3.0:1788834962.726557:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788834962.726572:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9309c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253967104:0@lo:101: 00010000:00010000:2.0:1788834962.726587:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1a47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a4e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834962.726595:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253966976:12345-0@lo:13: Request processed in 68us (336us total) trans 0 rc 0/0 00010000:00010000:2.0:1788834962.726599:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1a47 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1a4e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834962.726607:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788834962.726660:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9309c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253967232:0@lo:501: 00010000:00080000:3.0:1788834962.726669:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8345d500 x1875729253966848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834962.726688:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253966848:0@lo:13: 00000100:00100000:2.0:1788834962.726691:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834962.726717:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba07d840 going to sleep for 11 seconds 00010000:00080000:2.0:1788834962.726740:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb9309500 x1875729253966976/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834962.726752:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253966976:0@lo:13: 00000100:00100000:2.0:1788834962.726773:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253967232 00000100:00100000:2.0:1788834962.726777:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253967232 00000100:00100000:2.0:1788834962.726800:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788834962.726807:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253967232:12345-0@lo:501: 00000100:00100000:2.0:1788834962.726911:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253967232:12345-0@lo:501: Request processed in 105us (224us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.726924:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788834962.726956:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9309c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253967232:0@lo:501: 00000100:00100000:2.0:1788834962.726982:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9309c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253967360:0@lo:503: 00000100:00100000:2.0:1788834962.727040:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834962.727055:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba07d840 going to sleep for 11 seconds 00000100:00100000:2.0:1788834962.727067:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253967360 00000100:00100000:2.0:1788834962.727070:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253967360 00000100:00100000:2.0:1788834962.727091:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788834962.727097:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253967360:12345-0@lo:503: 00000100:00100000:2.0:1788834962.727165:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253967360:12345-0@lo:503: Request processed in 67us (126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.727171:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1788834962.727204:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9309c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253967360:0@lo:503: 00000100:00100000:2.0:1788834962.730839:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253967488:0@lo:41: 00000100:00100000:2.0:1788834962.730912:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834962.731021:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253967488 00000100:00100000:2.0:1788834962.731037:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253967488 00000100:00100000:2.0:1788834962.731099:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788834962.731111:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253967488:12345-0@lo:41: 00000004:00000024:2.0:1788834962.731145:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446518784 avail 1300279296 00000100:00100000:2.0:1788834962.731199:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253967488:12345-0@lo:41: Request processed in 90us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.731208:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788834962.731265:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253967488:0@lo:41: 00000100:00100000:0.0:1788834962.733386:0:9796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9796:1875729253967616:0@lo:502: 00000100:00100000:0.0:1788834962.733480:0:9796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834962.733529:0:9796:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd88592b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788834962.733740:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253967616 00000100:00100000:2.0:1788834962.733754:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253967616 00000100:00100000:2.0:1788834962.733808:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788834962.733816:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:9796:x1875729253967616:12345-0@lo:502: 00000100:00100000:2.0:1788834962.733941:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:9796:x1875729253967616:12345-0@lo:502: Request processed in 124us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.733949:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788834962.734450:0:9796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9796:1875729253967616:0@lo:502: 00000100:00100000:0.0:1788834962.734507:0:9796:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9796:1875729253967744:0@lo:502: 00000100:00100000:0.0:1788834962.734558:0:9796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834962.734581:0:9796:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd88592b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788834962.734697:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253967744 00000100:00100000:2.0:1788834962.734703:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253967744 00000100:00100000:2.0:1788834962.734743:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788834962.734752:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:9796:x1875729253967744:12345-0@lo:502: 00000100:00100000:2.0:1788834962.734838:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:9796:x1875729253967744:12345-0@lo:502: Request processed in 86us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.734845:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1788834962.735223:0:9796:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9796:1875729253967744:0@lo:502: 00000040:00080000:0.0:1788834962.735247:0:9796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788834962.735331:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788834962.735357:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788834962.735367:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1a47 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a4e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.735378:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a4e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834962.735388:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1788834962.735391:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1788834962.735394:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788834962.735418:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1a55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.735427:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1a55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.735450:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1a55 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834962.735556:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9309500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253967872:0@lo:101: 00000100:00100000:3.0:1788834962.735593:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834962.735615:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834962.736371:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253967872 00000100:00100000:2.0:1788834962.736381:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253967872 00000100:00100000:2.0:1788834962.736431:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788834962.736441:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253967872:12345-0@lo:101: 00010000:00010000:2.0:1788834962.736455:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788834962.736470:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e63200/0xdf60171e5a5d1a5c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1a55 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.736495:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e63200/0xdf60171e5a5d1a5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1a55 expref: 17 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.736507:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e63200/0xdf60171e5a5d1a5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1a55 expref: 17 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.736516:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e63200, rc 0) 00000100:00100000:2.0:1788834962.736574:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253967872:12345-0@lo:101: Request processed in 135us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.736580:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788834962.736641:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9309500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253967872:0@lo:101: 00010000:00010000:3.0:1788834962.736656:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1a55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834962.736665:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1a55 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1a5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834962.736722:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253968000:0@lo:501: 00000100:00100000:3.0:1788834962.736749:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834962.736785:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788834962.736829:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253968000 00000100:00100000:0.0:1788834962.736835:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253968000 00000100:00100000:0.0:1788834962.736880:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788834962.736887:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253968000:12345-0@lo:501: 00000100:00100000:0.0:1788834962.737020:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253968000:12345-0@lo:501: Request processed in 133us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834962.737027:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1788834962.737266:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253968000:0@lo:501: 00000100:00100000:3.0:1788834962.737305:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253968128:0@lo:503: 00000100:00100000:3.0:1788834962.737375:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834962.737392:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834962.737728:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253968128 00000100:00100000:2.0:1788834962.737735:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253968128 00000100:00100000:2.0:1788834962.737764:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788834962.737770:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253968128:12345-0@lo:503: 00000100:00100000:2.0:1788834962.737865:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253968128:12345-0@lo:503: Request processed in 94us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.737872:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788834962.738805:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253968128:0@lo:503: 00000100:00100000:3.0:1788834962.739825:0:9797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9797:1875729253968256:0@lo:502: 00000100:00100000:3.0:1788834962.739904:0:9797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834962.739952:0:9797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788834962.740003:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253968256 00000100:00100000:0.0:1788834962.740010:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253968256 00000100:00100000:0.0:1788834962.740066:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788834962.740077:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:9797:x1875729253968256:12345-0@lo:502: 00000100:00100000:0.0:1788834962.740203:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:9797:x1875729253968256:12345-0@lo:502: Request processed in 128us (300us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834962.740211:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788834962.740373:0:9797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9797:1875729253968256:0@lo:502: 00000020:01000000:3.0:1788834962.740398:0:9797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788834962.740407:0:9797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788834962.740410:0:9797:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:3.0:1788834962.740415:0:9797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1788834962.740417:0:9797:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1788834962.740433:0:9797:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9797:1875729253968384:0@lo:502: 00000100:00100000:3.0:1788834962.740467:0:9797:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834962.740489:0:9797:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788834962.740551:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253968384 00000100:00100000:0.0:1788834962.740555:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253968384 00000100:00100000:0.0:1788834962.740585:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1788834962.740593:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:9797:x1875729253968384:12345-0@lo:502: 00000100:00100000:0.0:1788834962.740657:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:9797:x1875729253968384:12345-0@lo:502: Request processed in 64us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834962.740664:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788834962.740791:0:9797:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9797:1875729253968384:0@lo:502: 00000020:01000000:3.0:1788834962.740810:0:9797:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788834962.740815:0:9797:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788834962.740816:0:9797:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000040:00080000:3.0:1788834962.740819:0:9797:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1788834962.741698:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1788834962.741725:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1788834962.741736:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1a55 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834962.741749:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1a55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788834962.741759:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788834962.741762:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afdb279f000 from 39 10000000:01000000:0.0:1788834962.741765:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788834962.741793:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1a63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834962.741801:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1a63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834962.741811:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1a63 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834962.741850:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253968512:0@lo:101: 00000100:00100000:0.0:1788834962.741910:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834962.741933:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb7235900 going to sleep for 11 seconds 00000100:00100000:3.0:1788834962.742146:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253968512 00000100:00100000:3.0:1788834962.742152:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253968512 00000100:00100000:3.0:1788834962.742193:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788834962.742208:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253968512:12345-0@lo:101: 00010000:00010000:3.0:1788834962.742228:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788834962.742240:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdc204a600/0xdf60171e5a5d1a6a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1a63 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834962.742262:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdc204a600/0xdf60171e5a5d1a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1a63 expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834962.742271:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdc204a600/0xdf60171e5a5d1a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1a63 expref: 18 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834962.742279:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204a600, rc 0) 00000100:00100000:3.0:1788834962.742333:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253968512:12345-0@lo:101: Request processed in 116us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834962.742341:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788834962.742378:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253968512:0@lo:101: 00010000:00010000:3.0:1788834962.742390:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1a63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a6a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834962.742399:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1a63 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1a6a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834962.742445:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253968640:0@lo:501: 00000100:00100000:3.0:1788834962.742469:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834962.742483:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788834962.742494:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253968640 00000100:00100000:3.0:1788834962.742497:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253968640 00000100:00100000:3.0:1788834962.742516:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788834962.742521:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd829d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253968640:12345-0@lo:501: 00000100:00100000:3.0:1788834962.742640:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd829d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253968640:12345-0@lo:501: Request processed in 118us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834962.742646:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788834962.742672:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253968640:0@lo:501: 00000100:00100000:3.0:1788834962.742695:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253968768:0@lo:503: 00000100:00100000:3.0:1788834962.742730:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834962.742742:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788834962.742752:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253968768 00000100:00100000:3.0:1788834962.742755:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253968768 00000100:00100000:3.0:1788834962.742771:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788834962.742776:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd878e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253968768:12345-0@lo:503: 00000100:00100000:3.0:1788834962.742842:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd878e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253968768:12345-0@lo:503: Request processed in 65us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834962.742848:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788834962.742895:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253968768:0@lo:503: 00000100:00100000:3.0:1788834962.743534:0:9798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9798:1875729253968896:0@lo:502: 00000100:00100000:3.0:1788834962.743574:0:9798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834962.743598:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253968896 00000100:00100000:3.0:1788834962.743601:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253968896 00000100:00100000:3.0:1788834962.743618:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788834962.743623:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd878e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:9798:x1875729253968896:12345-0@lo:502: 00000100:00100000:3.0:1788834962.743687:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd878e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:9798:x1875729253968896:12345-0@lo:502: Request processed in 63us (112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834962.743694:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788834962.743718:0:9798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788834962.743732:0:9798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9798:1875729253968896:0@lo:502: 00000100:00100000:3.0:1788834962.743762:0:9798:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9798:1875729253969024:0@lo:502: 00000100:00100000:3.0:1788834962.743786:0:9798:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834962.743799:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253969024 00000100:00100000:3.0:1788834962.743802:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253969024 00000100:00100000:3.0:1788834962.743815:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788834962.743819:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd878e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:9798:x1875729253969024:12345-0@lo:502: 00000100:00100000:3.0:1788834962.743866:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd878e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:9798:x1875729253969024:12345-0@lo:502: Request processed in 46us (79us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834962.743889:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788834962.744163:0:9798:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788834962.744179:0:9798:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9798:1875729253969024:0@lo:502: 00000040:00080000:3.0:1788834962.744198:0:9798:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:0.0:1788834962.744513:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:0.0:1788834962.744533:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788834962.744552:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1a63 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a6a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834962.744564:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1a63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a6a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788834962.744573:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788834962.744576:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afdb279f000 from 6 10000000:01000000:0.0:1788834962.744579:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788834962.744606:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d1a71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834962.744614:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d1a71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834962.744624:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d1a71 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834962.744637:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253969152:0@lo:101: 00000100:00100000:0.0:1788834962.744672:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834962.744695:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb7235a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788834962.744791:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253969152 00000100:00100000:3.0:1788834962.744796:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253969152 00000100:00100000:3.0:1788834962.744829:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788834962.744836:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd878d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253969152:12345-0@lo:101: 00010000:00010000:3.0:1788834962.744845:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788834962.744859:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdc204ac00/0xdf60171e5a5d1a78 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1a71 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834962.745179:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdc204ac00/0xdf60171e5a5d1a78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1a71 expref: 19 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834962.745191:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdc204ac00/0xdf60171e5a5d1a78 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1a71 expref: 19 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834962.745201:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204ac00, rc 0) 00000100:00100000:3.0:1788834962.745266:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd878d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:6485:x1875729253969152:12345-0@lo:101: Request processed in 430us (592us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834962.745274:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1788834962.745488:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253969152:0@lo:101: 00010000:00010000:0.0:1788834962.745503:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d1a71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a78 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834962.745518:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d1a71 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1a78 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834962.745573:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253969280:0@lo:256: 00000100:00100000:0.0:1788834962.745604:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834962.745640:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb7235a80 going to sleep for 11 seconds 00000100:00100000:1.0:1788834962.745789:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253969280 00000100:00100000:1.0:1788834962.745795:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253969280 00000100:00100000:1.0:1788834962.745832:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1788834962.745839:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:6485:x1875729253969280:12345-0@lo:256: 20000000:01000000:1.0:1788834962.745854:0:6482:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788834962.746146:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788834962.746150:0:6482:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:1.0:1788834962.746240:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:6485:x1875729253969280:12345-0@lo:256: Request processed in 400us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834962.746248:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788834962.746310:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253969280:0@lo:256: 10000000:01000000:0.0:1788834962.746429:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788834962.746437:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d1a71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a78 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834962.746445:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d1a71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a78 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788834962.746453:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788834962.746456:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 34 10000000:01000000:0.0:1788834962.746459:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788834962.746479:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1a7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834962.746486:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1a7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834962.746495:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1a7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834962.746507:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253969408:0@lo:101: 00000100:00100000:0.0:1788834962.746553:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834962.746571:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb7235a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788834962.746657:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253969408 00000100:00100000:3.0:1788834962.746662:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253969408 00000100:00100000:3.0:1788834962.746690:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788834962.746697:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:6485:x1875729253969408:12345-0@lo:101: 00010000:00010000:3.0:1788834962.746706:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788834962.746717:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdc204a000/0xdf60171e5a5d1a86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1a7f expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834962.746736:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdc204a000/0xdf60171e5a5d1a86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1a7f expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834962.746747:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdc204a000/0xdf60171e5a5d1a86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1a7f expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834962.746756:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204a000, rc 0) 00000100:00100000:3.0:1788834962.746789:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:6485:x1875729253969408:12345-0@lo:101: Request processed in 92us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834962.746795:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1788834962.746823:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253969408:0@lo:101: 00010000:00010000:3.0:1788834962.746833:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1a7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a86 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834962.746841:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1a7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1a86 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834962.746902:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253969536:0@lo:501: 00000100:00100000:3.0:1788834962.746946:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834962.746958:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788834962.747465:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253969536 00000100:00100000:1.0:1788834962.747471:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253969536 00000100:00100000:1.0:1788834962.747585:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788834962.747592:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:6485:x1875729253969536:12345-0@lo:501: 00000100:00100000:1.0:1788834962.747715:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:6485:x1875729253969536:12345-0@lo:501: Request processed in 123us (778us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834962.747722:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788834962.747761:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253969536:0@lo:501: 00000100:00100000:1.0:1788834962.747793:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253969664:0@lo:503: 00000100:00100000:1.0:1788834962.747831:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834962.747856:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2e0e600 going to sleep for 11 seconds 00000100:00100000:1.0:1788834962.747867:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253969664 00000100:00100000:1.0:1788834962.747887:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253969664 00000100:00100000:1.0:1788834962.747906:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788834962.747913:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:6485:x1875729253969664:12345-0@lo:503: 00000100:00100000:1.0:1788834962.748220:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:6485:x1875729253969664:12345-0@lo:503: Request processed in 305us (387us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834962.748227:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788834962.748265:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83740a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253969664:0@lo:503: 00000100:00100000:1.0:1788834962.748469:0:9799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83740a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9799:1875729253969792:0@lo:502: 00000100:00100000:1.0:1788834962.748512:0:9799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834962.748532:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253969792 00000100:00100000:1.0:1788834962.748536:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253969792 00000100:00100000:1.0:1788834962.748575:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788834962.748581:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:9799:x1875729253969792:12345-0@lo:502: 00000100:00100000:1.0:1788834962.748652:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:9799:x1875729253969792:12345-0@lo:502: Request processed in 70us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834962.748658:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788834962.748695:0:9799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd87225cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788834962.748714:0:9799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83740a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9799:1875729253969792:0@lo:502: 00000020:01000000:1.0:1788834962.748738:0:9799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788834962.748745:0:9799:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:1.0:1788834962.748751:0:9799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788834962.748754:0:9799:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1788834962.748759:0:9799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788834962.748763:0:9799:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:1.0:1788834962.748786:0:9799:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:1.0:1788834962.748789:0:9799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788834962.748805:0:9799:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9afdab4f3370) 00000020:00000080:1.0:1788834962.748829:0:9799:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type osp with refcount 2 00000020:00000080:1.0:1788834962.748834:0:9799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1788834962.749227:0:9799:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:1.0:1788834962.749235:0:9799:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:1.0:1788834962.749243:0:9799:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdf60171e5a5d1a94 00010000:00080000:1.0:1788834962.749272:0:9799:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afc830f8800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.122@tcp at head 00010000:00010000:1.0:1788834962.749554:0:9799:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-11 is initialized 00000040:01000000:1.0:1788834962.749684:0:9799:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1788834962.749696:0:9799:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000040:00080000:1.0:1788834962.749860:0:9799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788834962.753726:0:9799:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788834962.757184:0:9799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1788834962.757356:0:9799:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1788834962.761231:0:9802:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788834962.761240:0:9802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1788834962.768510:0:9799:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788834962.768524:0:9799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1788834962.768567:0:9799:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788834962.768592:0:9799:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdf60171e5a5d1a9b 00000100:00080000:1.0:1788834962.768602:0:9799:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788834962.768608:0:9799:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9afc830f8800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788834962.768643:0:9799:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afc83740a80 x1875729253969920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788834962.768684:0:9799:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788834962.768743:0:9799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788834962.768747:0:9799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788834962.768749:0:9799:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788834962.768752:0:9799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788834962.768756:0:9799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788834962.768757:0:9799:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788834962.768760:0:9799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788834962.768762:0:9799:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1788834962.768788:0:9799:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83742d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9799:1875729253970048:0@lo:502: 00000100:00100000:1.0:1788834962.768862:0:9799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834962.768900:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729253969920:0@lo:8: 00000100:00100000:1.0:1788834962.768900:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253970048 00000100:00100000:1.0:1788834962.768908:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253970048 00000100:00100000:2.0:1788834962.768947:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834962.768952:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788834962.768963:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:9799:x1875729253970048:12345-0@lo:502: 00000100:00100000:2.0:1788834962.769027:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253969920 00000100:00100000:2.0:1788834962.769032:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253969920 00000100:00100000:2.0:1788834962.769060:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788834962.769065:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb930b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875729253969920:12345-0@lo:8: 00010000:00080000:2.0:1788834962.769088:0:8402:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:2.0:1788834962.769111:0:8402:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdf60171e5a5d1aa2 00002000:00100000:2.0:1788834962.769124:0:8402:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9afc8346d800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:2.0:1788834962.769128:0:8402:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00000001:00000004:2.0:1788834962.769132:0:8402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1788834962.769186:0:8402:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1788834962.769447:0:8402:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:2.0:1788834962.769470:0:8402:0:(import.c:65:import_set_state_nolock()) ffff9afc83468800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788834962.769516:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb930b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:3613:x1875729253969920:12345-0@lo:8: Request processed in 448us (569us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.769525:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1788834962.769563:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83740a80 x1875729253969920/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788834972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834962.769574:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788834962.769580:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 1 00000100:00080000:2.0:1788834962.769586:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1788834962.769590:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1788834962.769592:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc830f8800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1788834962.769602:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1788834962.769607:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83740a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729253969920:0@lo:8: 00000004:00080000:2.0:1788834962.769630:0:9802:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1788834962.769680:0:9802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 204811364553ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788834962.769686:0:9802:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:3.0:1788834962.770628:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729253970176:0@lo:400: 00000100:00100000:3.0:1788834962.770674:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834962.770699:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729253970688:0@lo:400: 00000100:00100000:3.0:1788834962.770719:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834962.770738:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788834962.770744:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253970304:0@lo:400: 00000100:00100000:3.0:1788834962.770765:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834962.770781:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875729253970816:0@lo:400: 00000100:00100000:3.0:1788834962.770800:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834962.770825:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729253970432:0@lo:400: 00000100:00100000:3.0:1788834962.770846:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834962.770861:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729253970944:0@lo:400: 00000100:00100000:3.0:1788834962.770885:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834962.770898:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788834962.770902:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729253970560:0@lo:400: 00000100:00100000:3.0:1788834962.770919:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834962.770941:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253970176 00000100:00100000:3.0:1788834962.770947:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253970176 00000100:00100000:3.0:1788834962.770974:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253970688 00000100:00100000:3.0:1788834962.770977:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253970688 00000100:00100000:3.0:1788834962.770997:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253970816 00000100:00100000:3.0:1788834962.770999:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253970816 00000100:00100000:3.0:1788834962.771010:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253970432 00000100:00100000:3.0:1788834962.771012:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253970432 00000100:00100000:3.0:1788834962.771022:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253970944 00000100:00100000:3.0:1788834962.771024:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253970944 00000100:00100000:3.0:1788834962.771044:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253970560 00000100:00100000:3.0:1788834962.771047:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253970560 00000100:00100000:2.0:1788834962.771364:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788834962.771376:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729253970176:12345-0@lo:400: 00000100:00100000:3.0:1788834962.771487:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788834962.771494:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729253970688:12345-0@lo:400: 00000100:00100000:1.0:1788834962.771544:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:9799:x1875729253970048:12345-0@lo:502: Request processed in 2582us (2680us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834962.771554:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788834962.771623:0:9803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83741500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9803:1875729253971072:0@lo:700: 00000100:00100000:1.0:1788834962.771653:0:9803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834962.771671:0:9803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82c42f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788834962.771689:0:9799:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82c420c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788834962.771706:0:9799:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83742d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9799:1875729253970048:0@lo:502: 00000020:01000000:1.0:1788834962.771745:0:9799:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788834962.771753:0:9799:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788834962.771755:0:9799:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000040:00080000:1.0:1788834962.771759:0:9799:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000020:01000000:1.0:1788834962.771819:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 34-42 (rc=0) 10000000:01000000:1.0:1788834962.771846:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788834962.771855:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1a7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a86 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834962.771865:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1a7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a86 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834962.771875:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1788834962.771878:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afd85554000 from 39 10000000:01000000:1.0:1788834962.771880:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1788834962.771903:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d1aa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834962.771910:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d1aa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834962.771918:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d1aa9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834962.771930:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253971200:0@lo:101: 00000100:00100000:1.0:1788834962.771967:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834962.771985:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82c420c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788834962.776390:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253971200 00000100:00100000:1.0:1788834962.776403:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253971200 00000100:00100000:1.0:1788834962.776465:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788834962.776475:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:6485:x1875729253971200:12345-0@lo:101: 00010000:00010000:1.0:1788834962.776493:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788834962.776512:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e61400/0xdf60171e5a5d1ab0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1aa9 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834962.776563:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e61400/0xdf60171e5a5d1ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1aa9 expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834962.776575:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e61400/0xdf60171e5a5d1ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1aa9 expref: 21 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834962.776584:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61400, rc 0) 00000100:00100000:1.0:1788834962.776665:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729253971200:12345-0@lo:101: Request processed in 192us (4696us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834962.776672:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788834962.776709:0:8412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253971072 00000100:00100000:1.0:1788834962.776713:0:8412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253971072 00000100:00100000:1.0:1788834962.776748:0:8412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788834962.776755:0:8412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+6:9803:x1875729253971072:12345-0@lo:700: 00000100:00100000:1.0:1788834962.776801:0:8412:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83743100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8412:1875729253971328:0@lo:700: 00000100:00100000:1.0:1788834962.776836:0:8412:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834962.776860:0:8412:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8b5a16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788834962.777343:0:6488:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:1.0:1788834962.777353:0:6488:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:1.0:1788834962.777372:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788834962.777482:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253971200:0@lo:101: 00010000:00010000:1.0:1788834962.777501:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d1aa9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1ab0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834962.777513:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d1aa9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1ab0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834962.777583:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253971456:0@lo:501: 00000100:00100000:1.0:1788834962.777615:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834962.777640:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8b5a1300 going to sleep for 11 seconds 00000100:00100000:1.0:1788834962.777654:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253971456 00000100:00100000:1.0:1788834962.777658:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253971456 00000100:00100000:1.0:1788834962.777684:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788834962.777690:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729253971456:12345-0@lo:501: 00000100:00100000:1.0:1788834962.777804:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729253971456:12345-0@lo:501: Request processed in 113us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834962.777811:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788834962.777841:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253971456:0@lo:501: 00000100:00100000:1.0:1788834962.777866:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253971584:0@lo:503: 00000100:00100000:1.0:1788834962.778706:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834962.778743:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8b5a1300 going to sleep for 11 seconds 00000100:00100000:1.0:1788834962.778762:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253971584 00000100:00100000:1.0:1788834962.778767:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253971584 00000100:00100000:1.0:1788834962.778799:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788834962.778806:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729253971584:12345-0@lo:503: 00000100:00100000:1.0:1788834962.779045:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729253971584:12345-0@lo:503: Request processed in 238us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834962.779126:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788834962.779382:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729253970176:12345-0@lo:400: Request processed in 8007us (8704us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.779392:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1788834962.779417:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788834962.779426:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875729253970816:12345-0@lo:400: 00000100:00100000:2.0:1788834962.779473:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875729253970816:12345-0@lo:400: Request processed in 50us (8671us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.779479:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788834962.779491:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788834962.779499:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729253970432:12345-0@lo:400: 00000100:00100000:2.0:1788834962.779538:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729253970432:12345-0@lo:400: Request processed in 40us (8690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.779543:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788834962.779557:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788834962.779565:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729253970944:12345-0@lo:400: 00000100:00100000:2.0:1788834962.779598:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729253970944:12345-0@lo:400: Request processed in 34us (8712us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.779603:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788834962.779738:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788834962.779746:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729253970560:12345-0@lo:400: 00000100:00100000:2.0:1788834962.779776:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90faa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729253970560:12345-0@lo:400: Request processed in 31us (8856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.779792:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788834962.779816:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253970304 00000100:00100000:2.0:1788834962.779821:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253970304 00000100:00100000:2.0:1788834962.779850:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1788834962.779856:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253970304:12345-0@lo:400: 00000100:00100000:2.0:1788834962.779892:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253970304:12345-0@lo:400: Request processed in 36us (9126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.779898:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:2.0:1788834962.779939:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8345c380 x1875729253970560/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834962.779953:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729253970560:0@lo:400: 00010000:00080000:2.0:1788834962.779965:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8345c700 x1875729253970432/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834962.779973:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729253970432:0@lo:400: 00010000:00080000:2.0:1788834962.779999:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8345df80 x1875729253970944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834962.780008:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729253970944:0@lo:400: 00000100:00100000:3.0:1788834962.780305:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729253970688:12345-0@lo:400: Request processed in 8810us (9583us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834962.780328:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788834962.780362:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253970304:0@lo:400: 00010000:00080000:3.0:1788834962.780374:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8345f800 x1875729253970816/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834962.780384:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875729253970816:0@lo:400: 00010000:00080000:3.0:1788834962.780396:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8345f100 x1875729253970176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834962.780404:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729253970176:0@lo:400: 00010000:00080000:3.0:1788834962.780413:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8345d500 x1875729253970688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834978 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834962.780420:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729253970688:0@lo:400: 00000100:00100000:3.0:1788834962.780452:0:6494:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253971328 00000100:00100000:3.0:1788834962.780456:0:6494:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253971328 00000100:00100000:3.0:1788834962.780483:0:6494:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788834962.780490:0:6494:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8412:x1875729253971328:12345-0@lo:700: 00000100:00100000:0.0:1788834962.785266:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83742d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253971584:0@lo:503: 00000100:00100000:0.0:1788834962.786284:0:9807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9807:1875729253971712:0@lo:502: 00000100:00100000:0.0:1788834962.786383:0:9807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834962.786427:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253971712 00000100:00100000:0.0:1788834962.786429:0:9807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd88592180 going to sleep for 11 seconds 00000100:00100000:2.0:1788834962.786436:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253971712 00000100:00100000:2.0:1788834962.786487:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788834962.786498:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:9807:x1875729253971712:12345-0@lo:502: 00000100:00100000:2.0:1788834962.786642:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:9807:x1875729253971712:12345-0@lo:502: Request processed in 146us (258us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.786652:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788834962.786665:0:9807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9807:1875729253971712:0@lo:502: 00000100:00100000:0.0:1788834962.786716:0:9807:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9807:1875729253971840:0@lo:502: 00000100:00100000:0.0:1788834962.786747:0:9807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834962.786771:0:9807:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd88592180 going to sleep for 11 seconds 00000100:00100000:2.0:1788834962.786789:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253971840 00000100:00100000:2.0:1788834962.786794:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253971840 00000100:00100000:2.0:1788834962.786830:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788834962.786838:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:9807:x1875729253971840:12345-0@lo:502: 00000100:00100000:2.0:1788834962.786913:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:9807:x1875729253971840:12345-0@lo:502: Request processed in 74us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.786920:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000004:00080000:3.0:1788834962.786951:0:7417:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000100:00100000:0.0:1788834962.787148:0:9807:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9807:1875729253971840:0@lo:502: 00000040:00080000:0.0:1788834962.787166:0:9807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000020:01000000:2.0:1788834962.787444:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-47 (rc=0) 10000000:01000000:2.0:1788834962.787471:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788834962.787480:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d1aa9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1ab0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.787490:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d1aa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1ab0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834962.787500:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788834962.787503:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afd85554000 from 6 10000000:01000000:2.0:1788834962.787506:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788834962.787530:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62800/0xdf60171e5a5d1ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.787538:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62800/0xdf60171e5a5d1ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.787547:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62800/0xdf60171e5a5d1ab7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834962.787560:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253971968:0@lo:101: 00000100:00100000:2.0:1788834962.787594:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834962.787614:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd916720c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788834962.787713:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253971968 00000100:00100000:3.0:1788834962.787719:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253971968 00000100:00100000:3.0:1788834962.787756:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788834962.787764:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729253971968:12345-0@lo:101: 00010000:00010000:3.0:1788834962.787780:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788834962.787793:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdc204b400/0xdf60171e5a5d1abe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1ab7 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834962.787815:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdc204b400/0xdf60171e5a5d1abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1ab7 expref: 22 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834962.787826:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdc204b400/0xdf60171e5a5d1abe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1ab7 expref: 22 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834962.787835:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204b400, rc 0) 00000100:00100000:3.0:1788834962.787868:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729253971968:12345-0@lo:101: Request processed in 105us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834962.787874:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1788834962.788218:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253971968:0@lo:101: 00010000:00010000:2.0:1788834962.788232:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62800/0xdf60171e5a5d1ab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1abe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.788241:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62800/0xdf60171e5a5d1ab7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1abe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834962.788291:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253972096:0@lo:256: 00000100:00100000:2.0:1788834962.788348:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834962.788374:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd916720c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834962.788389:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253972096 00000100:00100000:2.0:1788834962.788393:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253972096 00000100:00100000:2.0:1788834962.788422:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788834962.788430:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729253972096:12345-0@lo:256: 20000000:01000000:2.0:1788834962.788444:0:6483:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788834962.788462:0:6483:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788834962.788466:0:6483:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1788834962.788544:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729253972096:12345-0@lo:256: Request processed in 115us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.788552:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1788834962.788587:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253972096:0@lo:256: 10000000:01000000:2.0:1788834962.788641:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788834962.788648:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62800/0xdf60171e5a5d1ab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1abe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.788656:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62800/0xdf60171e5a5d1ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1abe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834962.788673:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1788834962.788675:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1788834962.788678:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788834962.788695:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63e00/0xdf60171e5a5d1ac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.788702:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63e00/0xdf60171e5a5d1ac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.788708:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63e00/0xdf60171e5a5d1ac5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834962.788718:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253972224:0@lo:101: 00000100:00100000:2.0:1788834962.788740:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834962.788752:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd916720c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834962.788763:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253972224 00000100:00100000:2.0:1788834962.788767:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253972224 00000100:00100000:2.0:1788834962.788786:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788834962.788792:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729253972224:12345-0@lo:101: 00010000:00010000:2.0:1788834962.788799:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788834962.788810:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e62e00/0xdf60171e5a5d1acc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1ac5 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.788825:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e62e00/0xdf60171e5a5d1acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1ac5 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.788832:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e62e00/0xdf60171e5a5d1acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1ac5 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.788850:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e62e00, rc 0) 00000100:00100000:2.0:1788834962.788878:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729253972224:12345-0@lo:101: Request processed in 86us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.788884:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1788834962.788910:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253972224:0@lo:101: 00010000:00010000:2.0:1788834962.788919:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63e00/0xdf60171e5a5d1ac5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1acc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.788927:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63e00/0xdf60171e5a5d1ac5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1acc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834962.788970:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253972352:0@lo:501: 00000100:00100000:2.0:1788834962.789008:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834962.789021:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd916720c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834962.789266:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253972352 00000100:00100000:2.0:1788834962.789270:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253972352 00000100:00100000:2.0:1788834962.789299:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788834962.789305:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729253972352:12345-0@lo:501: 00000100:00100000:2.0:1788834962.789433:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729253972352:12345-0@lo:501: Request processed in 128us (424us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.789441:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788834962.789537:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253972352:0@lo:501: 00000100:00100000:2.0:1788834962.790737:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253972480:0@lo:503: 00000100:00100000:2.0:1788834962.790807:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834962.790830:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd88ed3300 going to sleep for 11 seconds 00000100:00100000:2.0:1788834962.790860:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253972480 00000100:00100000:2.0:1788834962.790865:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253972480 00000100:00100000:2.0:1788834962.790897:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788834962.790904:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729253972480:12345-0@lo:503: 00000100:00100000:2.0:1788834962.791015:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729253972480:12345-0@lo:503: Request processed in 110us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.791021:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1788834962.791788:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253972480:0@lo:503: 40000000:02000000:0.0:1788834962.792719:0:6494:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x00000002c0000400-0x0000000300000400]:1:ost 00000100:00100000:0.0:1788834962.808293:0:6494:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83742300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:8412:x1875729253971328:12345-0@lo:700: Request processed in 27796us (31448us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834962.808307:0:6494:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788834962.808413:0:8412:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83743100 x1875729253971328/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1788834978 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834962.808429:0:8412:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83743100 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:8412:1875729253971328:0@lo:700: 40000000:02000000:0.0:1788834962.808443:0:8412:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x00000002c0000400-0x0000000300000400]:1:ost] 00000100:00100000:3.0:1788834962.811223:0:9811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9811:1875729253972608:0@lo:502: 00000100:00100000:3.0:1788834962.811302:0:9811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834962.811358:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253972608 00000100:00100000:3.0:1788834962.811365:0:9811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c840 going to sleep for 11 seconds 00000100:00100000:2.0:1788834962.811366:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253972608 00000100:00100000:2.0:1788834962.811422:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:2.0:1788834962.811431:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:9811:x1875729253972608:12345-0@lo:502: 00000100:00100000:2.0:1788834962.811553:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:9811:x1875729253972608:12345-0@lo:502: Request processed in 122us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.811561:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788834962.813134:0:9811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9811:1875729253972608:0@lo:502: 00000020:01000000:3.0:1788834962.813178:0:9811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788834962.813186:0:9811:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788834962.813196:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788834962.813198:0:9811:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788834962.813204:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788834962.813208:0:9811:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:3.0:1788834962.813235:0:9811:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788834962.813239:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788834962.813255:0:9811:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9afc82370000) 00000020:00000080:3.0:1788834962.813280:0:9811:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type osp with refcount 2 00000020:00000080:3.0:1788834962.813294:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788834962.813410:0:9811:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788834962.813417:0:9811:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788834962.813426:0:9811:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf60171e5a5d1ada 00010000:00080000:3.0:1788834962.813460:0:9811:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afdb34c6000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:3.0:1788834962.813700:0:9811:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-12 is initialized 00000040:01000000:3.0:1788834962.813833:0:9811:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1788834962.813845:0:9811:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1788834962.814024:0:9811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788834962.814130:0:9811:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788834962.814270:0:9811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1788834962.814372:0:9811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:3.0:1788834962.821241:0:9812:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1788834962.821249:0:9812:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788834962.830728:0:9811:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788834962.830745:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788834962.830794:0:9811:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788834962.830823:0:9811:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf60171e5a5d1ae1 00000100:00080000:2.0:1788834962.830835:0:9811:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788834962.830841:0:9811:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9afdb34c6000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788834962.830876:0:9811:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdb930aa00 x1875729253972736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788834962.830895:0:9811:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788834962.830943:0:9811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788834962.830948:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788834962.830949:0:9811:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788834962.830958:0:9811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788834962.830962:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788834962.830963:0:9811:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788834962.830966:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788834962.830968:0:9811:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1788834962.831006:0:9811:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9309f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9811:1875729253972864:0@lo:502: 00000100:00100000:2.0:1788834962.831095:0:9811:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834962.831131:0:9811:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77600 going to sleep for 11 seconds 00000100:00100000:2.0:1788834962.831147:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729253972736:0@lo:8: 00000100:00100000:2.0:1788834962.831186:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834962.831381:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253972736 00000100:00100000:0.0:1788834962.831389:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253972736 00000100:00100000:0.0:1788834962.831427:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788834962.831434:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3613:x1875729253972736:12345-0@lo:8: 00010000:00080000:0.0:1788834962.831458:0:8405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 204 last 0 00000020:00000080:0.0:1788834962.831479:0:8405:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf60171e5a5d1ae8 00002000:00100000:0.0:1788834962.831491:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9afc83378800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1788834962.831496:0:8405:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1788834962.831498:0:8405:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1788834962.831546:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788834962.831568:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9afc8337b800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788834962.831619:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9309500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3613:x1875729253972736:12345-0@lo:8: Request processed in 184us (432us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834962.831626:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:0.0:1788834962.831747:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb930aa00 x1875729253972736/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788834972 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834962.831757:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788834962.831764:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1788834962.831770:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788834962.831774:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1788834962.831777:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdb34c6000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788834962.831799:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788834962.831803:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729253972736:0@lo:8: 00000100:00100000:3.0:1788834962.832259:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253972864 00000100:00100000:3.0:1788834962.832266:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253972864 00000100:00100000:3.0:1788834962.832306:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1788834962.832334:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:9811:x1875729253972864:12345-0@lo:502: 00000100:00100000:3.0:1788834962.832443:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:9811:x1875729253972864:12345-0@lo:502: Request processed in 130us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834962.832450:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000004:00080000:3.0:1788834962.832485:0:9812:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:2.0:1788834962.832604:0:9811:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9309f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:9811:1875729253972864:0@lo:502: 00000020:01000000:2.0:1788834962.832635:0:9811:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788834962.832641:0:9811:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788834962.832643:0:9811:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000040:00080000:2.0:1788834962.832647:0:9811:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000020:01000000:3.0:1788834962.836242:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-42 (rc=0) 10000000:01000000:3.0:1788834962.836284:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788834962.836297:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63e00/0xdf60171e5a5d1ac5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1acc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834962.836310:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63e00/0xdf60171e5a5d1ac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1acc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788834962.836362:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1788834962.836365:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9afdab4bb370 from 1 10000000:01000000:3.0:1788834962.836368:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1788834962.836407:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdc204b000/0xdf60171e5a5d1aef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834962.836416:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdc204b000/0xdf60171e5a5d1aef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834962.836426:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdc204b000/0xdf60171e5a5d1aef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834962.836447:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253972992:0@lo:101: 00000100:00100000:3.0:1788834962.836505:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834962.836542:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c540 going to sleep for 11 seconds 00000100:00100000:2.0:1788834962.836616:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253972992 00000100:00100000:2.0:1788834962.836624:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253972992 00000100:00100000:2.0:1788834962.836676:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788834962.836684:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729253972992:12345-0@lo:101: 00010000:00010000:2.0:1788834962.836696:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788834962.836706:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e62400/0xdf60171e5a5d1af6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1aef expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.836728:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e62400/0xdf60171e5a5d1af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1aef expref: 24 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.836738:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e62400/0xdf60171e5a5d1af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1aef expref: 24 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.836746:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e62400, rc 0) 00000100:00100000:2.0:1788834962.836788:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:6485:x1875729253972992:12345-0@lo:101: Request processed in 105us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.836794:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788834962.836831:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253972992:0@lo:101: 00010000:00010000:2.0:1788834962.836843:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdc204b000/0xdf60171e5a5d1aef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1af6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.836852:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdc204b000/0xdf60171e5a5d1aef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1af6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834962.836901:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9309f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253973120:0@lo:501: 00000100:00100000:2.0:1788834962.836922:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834962.836933:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788834962.836944:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253973120 00000100:00100000:2.0:1788834962.836947:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253973120 00000100:00100000:2.0:1788834962.836964:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788834962.836969:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:6485:x1875729253973120:12345-0@lo:501: 00000100:00100000:2.0:1788834962.837038:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:6485:x1875729253973120:12345-0@lo:501: Request processed in 69us (116us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788834962.837045:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788834962.837078:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9309f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253973120:0@lo:501: 10000000:01000000:2.0:1788834962.837098:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788834962.837103:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdc204b000/0xdf60171e5a5d1aef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1af6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834962.837110:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdc204b000/0xdf60171e5a5d1aef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1af6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788834962.837778:0:9812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 204879460978ns, next at 0ns, rc = 0 00080000:00080000:3.0:1788834962.837786:0:9812:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000001:00100000:0.0:1788834962.840293:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788834962.840426:0:8412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83743b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0001-mdtlov_UUID+5:9803:x1875729253971072:12345-0@lo:700: Request processed in 63666us (68767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834962.840442:0:8412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788834962.840499:0:9803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83741500 x1875729253971072/t0(0) o700->lustre-OST0001-osc-MDT0001@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788834978 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834962.840523:0:9803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83741500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9803:1875729253971072:0@lo:700: 00000100:00100000:2.0:1788834962.850770:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253973248:0@lo:13: 00000100:00100000:2.0:1788834962.850839:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834962.850902:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253973248 00000100:00100000:2.0:1788834962.850908:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253973248 00000100:00100000:2.0:1788834962.850962:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788834962.850970:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb930aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875729253973248:12345-0@lo:13: 00002000:00000024:2.0:1788834962.852211:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1788834962.852290:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb930aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875729253973248:12345-0@lo:13: Request processed in 1318us (1448us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.852300:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1788834962.852349:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1788834962.852387:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb9309f80 x1875729253973248/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834962.852407:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9309f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253973248:0@lo:13: 00000004:00080000:2.0:1788834962.852432:0:9813:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788834962.852457:0:9813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9309f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9813:1875729253973376:0@lo:7: 00000100:00100000:2.0:1788834962.852490:0:9813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834962.852516:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253973376 00000100:00100000:2.0:1788834962.852521:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253973376 00000100:00100000:2.0:1788834962.852557:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788834962.852565:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9813:x1875729253973376:12345-0@lo:7: 00000004:00080000:0.0:1788834962.855441:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:1.0:1788834962.855552:0:9803:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788834962.855578:0:9803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83740380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9803:1875729253973632:0@lo:7: 00000100:00100000:1.0:1788834962.855639:0:9803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834962.855695:0:9803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8b5a16c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788834962.855713:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253973504:0@lo:13: 00000100:00100000:1.0:1788834962.855738:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834962.855850:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253973504 00000100:00100000:2.0:1788834962.855859:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253973504 00000100:00100000:2.0:1788834962.855898:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788834962.855907:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253973504:12345-0@lo:13: 00002000:00000024:2.0:1788834962.855932:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923947520 avail 3692425216 00000100:00100000:2.0:1788834962.855975:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83743480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253973504:12345-0@lo:13: Request processed in 69us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.855983:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1788834962.856140:0:8402:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788834962.856148:0:8402:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00010000:00080000:1.0:1788834962.857175:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83740700 x1875729253973504/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834978 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834962.857198:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83740700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253973504:0@lo:13: 00000100:00100000:1.0:1788834962.857371:0:9813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788834962.858046:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253973632 00000100:00100000:0.0:1788834962.858125:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253973632 00000100:00100000:1.0:1788834962.858591:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788834962.858604:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9803:x1875729253973632:12345-0@lo:7: 00002000:00080000:2.0:1788834962.864505:0:8403:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1788834962.864513:0:8403:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788834962.864600:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:9813:x1875729253973376:12345-0@lo:7: Request processed in 12031us (12104us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834962.864611:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:2.0:1788834962.864667:0:9813:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb9309f80 x1875729253973376/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788834978 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834962.864682:0:9813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9309f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9813:1875729253973376:0@lo:7: 00000004:00080000:2.0:1788834962.864698:0:9813:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1788834962.864734:0:9813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9813:1875729253973760:0@lo:5: 00000100:00100000:2.0:1788834962.864765:0:9813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834962.864794:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253973760 00000100:00100000:2.0:1788834962.864800:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253973760 00000100:00100000:2.0:1788834962.864833:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788834962.864841:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:9813:x1875729253973760:12345-0@lo:5: 00002000:00080000:2.0:1788834962.864865:0:8402:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1788834962.864868:0:8402:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1788834962.870435:0:9813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd84f190c0 going to sleep for 11 seconds 00002000:00080000:1.0:1788834962.880390:0:9814:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788834962.880399:0:9814:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788834962.880486:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83740e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:9803:x1875729253973632:12345-0@lo:7: Request processed in 21882us (24843us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834962.880497:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1788834962.880547:0:9803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83740380 x1875729253973632/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788834978 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834962.880562:0:9803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83740380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9803:1875729253973632:0@lo:7: 00000004:00080000:1.0:1788834962.880576:0:9803:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788834962.880612:0:9803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83740380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9803:1875729253973888:0@lo:5: 00000100:00100000:1.0:1788834962.880644:0:9803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834962.880676:0:9803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82c420c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788834962.880694:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253973888 00000100:00100000:1.0:1788834962.880700:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253973888 00000100:00100000:1.0:1788834962.880741:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788834962.880750:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9803:x1875729253973888:12345-0@lo:5: 00002000:00080000:1.0:1788834962.880773:0:8405:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 1 -> diff = 0 00000100:00100000:1.0:1788834962.880809:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83740700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9803:x1875729253973888:12345-0@lo:5: Request processed in 60us (165us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834962.880815:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1788834962.880839:0:9803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83740380 x1875729253973888/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788834978 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834962.880849:0:9803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83740380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9803:1875729253973888:0@lo:5: 00000004:00080000:1.0:1788834962.880857:0:9803:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x1:0x0] from OST, last_created [0x2c0000400:0x1:0x0]last_used is [0x2c0000400:0x1:0x0] 00000100:00100000:1.0:1788834962.880877:0:9803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83740380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9803:1875729253974016:0@lo:5: 00000100:00100000:1.0:1788834962.880898:0:9803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834962.880910:0:9803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82c420c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788834962.880919:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253974016 00000100:00100000:1.0:1788834962.880922:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253974016 00000100:00100000:1.0:1788834962.880938:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788834962.880943:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:9803:x1875729253974016:12345-0@lo:5: 00002000:00080000:1.0:1788834962.880963:0:8405:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 2 00000100:00100000:1.0:1788834962.882518:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83741c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:9803:x1875729253974016:12345-0@lo:5: Request processed in 1569us (1614us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1788834962.882528:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1788834962.882618:0:9803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83740380 x1875729253974016/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788834978 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834962.882633:0:9803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83740380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:9803:1875729253974016:0@lo:5: 00000004:00080000:1.0:1788834962.882645:0:9803:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x1:0x0]-[0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788834962.882677:0:9803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83740000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9803:1875729253974144:0@lo:900: 00000100:00100000:1.0:1788834962.882709:0:9803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834962.882729:0:9803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd98a0b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788834962.883059:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253974144 00000100:00100000:3.0:1788834962.883067:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253974144 00000100:00100000:3.0:1788834962.883108:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788834962.883116:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9803:x1875729253974144:12345-0@lo:900: 00000100:00100000:3.0:1788834962.883170:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83741f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:9803:x1875729253974144:12345-0@lo:900: Request processed in 55us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834962.883177:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1788834962.887627:0:9803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83740000 x1875729253974144/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788834978 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834962.887662:0:9803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83740000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:9803:1875729253974144:0@lo:900: 00000001:00080000:2.0:1788834962.889223:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1788834962.889242:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:1.0:1788834962.889791:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:9813:x1875729253973760:12345-0@lo:5: Request processed in 24945us (25020us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1788834962.889802:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788834962.893000:0:9813:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8345f100 x1875729253973760/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788834978 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834962.893016:0:9813:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1788834962.893042:0:9813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9813:1875729253973760:0@lo:5: 00000004:00080000:2.0:1788834962.893176:0:9813:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1788834962.893297:0:9813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9813:1875729253974272:0@lo:700: 00000100:00100000:2.0:1788834962.893436:0:9813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834962.893508:0:9813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd84f190c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788834962.898519:0:8411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253974272 00000100:00100000:1.0:1788834962.898535:0:8411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253974272 00000100:00100000:1.0:1788834962.898605:0:8411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788834962.898614:0:8411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9813:x1875729253974272:12345-0@lo:700: 00000001:00080000:0.0:1788834962.908623:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:1.0:1788834962.908864:0:8411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:9813:x1875729253974272:12345-0@lo:700: Request processed in 10247us (15424us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834962.908886:0:8411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1788834962.909029:0:9813:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8345f100 x1875729253974272/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1788834978 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834962.909044:0:9813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345f100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9813:1875729253974272:0@lo:700: 00000004:02000040:2.0:1788834962.916965:0:9813:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x2c0000401 00010000:00010000:0.0:1788834962.918489:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788834962.922154:0:9813:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9813:1875729253974400:0@lo:5: 00000100:00100000:2.0:1788834962.922222:0:9813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834962.922375:0:9813:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd84f19180 going to sleep for 11 seconds 00000100:00100000:1.0:1788834962.924432:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253974400 00000100:00100000:1.0:1788834962.924446:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253974400 00000100:00100000:1.0:1788834962.924512:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1788834962.924522:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:9813:x1875729253974400:12345-0@lo:5: 00002000:00080000:1.0:1788834962.935208:0:8405:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:1.0:1788834962.935232:0:8405:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 2 00000100:00100000:1.0:1788834962.944760:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:9813:x1875729253974400:12345-0@lo:5: Request processed in 20230us (22529us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1788834962.944777:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1788834962.944819:0:9813:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8345df80 x1875729253974400/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788834978 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834962.944961:0:9813:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345df80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:9813:1875729253974400:0@lo:5: 00000004:00080000:2.0:1788834962.944977:0:9813:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x1:0x0]-[0x2c0000401:0x21:0x0] 00000001:02000400:3.0:1788834963.448551:0:9856:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1788834963.942598:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788834964.262251:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788834964.262290:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253974528:0@lo:41: 00000100:00100000:2.0:1788834964.262385:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834964.262669:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253974528 00000100:00100000:0.0:1788834964.262678:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253974528 00000100:00100000:0.0:1788834964.262730:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788834964.262740:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253974528:12345-0@lo:41: 00000004:00000024:0.0:1788834964.262773:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:0.0:1788834964.262823:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253974528:12345-0@lo:41: Request processed in 84us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834964.262830:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788834964.262916:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253974528:0@lo:41: 00000020:00000004:1.0:1788834964.516149:0:9908:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788834964.516792:0:9908:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788834964.969671:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788834965.491534:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00010000:00010000:0.0:1788834965.989585:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788834967.013575:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788834967.677591:0:10009:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788834967.677851:0:10009:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788834967.851240:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788834967.851277:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253974656:0@lo:41: 00000100:00100000:2.0:1788834967.851393:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834967.852102:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253974656 00000100:00100000:0.0:1788834967.852114:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253974656 00000100:00100000:0.0:1788834967.852182:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788834967.852193:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253974656:12345-0@lo:41: 00000004:00000024:0.0:1788834967.852236:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788834967.852307:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9309f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253974656:12345-0@lo:41: Request processed in 115us (914us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834967.852355:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788834967.852413:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253974656:0@lo:41: 00000100:00100000:3.0:1788834967.861946:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253974784:0@lo:13: 00000100:00100000:3.0:1788834967.862075:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834967.862175:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253974784 00000100:00100000:3.0:1788834967.862186:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253974784 00000100:00100000:3.0:1788834967.862249:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788834967.862259:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253974784:12345-0@lo:13: 00002000:00000024:3.0:1788834967.862297:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788834967.862374:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba369880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253974784:12345-0@lo:13: Request processed in 115us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834967.862381:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1788834967.862407:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788834967.862441:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb90f9500 x1875729253974784/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834967.862595:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253974912:0@lo:13: 00000100:00100000:1.0:1788834967.862628:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834967.862927:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729253975424:0@lo:400: 00000100:00100000:1.0:1788834967.862970:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834967.862996:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788834967.863002:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdaaf3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253975040:0@lo:400: 00000100:00100000:1.0:1788834967.863033:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834967.863059:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729253975552:0@lo:400: 00000100:00100000:1.0:1788834967.863082:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834967.863123:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253975424 00000100:00100000:1.0:1788834967.863128:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253975424 00000100:00100000:1.0:1788834967.863165:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253975552 00000100:00100000:1.0:1788834967.863168:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253975552 00000100:00100000:1.0:1788834967.863192:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788834967.863200:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729253975424:12345-0@lo:400: 00000100:00100000:1.0:1788834967.863246:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83743100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729253975424:12345-0@lo:400: Request processed in 47us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834967.863253:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788834967.863269:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788834967.863275:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729253975552:12345-0@lo:400: 00000100:00100000:1.0:1788834967.863302:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83742d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729253975552:12345-0@lo:400: Request processed in 27us (219us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834967.863307:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1788834967.863368:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36f480 x1875729253975552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834967.863382:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729253975552:0@lo:400: 00010000:00080000:1.0:1788834967.863392:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36ce00 x1875729253975424/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834967.863414:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729253975424:0@lo:400: 00000100:00100000:3.0:1788834967.863574:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253974784:0@lo:13: 00000100:00100000:1.0:1788834967.863795:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729253975936:0@lo:400: 00000100:00100000:1.0:1788834967.863827:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834967.863905:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253975296:0@lo:400: 00000100:00100000:3.0:1788834967.863939:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834967.863972:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729253975808:0@lo:400: 00000100:00100000:3.0:1788834967.863994:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834967.864012:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788834967.864018:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdaaf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729253975168:0@lo:400: 00000100:00100000:3.0:1788834967.864041:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834967.864057:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875729253975680:0@lo:400: 00000100:00100000:3.0:1788834967.864077:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834967.868396:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253976064:0@lo:400: 00000100:00100000:3.0:1788834967.868508:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834967.868585:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253974912 00000100:00100000:3.0:1788834967.868613:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253974912 00000100:00100000:3.0:1788834967.868685:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788834967.868695:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729253974912:12345-0@lo:13: 00002000:00000024:3.0:1788834967.868726:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788834967.869746:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253976064 00000100:00100000:0.0:1788834967.869759:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253976064 00000100:00100000:0.0:1788834967.869903:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788834967.869916:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253976064:12345-0@lo:400: 00000100:00100000:2.0:1788834967.870598:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253975040 00000100:00100000:2.0:1788834967.870607:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253975040 00000100:00100000:2.0:1788834967.870654:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1788834967.870664:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3614:x1875729253975040:12345-0@lo:400: 00000100:00100000:2.0:1788834967.870779:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3614:x1875729253975040:12345-0@lo:400: Request processed in 116us (7743us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834967.870787:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1788834967.870916:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253976064:12345-0@lo:400: Request processed in 1004us (2407us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834967.870925:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1788834967.871667:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36ea00 x1875729253976064/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788834983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834967.871682:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1788834967.871704:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253976064:0@lo:400: 00000100:00100000:0.0:1788834967.871843:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253975936 00000100:00100000:0.0:1788834967.871851:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253975936 00000100:00100000:0.0:1788834967.871893:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253975808 00000100:00100000:0.0:1788834967.871896:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253975808 00000100:00100000:0.0:1788834967.871913:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253975168 00000100:00100000:0.0:1788834967.871916:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253975168 00000100:00100000:0.0:1788834967.871928:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253975680 00000100:00100000:0.0:1788834967.871930:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253975680 00000100:00100000:0.0:1788834967.871947:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788834967.871964:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729253975936:12345-0@lo:400: 00000100:00100000:0.0:1788834967.872034:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83740a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729253975936:12345-0@lo:400: Request processed in 80us (8205us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834967.872041:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788834967.872056:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788834967.872062:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729253975808:12345-0@lo:400: 00000100:00100000:0.0:1788834967.872490:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729253975808:12345-0@lo:400: Request processed in 426us (8493us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834967.872498:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788834967.872531:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788834967.872538:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729253975168:12345-0@lo:400: 00000100:00100000:0.0:1788834967.872576:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba369500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729253975168:12345-0@lo:400: Request processed in 39us (8534us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834967.872581:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788834967.872594:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1788834967.872601:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875729253975680:12345-0@lo:400: 00000100:00100000:0.0:1788834967.872628:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875729253975680:12345-0@lo:400: Request processed in 28us (8549us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834967.872634:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1788834967.872660:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788834967.872665:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788834967.872669:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788834967.872673:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788834967.872695:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253976192:0@lo:400: 00000100:00100000:0.0:1788834967.872739:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834967.874304:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253976192 00000100:00100000:2.0:1788834967.874348:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253976192 00000100:00100000:2.0:1788834967.874447:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788834967.874458:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253976192:12345-0@lo:400: 00000100:00100000:2.0:1788834967.874569:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253976192:12345-0@lo:400: Request processed in 113us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834967.874578:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1788834967.874633:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36d180 x1875729253976192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788834983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834967.874646:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967299 gen 2 00000100:00100000:2.0:1788834967.874666:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253976192:0@lo:400: 00000100:00080000:0.0:1788834967.874800:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788834967.876234:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253975296 00000100:00100000:0.0:1788834967.876250:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253975296 00000100:00100000:0.0:1788834967.876355:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788834967.876366:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253975296:12345-0@lo:400: 00000100:00100000:0.0:1788834967.876478:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253975296:12345-0@lo:400: Request processed in 113us (12536us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834967.876485:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788834967.876788:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729253974912:12345-0@lo:13: Request processed in 8092us (14157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834967.876799:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1788834967.876860:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdaaf3ce00 x1875729253975168/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834967.876877:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdaaf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729253975168:0@lo:400: 00010000:00080000:3.0:1788834967.876891:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36dc00 x1875729253975680/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834967.876900:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875729253975680:0@lo:400: 00000100:00100000:3.0:1788834967.876912:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253975296:0@lo:400: 00010000:00080000:3.0:1788834967.876926:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36c000 x1875729253975808/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834967.876934:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729253975808:0@lo:400: 00010000:00080000:1.0:1788834967.876985:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83740000 x1875729253974912/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834983 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834967.877010:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253974912:0@lo:13: 00010000:00080000:1.0:1788834967.877040:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36df80 x1875729253975936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834983 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834967.877050:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729253975936:0@lo:400: 00000100:00100000:1.0:1788834967.877063:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdaaf3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253975040:0@lo:400: 00010000:00010000:1.0:1788834968.041363:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788834968.357549:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253976320:0@lo:13: 00000100:00100000:3.0:1788834968.357650:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834968.357879:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253976320 00000100:00100000:1.0:1788834968.357890:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253976320 00000100:00100000:1.0:1788834968.357964:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788834968.357975:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253976320:12345-0@lo:13: 00002000:00000024:1.0:1788834968.358013:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788834968.358110:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253976320:12345-0@lo:13: Request processed in 137us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834968.358119:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:2.0:1788834968.360726:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83740000 x1875729253976320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834968.360837:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253976320:0@lo:13: 00000100:00100000:1.0:1788834968.365908:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788834968.365940:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253976448:0@lo:13: 00000100:00100000:1.0:1788834968.366072:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834968.366150:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253976448 00000100:00100000:1.0:1788834968.366158:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253976448 00000100:00100000:1.0:1788834968.366229:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788834968.366238:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253976448:12345-0@lo:13: 00002000:00000024:1.0:1788834968.366266:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788834968.366332:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83740380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253976448:12345-0@lo:13: Request processed in 75us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834968.366340:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1788834968.366388:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83740000 x1875729253976448/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834968.366410:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253976448:0@lo:13: 00000020:00000004:3.0:1788834968.970344:0:10057:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788834968.970359:0:10057:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=c0185879 00010000:00010000:0.0:1788834969.068018:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788834969.381633:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253976576:0@lo:41: 00000100:00100000:2.0:1788834969.381734:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834969.381875:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253976576 00000100:00100000:1.0:1788834969.381885:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253976576 00000100:00100000:1.0:1788834969.381958:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788834969.381970:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253976576:12345-0@lo:41: 00000004:00000024:1.0:1788834969.382023:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446322176 avail 1300082688 00000100:00100000:1.0:1788834969.382091:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253976576:12345-0@lo:41: Request processed in 123us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834969.382100:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1788834969.382160:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83740000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253976576:0@lo:41: 00000100:00100000:1.0:1788834969.693804:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834969.694664:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242390656 00000100:00100000:3.0:1788834969.694691:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242390656 00000100:00100000:3.0:1788834969.694760:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 181 00000100:00100000:3.0:1788834969.694791:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2384:x1875729242390656:12345-192.168.203.22@tcp:250: 00010000:00080000:3.0:1788834969.694831:0:6482:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from e8f7875b-4951-482c-9de0-d3888250010c@192.168.203.22@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:3.0:1788834969.694871:0:6482:0:(genops.c:1385:class_connect()) connect: client e8f7875b-4951-482c-9de0-d3888250010c, cookie 0xdf60171e5a5d1afd 00000100:00080000:3.0:1788834969.695059:0:6482:0:(import.c:65:import_set_state_nolock()) ffff9afc837f1800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788834969.695211:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+5:2384:x1875729242390656:12345-192.168.203.22@tcp:250: Request processed in 419us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834969.695219:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 181 00000100:00100000:1.0:1788834969.711417:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834969.711885:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242390784 00000100:00100000:2.0:1788834969.711918:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242390784 00000100:00100000:2.0:1788834969.712004:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 182 00000100:00100000:2.0:1788834969.712018:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+5:6146:x1875729242390784:12345-192.168.203.22@tcp:101: 00010000:00010000:2.0:1788834969.712040:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788834969.712063:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1b04 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0372 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834969.712105:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0372 expref: 6 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834969.712119:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0372 expref: 6 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834969.712130:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e63800, rc 0) 00000100:00100000:2.0:1788834969.712218:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+6:6146:x1875729242390784:12345-192.168.203.22@tcp:101: Request processed in 204us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834969.712226:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 182 00000100:00100000:0.0:1788834969.716179:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834969.716371:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242390912 00000100:00100000:2.0:1788834969.716387:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242390912 00000100:00100000:2.0:1788834969.716460:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 183 00000100:00100000:2.0:1788834969.716473:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+6:6146:x1875729242390912:12345-192.168.203.22@tcp:501: 00000100:00100000:2.0:1788834969.716807:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+6:6146:x1875729242390912:12345-192.168.203.22@tcp:501: Request processed in 336us (641us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788834969.716816:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 183 00000100:00100000:1.0:1788834969.733027:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834969.737366:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242391040 00000100:00100000:3.0:1788834969.737388:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242391040 00000100:00100000:3.0:1788834969.737548:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 184 00000100:00100000:3.0:1788834969.737562:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+6:6146:x1875729242391040:12345-192.168.203.22@tcp:101: 00010000:00010000:3.0:1788834969.737588:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788834969.737615:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1b0b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0379 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834969.737653:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0379 expref: 7 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834969.737677:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0379 expref: 7 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834969.737689:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204ae00, rc 0) 00000100:00100000:3.0:1788834969.737788:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+7:6146:x1875729242391040:12345-192.168.203.22@tcp:101: Request processed in 230us (4776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834969.737796:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 184 00000100:00100000:1.0:1788834969.742854:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834969.743051:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242391168 00000100:00100000:2.0:1788834969.743066:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242391168 00000100:00100000:2.0:1788834969.743138:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 185 00000100:00100000:2.0:1788834969.743150:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+7:6146:x1875729242391168:12345-192.168.203.22@tcp:501: 00000100:00100000:2.0:1788834969.743613:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+8:6146:x1875729242391168:12345-192.168.203.22@tcp:501: Request processed in 462us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834969.743623:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 185 00000100:00100000:1.0:1788834969.753478:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834969.753861:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242391296 00000100:00100000:3.0:1788834969.753875:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242391296 00000100:00100000:3.0:1788834969.753989:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 186 00000100:00100000:3.0:1788834969.754002:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+8:6146:x1875729242391296:12345-192.168.203.22@tcp:503: 00000100:00100000:3.0:1788834969.754201:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+8:6146:x1875729242391296:12345-192.168.203.22@tcp:503: Request processed in 191us (729us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834969.754210:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 186 00000100:00100000:1.0:1788834969.772933:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788834969.773296:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242391424 00000100:00100000:0.0:1788834969.773311:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242391424 00000100:00100000:0.0:1788834969.773450:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 187 00000100:00100000:0.0:1788834969.773462:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+8:6164:x1875729242391424:12345-192.168.203.22@tcp:502: 00000100:00100000:0.0:1788834969.773905:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+8:6164:x1875729242391424:12345-192.168.203.22@tcp:502: Request processed in 441us (984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834969.773915:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 187 00000100:00100000:1.0:1788834969.821548:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834969.821670:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242391552 00000100:00100000:2.0:1788834969.821683:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242391552 00000100:00100000:2.0:1788834969.821750:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 188 00000100:00100000:2.0:1788834969.821761:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+8:6164:x1875729242391552:12345-192.168.203.22@tcp:502: 00000100:00100000:2.0:1788834969.821997:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+8:6164:x1875729242391552:12345-192.168.203.22@tcp:502: Request processed in 236us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834969.822005:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 188 00000100:00100000:1.0:1788834969.836965:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788834969.838557:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242391680 00000100:00100000:0.0:1788834969.838577:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242391680 00000100:00100000:0.0:1788834969.838668:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 189 00000100:00100000:0.0:1788834969.838680:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+8:6146:x1875729242391680:12345-192.168.203.22@tcp:101: 00010000:00010000:0.0:1788834969.838704:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788834969.838729:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd80031200/0xdf60171e5a5d1b12 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae03aa expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834969.838769:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd80031200/0xdf60171e5a5d1b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03aa expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834969.838783:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd80031200/0xdf60171e5a5d1b12 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03aa expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834969.838795:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd80031200, rc 0) 00000100:00100000:0.0:1788834969.838900:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+9:6146:x1875729242391680:12345-192.168.203.22@tcp:101: Request processed in 211us (1949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834969.838908:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 189 00000100:00100000:1.0:1788834969.850267:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834969.850426:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242391808 00000100:00100000:3.0:1788834969.850440:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242391808 00000100:00100000:3.0:1788834969.850515:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 190 00000100:00100000:3.0:1788834969.850527:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+9:6146:x1875729242391808:12345-192.168.203.22@tcp:256: 20000000:01000000:3.0:1788834969.850563:0:6482:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788834969.850597:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788834969.850602:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788834969.850606:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788834969.850609:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788834969.850611:0:6482:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788834969.852596:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+9:6146:x1875729242391808:12345-192.168.203.22@tcp:256: Request processed in 2056us (2330us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834969.852614:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 190 00000100:00100000:1.0:1788834969.862467:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834969.862622:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242391936 00000100:00100000:2.0:1788834969.862636:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242391936 00000100:00100000:2.0:1788834969.862708:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 191 00000100:00100000:2.0:1788834969.862720:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+9:6146:x1875729242391936:12345-192.168.203.22@tcp:101: 00010000:00010000:2.0:1788834969.862740:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788834969.862762:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e62200/0xdf60171e5a5d1b19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae03b1 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834969.862800:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e62200/0xdf60171e5a5d1b19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03b1 expref: 10 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834969.862813:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e62200/0xdf60171e5a5d1b19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03b1 expref: 10 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834969.862824:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e62200, rc 0) 00000100:00100000:2.0:1788834969.862895:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+10:6146:x1875729242391936:12345-192.168.203.22@tcp:101: Request processed in 177us (443us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834969.862912:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 191 00000100:00100000:1.0:1788834969.870667:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834969.870775:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242392064 00000100:00100000:3.0:1788834969.870790:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242392064 00000100:00100000:3.0:1788834969.870863:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 192 00000100:00100000:3.0:1788834969.870875:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+10:6146:x1875729242392064:12345-192.168.203.22@tcp:501: 00000100:00100000:3.0:1788834969.871123:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+10:6146:x1875729242392064:12345-192.168.203.22@tcp:501: Request processed in 250us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834969.871132:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 192 00000100:00100000:1.0:1788834969.873453:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788834969.873565:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242392192 00000100:00100000:0.0:1788834969.873578:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242392192 00000100:00100000:0.0:1788834969.873651:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 193 00000100:00100000:0.0:1788834969.873662:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+10:6146:x1875729242392192:12345-192.168.203.22@tcp:503: 00000100:00100000:0.0:1788834969.873872:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+10:6146:x1875729242392192:12345-192.168.203.22@tcp:503: Request processed in 211us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834969.873881:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 193 00000100:00100000:1.0:1788834969.888804:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834969.888956:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242392320 00000100:00100000:2.0:1788834969.888969:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242392320 00000100:00100000:2.0:1788834969.889179:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 194 00000100:00100000:2.0:1788834969.889192:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+10:6168:x1875729242392320:12345-192.168.203.22@tcp:502: 00000100:00100000:2.0:1788834969.889745:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+10:6168:x1875729242392320:12345-192.168.203.22@tcp:502: Request processed in 552us (953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834969.889756:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 194 00000100:00100000:1.0:1788834969.895719:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834969.897060:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242392448 00000100:00100000:3.0:1788834969.897079:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242392448 00000100:00100000:3.0:1788834969.898103:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 195 00000100:00100000:3.0:1788834969.898134:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+10:6168:x1875729242392448:12345-192.168.203.22@tcp:502: 00000100:00100000:3.0:1788834969.898443:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+10:6168:x1875729242392448:12345-192.168.203.22@tcp:502: Request processed in 319us (2735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834969.898453:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 195 00000100:00100000:1.0:1788834969.905409:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788834969.905465:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788834969.905554:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242392576 00000100:00100000:0.0:1788834969.905567:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242392576 00000100:00100000:0.0:1788834969.905625:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242392832 00000100:00100000:0.0:1788834969.905629:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242392832 00000100:00100000:0.0:1788834969.905651:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:0.0:1788834969.905660:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:2384:x1875729242392576:12345-192.168.203.22@tcp:38: 00010000:00080000:0.0:1788834969.905700:0:9806:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:0.0:1788834969.905767:0:9806:0:(genops.c:1385:class_connect()) connect: client b8987b33-76f7-43a0-9448-1013c4af787f, cookie 0xdf60171e5a5d1b20 00000004:00100000:0.0:1788834969.905802:0:9806:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788834969.906155:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:1.0:1788834969.906163:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2384:x1875729242392832:12345-192.168.203.22@tcp:38: 00010000:00080000:1.0:1788834969.906182:0:6487:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp t0 exp 0000000000000000 cur 211 last 0 00000020:00000080:1.0:1788834969.906229:0:6487:0:(genops.c:1385:class_connect()) connect: client b8987b33-76f7-43a0-9448-1013c4af787f, cookie 0xdf60171e5a5d1b27 00000004:00100000:1.0:1788834969.906255:0:6487:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788834969.907879:0:9806:0:(import.c:65:import_set_state_nolock()) ffff9afc8337c800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788834969.908036:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83740000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+6:2384:x1875729242392576:12345-192.168.203.22@tcp:38: Request processed in 2365us (2630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834969.908049:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00080000:1.0:1788834969.908590:0:6487:0:(import.c:65:import_set_state_nolock()) ffff9afc8369a000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788834969.908667:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+6:2384:x1875729242392832:12345-192.168.203.22@tcp:38: Request processed in 2501us (3199us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834969.908678:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00010000:00010000:3.0:1788834970.085835:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788834970.926924:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788834970.926973:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788834970.927065:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834970.927152:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242393088 00000100:00100000:2.0:1788834970.927163:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242393088 00000100:00100000:2.0:1788834970.927236:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242392960 00000100:00100000:2.0:1788834970.927240:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242392960 00000100:00100000:2.0:1788834970.927260:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242392704 00000100:00100000:2.0:1788834970.927263:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242392704 00000100:00100000:2.0:1788834970.927288:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1788834970.927298:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+7:6146:x1875729242393088:12345-192.168.203.22@tcp:41: 00000004:00000024:2.0:1788834970.927361:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788834970.927429:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+7:6146:x1875729242393088:12345-192.168.203.22@tcp:41: Request processed in 131us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834970.927438:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:3.0:1788834970.927460:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:3.0:1788834970.927475:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+6:0:x1875729242392960:12345-192.168.203.22@tcp:41: 00000004:00000024:3.0:1788834970.927498:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00080000:1.0:1788834970.927498:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788834970.927505:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788834970.927590:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+6:0:x1875729242392960:12345-192.168.203.22@tcp:41: Request processed in 121us (616us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834970.935160:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:2.0:1788834970.935190:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+6:0:x1875729242392704:12345-192.168.203.22@tcp:41: 00000004:00000024:2.0:1788834970.935229:0:6489:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:2.0:1788834970.935299:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+6:0:x1875729242392704:12345-192.168.203.22@tcp:41: Request processed in 125us (8232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834970.935308:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:3.0:1788834970.943403:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:0.0:1788834970.945104:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834970.948739:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242393216 00000100:00100000:2.0:1788834970.948754:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242393216 00000100:00100000:2.0:1788834970.948828:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:2.0:1788834970.948838:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+6:6146:x1875729242393216:12345-192.168.203.22@tcp:40: 00000100:00100000:2.0:1788834970.948947:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+6:6146:x1875729242393216:12345-192.168.203.22@tcp:40: Request processed in 110us (3849us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834970.948955:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:2.0:1788834970.956208:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834970.956251:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834970.956373:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834970.956406:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834970.956436:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242393728 00000100:00100000:2.0:1788834970.956444:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242393728 00000100:00100000:2.0:1788834970.956492:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 196 00000100:00100000:2.0:1788834970.956502:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+10:2386:x1875729242393728:12345-192.168.203.22@tcp:400: 00000100:00100000:2.0:1788834970.956567:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+10:2386:x1875729242393728:12345-192.168.203.22@tcp:400: Request processed in 66us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834970.956575:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 196 00000100:00100000:1.0:1788834970.956811:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242393344 00000100:00100000:1.0:1788834970.956816:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242393344 00000100:00100000:1.0:1788834970.956843:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242393472 00000100:00100000:1.0:1788834970.956846:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242393472 00000100:00100000:1.0:1788834970.956865:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:1.0:1788834970.956870:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2384:x1875729242393344:12345-192.168.203.22@tcp:8: 00010000:00080000:1.0:1788834970.956903:0:8402:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:1.0:1788834970.956957:0:8402:0:(genops.c:1385:class_connect()) connect: client b8987b33-76f7-43a0-9448-1013c4af787f, cookie 0xdf60171e5a5d1b2e 00002000:00100000:1.0:1788834970.956969:0:8402:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b8987b33-76f7-43a0-9448-1013c4af787f/ffff9afc83699000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788834970.956987:0:8402:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:0.0:1788834970.957025:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:0.0:1788834970.957033:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2384:x1875729242393472:12345-192.168.203.22@tcp:8: 00010000:00080000:0.0:1788834970.957054:0:9814:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:0.0:1788834970.957077:0:9814:0:(genops.c:1385:class_connect()) connect: client b8987b33-76f7-43a0-9448-1013c4af787f, cookie 0xdf60171e5a5d1b35 00002000:00100000:0.0:1788834970.957086:0:9814:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b8987b33-76f7-43a0-9448-1013c4af787f/ffff9afc8337f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788834970.957099:0:9814:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788834970.957190:0:8402:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788834970.957219:0:8402:0:(import.c:65:import_set_state_nolock()) ffff9afc8369e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788834970.957264:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+6:2384:x1875729242393344:12345-192.168.203.22@tcp:8: Request processed in 391us (1011us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834970.957272:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00002000:00080000:0.0:1788834970.957298:0:9814:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788834970.957342:0:9814:0:(import.c:65:import_set_state_nolock()) ffff9afc8337e800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788834970.957380:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+6:2384:x1875729242393472:12345-192.168.203.22@tcp:8: Request processed in 346us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834970.957388:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:3.0:1788834970.957730:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242393600 00000100:00100000:3.0:1788834970.957735:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242393600 00000100:00100000:3.0:1788834970.957812:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:3.0:1788834970.957820:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b8987b33-76f7-43a0-9448-1013c4af787f+6:6146:x1875729242393600:12345-192.168.203.22@tcp:900: 00000100:00100000:3.0:1788834970.957918:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b8987b33-76f7-43a0-9448-1013c4af787f+6:6146:x1875729242393600:12345-192.168.203.22@tcp:900: Request processed in 99us (1730us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834970.957925:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:2.0:1788834970.965609:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834970.965749:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242393856 00000100:00100000:3.0:1788834970.965759:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242393856 00000100:00100000:3.0:1788834970.965811:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:3.0:1788834970.965822:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+6:6146:x1875729242393856:12345-192.168.203.22@tcp:33: 00000004:00080000:3.0:1788834971.002968:0:6490:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 37052us 00000004:00200000:0.0:1788834971.036854:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788834971.037037:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+6:6146:x1875729242393856:12345-192.168.203.22@tcp:33: Request processed in 71212us (71430us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834971.037052:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00010000:00010000:1.0:1788834971.109474:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788834971.225057:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834971.225167:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242393984 00000100:00100000:2.0:1788834971.225177:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242393984 00000100:00100000:2.0:1788834971.225241:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:2.0:1788834971.225252:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+6:6186:x1875729242393984:12345-192.168.203.22@tcp:101: 00010000:00010000:2.0:1788834971.225271:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788834971.225308:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1b3c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae03e2 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834971.225432:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1b43 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834971.225445:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1b43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834971.225459:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1b43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788834971.225504:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788834971.225508:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788834971.225523:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1b43 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834971.225548:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1b3c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03e2 expref: 8 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834971.225565:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1b43 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03e2 expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834971.225579:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc835c9c00) 00010000:00010000:2.0:1788834971.225582:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788834971.225585:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e62a00, rc 0) 00000100:00100000:2.0:1788834971.225645:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83108a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+7:6186:x1875729242393984:12345-192.168.203.22@tcp:101: Request processed in 396us (596us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834971.225652:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00010000:00010000:0.0:1788834972.133804:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788834972.965633:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788834972.965661:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253976704:0@lo:41: 00000100:00100000:2.0:1788834972.965749:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834972.965792:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253976704 00000100:00100000:1.0:1788834972.965800:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253976704 00000100:00100000:2.0:1788834972.965817:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253976832:0@lo:13: 00000100:00100000:1.0:1788834972.965849:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788834972.965860:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834972.965863:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253976704:12345-0@lo:41: 00000004:00000024:1.0:1788834972.965910:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788834972.965931:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253976960:0@lo:13: 00000100:00100000:2.0:1788834972.965968:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834972.965985:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253976704:12345-0@lo:41: Request processed in 126us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834972.965994:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788834972.966021:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253976832 00000100:00100000:1.0:1788834972.966022:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253976960 00000100:00100000:2.0:1788834972.966027:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253976832 00000100:00100000:1.0:1788834972.966028:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253976960 00000100:00100000:2.0:1788834972.966063:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788834972.966071:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253976832:12345-0@lo:13: 00002000:00000024:2.0:1788834972.966092:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788834972.966120:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253976832:12345-0@lo:13: Request processed in 51us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834972.966127:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788834972.966775:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1788834972.966784:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729253976960:12345-0@lo:13: 00002000:00000024:1.0:1788834972.966797:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788834972.966839:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729253976960:12345-0@lo:13: Request processed in 56us (871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834972.966846:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1788834972.966884:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83108700 x1875729253976960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834972.967068:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729253977088:0@lo:400: 00000100:00100000:0.0:1788834972.967104:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834972.967129:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875729253977600:0@lo:400: 00000100:00100000:0.0:1788834972.967154:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834972.967171:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253978112:0@lo:400: 00000100:00100000:0.0:1788834972.967192:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834972.967212:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788834972.967216:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729253977472:0@lo:400: 00000100:00100000:0.0:1788834972.967237:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834972.967251:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875729253977984:0@lo:400: 00000100:00100000:0.0:1788834972.967283:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834972.967310:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253977600 00000100:00100000:0.0:1788834972.967332:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253977600 00000100:00100000:0.0:1788834972.967365:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253977472 00000100:00100000:0.0:1788834972.967368:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253977472 00000100:00100000:0.0:1788834972.967383:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253977984 00000100:00100000:0.0:1788834972.967386:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253977984 00000100:00100000:0.0:1788834972.967401:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788834972.967409:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875729253977600:12345-0@lo:400: 00000100:00100000:0.0:1788834972.967457:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82074380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875729253977600:12345-0@lo:400: Request processed in 48us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834972.967464:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788834972.967479:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788834972.967485:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729253977472:12345-0@lo:400: 00000100:00100000:0.0:1788834972.967514:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82075180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729253977472:12345-0@lo:400: Request processed in 28us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834972.967528:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788834972.967542:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83108700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253976960:0@lo:13: 00000100:00100000:0.0:1788834972.967546:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788834972.967556:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875729253977984:12345-0@lo:400: 00000100:00100000:1.0:1788834972.967575:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253977344:0@lo:400: 00000100:00100000:0.0:1788834972.967586:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9edf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875729253977984:12345-0@lo:400: Request processed in 32us (302us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834972.967593:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1788834972.967611:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253978112 00000100:00100000:0.0:1788834972.967615:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253978112 00000100:00100000:0.0:1788834972.967642:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788834972.967649:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253978112:12345-0@lo:400: 00000100:00100000:3.0:1788834972.967832:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253977088 00000100:00100000:3.0:1788834972.967847:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253977088 00000100:00100000:3.0:1788834972.967887:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:3.0:1788834972.967893:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3615:x1875729253977088:12345-0@lo:400: 00000100:00100000:1.0:1788834972.972637:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834972.972650:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82076680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253978112:12345-0@lo:400: Request processed in 4999us (5454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834972.972664:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788834972.972691:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729253977856:0@lo:400: 00000100:00100000:0.0:1788834972.972725:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729253977216:0@lo:400: 00000100:00100000:0.0:1788834972.972760:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834972.972780:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729253977728:0@lo:400: 00000100:00100000:0.0:1788834972.972804:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834972.972824:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253978240:0@lo:400: 00000100:00100000:1.0:1788834972.972830:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788834972.972865:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83109f80 x1875729253976832/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834988 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834972.972888:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253976832:0@lo:13: 00000100:00100000:1.0:1788834972.972903:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253976704:0@lo:41: 00000100:00100000:1.0:1788834972.972950:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253977344 00000100:00100000:1.0:1788834972.972955:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253977344 00000100:00080000:2.0:1788834972.973059:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788834972.973066:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788834972.973069:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788834972.973073:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788834972.973110:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788834972.973112:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253977216 00000100:00100000:2.0:1788834972.973118:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253977216 00000100:00100000:1.0:1788834972.973123:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253977344:12345-0@lo:400: 00000100:00100000:2.0:1788834972.973144:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253977728 00000100:00100000:2.0:1788834972.973148:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253977728 00000100:00100000:2.0:1788834972.973174:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253977856 00000100:00100000:2.0:1788834972.973178:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253977856 00000100:00100000:1.0:1788834972.973185:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253977344:12345-0@lo:400: Request processed in 64us (555us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834972.973193:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788834972.973617:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253977344:0@lo:400: 00000100:00100000:1.0:1788834972.973662:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788834972.973670:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729253977216:12345-0@lo:400: 00000100:00100000:1.0:1788834972.973705:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9eea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729253977216:12345-0@lo:400: Request processed in 37us (945us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834972.973863:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788834972.973880:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788834972.973897:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729253977728:12345-0@lo:400: 00000100:00100000:1.0:1788834972.973940:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ed180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729253977728:12345-0@lo:400: Request processed in 45us (1135us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834972.973946:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788834972.973958:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788834972.973965:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729253977856:12345-0@lo:400: 00000100:00100000:1.0:1788834972.974122:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729253977856:12345-0@lo:400: Request processed in 157us (1293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834972.974128:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788834972.974158:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729253977856:0@lo:400: 00000100:00100000:1.0:1788834972.974203:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e811880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729253977472:0@lo:400: 00010000:00080000:1.0:1788834972.974450:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc82077480 x1875729253977984/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834972.974463:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875729253977984:0@lo:400: 00000100:00100000:1.0:1788834972.974477:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e813800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875729253977600:0@lo:400: 00010000:00080000:1.0:1788834972.974487:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc82075c00 x1875729253978112/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788834988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834972.974495:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253978112:0@lo:400: 00000100:00080000:1.0:1788834972.974541:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788834972.974545:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788834972.974961:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3615:x1875729253977088:12345-0@lo:400: Request processed in 7066us (7854us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834972.974971:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:0.0:1788834972.974989:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834972.975028:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729253977216:0@lo:400: 00010000:00080000:0.0:1788834972.975041:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc82077100 x1875729253977728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834972.975051:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82077100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729253977728:0@lo:400: 00000100:00100000:0.0:1788834972.975074:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253978240 00000100:00100000:0.0:1788834972.975080:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253978240 00000100:00100000:1.0:1788834972.975121:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729253977088:0@lo:400: 00000100:00100000:0.0:1788834972.975127:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788834972.975137:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253978240:12345-0@lo:400: 00000100:00080000:1.0:1788834972.975150:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788834972.975184:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ef800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253978240:12345-0@lo:400: Request processed in 49us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834972.975194:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1788834972.975195:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc82074e00 x1875729253978240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788834988 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834972.975230:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82074e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253978240:0@lo:400: 00010000:00010000:3.0:1788834973.157532:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788834973.478009:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788834973.478034:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253978368:0@lo:13: 00000100:00100000:0.0:1788834973.478099:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834973.478334:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253978368 00000100:00100000:1.0:1788834973.478343:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253978368 00000100:00100000:1.0:1788834973.478394:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788834973.478402:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253978368:12345-0@lo:13: 00002000:00000024:1.0:1788834973.478453:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788834973.478519:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ee680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253978368:12345-0@lo:13: Request processed in 117us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834973.478527:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1788834973.478742:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83109f80 x1875729253978368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834973.478761:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253978368:0@lo:13: 00000100:00100000:0.0:1788834973.479064:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788834973.479076:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253978496:0@lo:13: 00000100:00100000:0.0:1788834973.479106:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834973.479178:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253978496 00000100:00100000:1.0:1788834973.479182:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253978496 00000100:00100000:1.0:1788834973.479214:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788834973.479221:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253978496:12345-0@lo:13: 00002000:00000024:1.0:1788834973.479232:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788834973.479269:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253978496:12345-0@lo:13: Request processed in 49us (163us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834973.479276:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1788834973.479361:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8310a680 x1875729253978496/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834973.479375:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253978496:0@lo:13: 00000100:00100000:1.0:1788834973.518203:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834973.518290:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242394112 00000100:00100000:2.0:1788834973.518301:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242394112 00000100:00100000:2.0:1788834973.518406:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:2.0:1788834973.518417:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+7:6238:x1875729242394112:12345-192.168.203.22@tcp:41: 00000004:00000024:2.0:1788834973.518471:0:6487:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00080000:1.0:1788834973.518738:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788834973.518849:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+7:6238:x1875729242394112:12345-192.168.203.22@tcp:41: Request processed in 433us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834973.518863:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:3.0:1788834973.520874:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788834973.520941:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242394240 00000100:00100000:1.0:1788834973.520949:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242394240 00000100:00100000:1.0:1788834973.521017:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:1.0:1788834973.521027:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+6:6238:x1875729242394240:12345-192.168.203.22@tcp:41: 00000004:00000024:1.0:1788834973.521054:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788834973.521118:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba368700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+6:6238:x1875729242394240:12345-192.168.203.22@tcp:41: Request processed in 93us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834973.521141:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00080000:2.0:1788834973.521255:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788834973.523842:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834973.523960:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242394368 00000100:00100000:2.0:1788834973.523968:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242394368 00000100:00100000:2.0:1788834973.524065:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:2.0:1788834973.524075:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b8987b33-76f7-43a0-9448-1013c4af787f+6:6238:x1875729242394368:12345-192.168.203.22@tcp:13: 00002000:00000024:2.0:1788834973.524098:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788834973.524174:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b8987b33-76f7-43a0-9448-1013c4af787f+6:6238:x1875729242394368:12345-192.168.203.22@tcp:13: Request processed in 100us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834973.524183:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00080000:1.0:1788834973.525367:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788834973.527444:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834973.527656:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242394496 00000100:00100000:2.0:1788834973.527673:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242394496 00000100:00100000:2.0:1788834973.527791:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:2.0:1788834973.527800:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b8987b33-76f7-43a0-9448-1013c4af787f+6:6238:x1875729242394496:12345-192.168.203.22@tcp:13: 00002000:00000024:2.0:1788834973.527823:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788834973.527898:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba368380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b8987b33-76f7-43a0-9448-1013c4af787f+6:6238:x1875729242394496:12345-192.168.203.22@tcp:13: Request processed in 100us (462us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834973.527906:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00080000:1.0:1788834973.528655:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788834974.182549:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788834974.501487:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253978624:0@lo:41: 00000100:00100000:0.0:1788834974.501561:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834974.501684:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253978624 00000100:00100000:3.0:1788834974.501691:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253978624 00000100:00100000:3.0:1788834974.501741:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788834974.501752:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253978624:12345-0@lo:41: 00000004:00000024:3.0:1788834974.501784:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788834974.501844:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253978624:12345-0@lo:41: Request processed in 93us (282us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834974.501850:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788834974.503134:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba368e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253978624:0@lo:41: 00000001:00100000:2.0:1788834975.021221:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b8987b33-76f7-43a0-9448-1013c4af787f 00010000:00010000:0.0:1788834975.205956:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788834976.041931:0:7417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b8987b33-76f7-43a0-9448-1013c4af787f 00000001:00100000:3.0:1788834976.050150:0:6467:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b8987b33-76f7-43a0-9448-1013c4af787f 00000001:02000400:2.0:1788834976.137360:0:10155:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1788834976.229549:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788834976.351351:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834976.351418:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242394624 00000100:00100000:3.0:1788834976.351428:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242394624 00000100:00100000:3.0:1788834976.351487:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 198 00000100:00100000:3.0:1788834976.351497:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+10:2385:x1875729242394624:12345-192.168.203.22@tcp:400: 00000100:00100000:3.0:1788834976.351563:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+10:2385:x1875729242394624:12345-192.168.203.22@tcp:400: Request processed in 67us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834976.351571:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 198 00000100:00100000:0.0:1788834976.351625:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788834976.351791:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788834976.351864:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788834976.351888:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788834976.351929:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242394880 00000100:00100000:1.0:1788834976.351934:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242394880 00000100:00100000:1.0:1788834976.351974:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242394752 00000100:00100000:1.0:1788834976.351977:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242394752 00000100:00100000:1.0:1788834976.351996:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:1.0:1788834976.352003:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242394880:12345-192.168.203.22@tcp:400: 00000100:00100000:1.0:1788834976.352044:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9eed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242394880:12345-192.168.203.22@tcp:400: Request processed in 41us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834976.352050:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:1.0:1788834976.352065:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:1.0:1788834976.352070:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+6:2385:x1875729242394752:12345-192.168.203.22@tcp:400: 00000100:00100000:1.0:1788834976.352092:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9efb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+6:2385:x1875729242394752:12345-192.168.203.22@tcp:400: Request processed in 22us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834976.352098:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00080000:1.0:1788834976.352113:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788834976.352117:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788834976.359185:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242395136 00000100:00100000:3.0:1788834976.359306:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242395136 00000100:00100000:3.0:1788834976.359972:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242395008 00000100:00100000:3.0:1788834976.359978:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242395008 00000100:00100000:2.0:1788834976.360030:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:2.0:1788834976.360043:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242395136:12345-192.168.203.22@tcp:400: 00000100:00100000:2.0:1788834976.360121:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ed500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242395136:12345-192.168.203.22@tcp:400: Request processed in 80us (8329us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834976.360138:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00080000:0.0:1788834976.360191:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788834976.360195:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788834976.360580:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:3.0:1788834976.360590:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+6:2385:x1875729242395008:12345-192.168.203.22@tcp:400: 00000100:00100000:3.0:1788834976.360622:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ef100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+6:2385:x1875729242395008:12345-192.168.203.22@tcp:400: Request processed in 35us (8733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834976.360629:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000001:00100000:2.0:1788834977.078906:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b8987b33-76f7-43a0-9448-1013c4af787f 00010000:00010000:1.0:1788834977.253492:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788834978.085428:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788834978.085496:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788834978.085516:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729253978880:0@lo:400: 00000100:00100000:3.0:1788834978.085591:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729253978752:0@lo:400: 00000100:00100000:2.0:1788834978.085597:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834978.085733:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253978880 00000100:00100000:0.0:1788834978.085739:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253978880 00000100:00100000:0.0:1788834978.085792:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788834978.085811:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729253978880:12345-0@lo:400: 00000100:00100000:3.0:1788834978.086053:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834978.086108:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729253979392:0@lo:400: 00000100:00100000:3.0:1788834978.086134:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834978.086153:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729253979904:0@lo:400: 00000100:00100000:3.0:1788834978.086173:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834978.086190:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788834978.086196:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253979264:0@lo:400: 00000100:00100000:3.0:1788834978.086218:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834978.086234:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253979776:0@lo:400: 00000100:00100000:3.0:1788834978.086255:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834978.086272:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253980288:0@lo:400: 00000100:00100000:2.0:1788834978.086653:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788834978.086664:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253980416:0@lo:13: 00000100:00100000:2.0:1788834978.086690:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834978.086734:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253980416 00000100:00100000:2.0:1788834978.086738:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253980416 00000100:00100000:2.0:1788834978.086844:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788834978.086854:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253980416:12345-0@lo:13: 00002000:00000024:2.0:1788834978.086876:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788834978.086926:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253980416:12345-0@lo:13: Request processed in 74us (233us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834978.086932:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:2.0:1788834978.087672:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8310a680 x1875729253980416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834978.087691:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253980416:0@lo:13: 00000100:00100000:2.0:1788834978.088214:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253979392 00000100:00100000:2.0:1788834978.088220:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253979392 00000100:00100000:2.0:1788834978.088257:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253979904 00000100:00100000:2.0:1788834978.088260:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253979904 00000100:00100000:2.0:1788834978.088279:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788834978.088288:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729253979392:12345-0@lo:400: 00000100:00100000:2.0:1788834978.088363:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729253979392:12345-0@lo:400: Request processed in 75us (2227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834978.088375:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1788834978.088390:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788834978.088396:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729253979904:12345-0@lo:400: 00000100:00100000:2.0:1788834978.088424:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba369c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729253979904:12345-0@lo:400: Request processed in 29us (2250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834978.088429:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788834978.088447:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253978752 00000100:00100000:2.0:1788834978.088451:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253978752 00000100:00100000:2.0:1788834978.088476:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788834978.088482:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729253978752:12345-0@lo:400: 00000100:00100000:2.0:1788834978.088514:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729253978752:12345-0@lo:400: Request processed in 31us (2460us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834978.088520:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788834978.089860:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253979776 00000100:00100000:2.0:1788834978.089867:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253979776 00000100:00100000:2.0:1788834978.089918:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788834978.089927:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253979776:12345-0@lo:400: 00000100:00100000:2.0:1788834978.089985:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253979776:12345-0@lo:400: Request processed in 60us (3729us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834978.089992:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788834978.090011:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834978.090013:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253979264 00000100:00100000:2.0:1788834978.090016:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253979264 00000100:00100000:2.0:1788834978.090045:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788834978.090051:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253979264:12345-0@lo:400: 00000100:00100000:3.0:1788834978.090067:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9edc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729253979392:0@lo:400: 00000100:00100000:3.0:1788834978.090082:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729253979904:0@lo:400: 00000100:00100000:2.0:1788834978.090085:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253979264:12345-0@lo:400: Request processed in 34us (3866us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834978.090091:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729253978752:0@lo:400: 00000100:00100000:2.0:1788834978.090101:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788834978.090125:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253979264:0@lo:400: 00010000:00080000:3.0:1788834978.090138:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc836b9f80 x1875729253979776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788834994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834978.090149:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253979776:0@lo:400: 00000100:00100000:3.0:1788834978.090172:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253980288 00000100:00100000:3.0:1788834978.090176:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253980288 00000100:00100000:3.0:1788834978.090212:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788834978.090219:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253980288:12345-0@lo:400: 00000100:00100000:3.0:1788834978.090255:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253980288:12345-0@lo:400: Request processed in 37us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834978.090261:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:3.0:1788834978.090381:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc836ba680 x1875729253980288/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788834994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834978.090391:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253980288:0@lo:400: 00000100:00100000:0.0:1788834978.090743:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253979008:0@lo:400: 00000100:00100000:0.0:1788834978.090789:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834978.090818:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729253979520:0@lo:400: 00000100:00100000:2.0:1788834978.090819:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729253979136:0@lo:400: 00000100:00100000:0.0:1788834978.090842:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834978.090848:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253979008 00000100:00100000:2.0:1788834978.090851:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253979008 00000100:00100000:2.0:1788834978.090897:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788834978.090904:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253979008:12345-0@lo:400: 00000100:00100000:2.0:1788834978.090938:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253979008:12345-0@lo:400: Request processed in 35us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834978.090957:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788834978.090994:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729253978880:12345-0@lo:400: Request processed in 5194us (5396us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834978.091002:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788834978.091033:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729253978880:0@lo:400: 00000100:00100000:2.0:1788834978.091069:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253979520 00000100:00100000:2.0:1788834978.091073:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253979520 00000100:00100000:0.0:1788834978.091082:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729253980032:0@lo:400: 00000100:00100000:2.0:1788834978.091098:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788834978.091104:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729253979520:12345-0@lo:400: 00000100:00100000:0.0:1788834978.091105:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834978.091121:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253980544:0@lo:13: 00000100:00100000:2.0:1788834978.091132:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729253979520:12345-0@lo:400: Request processed in 29us (289us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834978.091137:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788834978.091140:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834978.091146:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253980032 00000100:00100000:2.0:1788834978.091149:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253980032 00000100:00100000:2.0:1788834978.091167:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788834978.091167:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253979008:0@lo:400: 00000100:00100000:2.0:1788834978.091173:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729253980032:12345-0@lo:400: 00010000:00080000:0.0:1788834978.091176:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbf9ec000 x1875729253979520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834978.091185:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729253979520:0@lo:400: 00000100:00100000:2.0:1788834978.091197:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729253980032:12345-0@lo:400: Request processed in 25us (91us total) trans 0 rc 0/0 00010000:00080000:0.0:1788834978.091200:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc836b9180 x1875729253980032/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834978.091212:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788834978.091215:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729253980032:0@lo:400: 00000100:00080000:0.0:1788834978.091230:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788834978.091234:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788834978.091237:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788834978.091240:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788834978.091253:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253980544 00000100:00100000:0.0:1788834978.091259:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253980544 00000100:00100000:0.0:1788834978.093710:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788834978.093728:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729253980544:12345-0@lo:13: 00002000:00000024:0.0:1788834978.093753:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788834978.093829:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729253980544:12345-0@lo:13: Request processed in 108us (2687us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834978.093836:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:0.0:1788834978.093898:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83109f80 x1875729253980544/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834978.093920:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253980544:0@lo:13: 00000100:00100000:0.0:1788834978.093952:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834978.093983:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253979648:0@lo:400: 00000100:00100000:0.0:1788834978.094014:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834978.094031:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253980160:0@lo:400: 00000100:00100000:0.0:1788834978.094050:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834978.094068:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253980672:0@lo:41: 00000100:00100000:0.0:1788834978.094091:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834978.094119:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253979648 00000100:00100000:0.0:1788834978.094126:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253979648 00000100:00100000:0.0:1788834978.094366:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253980160 00000100:00100000:0.0:1788834978.094371:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253980160 00000100:00100000:0.0:1788834978.094404:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788834978.094411:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253979648:12345-0@lo:400: 00000100:00100000:0.0:1788834978.094453:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253979648:12345-0@lo:400: Request processed in 43us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834978.094460:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788834978.094474:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788834978.094481:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253980160:12345-0@lo:400: 00000100:00100000:0.0:1788834978.094512:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253980160:12345-0@lo:400: Request processed in 31us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834978.094518:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1788834978.094535:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788834978.094560:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc836b8000 x1875729253979648/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788834994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834978.094694:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253979648:0@lo:400: 00010000:00080000:0.0:1788834978.094709:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc836bb800 x1875729253980160/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788834994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834978.094720:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253980160:0@lo:400: 00000100:00100000:0.0:1788834978.094749:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253980672 00000100:00100000:0.0:1788834978.094753:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253980672 00000100:00100000:0.0:1788834978.094781:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788834978.094787:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253980672:12345-0@lo:41: 00000004:00000024:0.0:1788834978.094812:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788834978.094847:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253980672:12345-0@lo:41: Request processed in 60us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834978.094862:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788834978.094902:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253980672:0@lo:41: 00000100:00100000:0.0:1788834978.094922:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253979136 00000100:00100000:0.0:1788834978.094925:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253979136 00000100:00100000:0.0:1788834978.094957:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788834978.094964:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729253979136:12345-0@lo:400: 00000100:00100000:0.0:1788834978.095000:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729253979136:12345-0@lo:400: Request processed in 36us (1047us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834978.095006:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788834978.095031:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729253979136:0@lo:400: 00010000:00010000:1.0:1788834978.278448:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788834978.597991:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253980800:0@lo:13: 00000100:00100000:2.0:1788834978.598062:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834978.598139:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253980800 00000100:00100000:2.0:1788834978.598147:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253980800 00000100:00100000:2.0:1788834978.598191:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788834978.598199:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253980800:12345-0@lo:13: 00002000:00000024:2.0:1788834978.598227:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788834978.598282:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253980800:12345-0@lo:13: Request processed in 83us (219us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834978.598289:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1788834978.598363:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36c700 x1875729253980800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834978.598381:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253980800:0@lo:13: 00000100:00100000:1.0:1788834978.601892:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788834978.601918:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253980928:0@lo:13: 00000100:00100000:1.0:1788834978.601993:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834978.602058:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253980928 00000100:00100000:1.0:1788834978.602072:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253980928 00000100:00100000:1.0:1788834978.602117:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788834978.602125:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253980928:12345-0@lo:13: 00002000:00000024:1.0:1788834978.602147:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788834978.602189:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253980928:12345-0@lo:13: Request processed in 64us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834978.602196:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1788834978.602233:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83109f80 x1875729253980928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834978.602252:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253980928:0@lo:13: 00010000:00010000:3.0:1788834979.302240:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788834979.632014:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788834979.632037:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253981056:0@lo:41: 00000100:00100000:3.0:1788834979.632116:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834979.632183:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253981056 00000100:00100000:3.0:1788834979.632191:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253981056 00000100:00100000:3.0:1788834979.632236:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788834979.632244:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253981056:12345-0@lo:41: 00000004:00000024:3.0:1788834979.632274:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446322176 avail 1300082688 00000100:00100000:3.0:1788834979.632339:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253981056:12345-0@lo:41: Request processed in 94us (223us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834979.632356:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788834979.632401:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba369180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253981056:0@lo:41: 00000020:00000080:2.0:1788834979.647587:0:10303:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffeef644020 20000000:00000080:2.0:1788834979.647605:0:10303:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9afdba2fa400 uarg=0000000000000000 20000000:01000000:2.0:1788834979.647651:0:10303:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1788834979.647653:0:10303:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1788834979.647656:0:10303:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788834979.647661:0:10303:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1788834979.647666:0:10303:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1788834979.647723:0:10303:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0001 20000000:01000000:2.0:1788834979.647726:0:10303:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788834979.650624:0:10304:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 43 count 43 00000040:00080000:2.0:1788834979.651441:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].43, 224 off15672 00000040:00080000:2.0:1788834979.651536:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].44, 120 off15792 00000040:00080000:2.0:1788834979.651555:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].45, 224 off16016 20000000:01000000:2.0:1788834979.651566:0:10303:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:2.0:1788834979.651581:0:10303:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788834979.652533:0:10305:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 8 count 8 00000040:00080000:2.0:1788834979.652734:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9632 00000040:00080000:2.0:1788834979.652830:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 120 off9752 00000040:00080000:2.0:1788834979.652921:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off9976 20000000:01000000:2.0:1788834979.652936:0:10303:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1788834979.653157:0:10303:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788834979.654005:0:10306:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 43 count 43 00000040:00080000:2.0:1788834979.655057:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].43, 224 off15640 00000040:00080000:2.0:1788834979.655156:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].44, 120 off15760 00000040:00080000:2.0:1788834979.655173:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].45, 224 off15984 20000000:01000000:2.0:1788834979.655183:0:10303:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1788834979.655185:0:10303:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1788834979.655610:0:10307:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000040:00080000:2.0:1788834979.655833:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10160 00000040:00080000:2.0:1788834979.655929:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 120 off10280 00000040:00080000:2.0:1788834979.656193:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 224 off10504 20000000:01000000:2.0:1788834979.656205:0:10303:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1788834979.656207:0:10303:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1788834979.658715:0:10308:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 48 count 48 00000040:00080000:3.0:1788834979.660212:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].49, 224 off16608 00000040:00080000:3.0:1788834979.660273:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].50, 120 off16728 00000040:00080000:3.0:1788834979.660296:0:10303:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].51, 224 off16952 10000000:01000000:3.0:1788834979.661544:0:10303:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1788834979.661570:0:10303:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afc8374d200/0xdf60171e5a5d1b4a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.661589:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d19e5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d19de expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.661598:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdb2e63c00/0xdf60171e5a5d1a0f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1a08 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.661605:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdb2e62c00/0xdf60171e5a5d1a4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1a47 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.661613:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdb2e63200/0xdf60171e5a5d1a5c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1a55 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.661619:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdc204a600/0xdf60171e5a5d1a6a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1a63 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.661626:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdc204a000/0xdf60171e5a5d1a86 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1a7f expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.661634:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdb2e61400/0xdf60171e5a5d1ab0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1aa9 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.661659:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdb2e62e00/0xdf60171e5a5d1acc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1ac5 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.661667:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdb2e62400/0xdf60171e5a5d1af6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1aef expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.661676:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1b04 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0372 expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.661684:0:10303:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1b0b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0379 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.661692:0:10303:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afc8374d200/0xdf60171e5a5d1b4a lrc: 14/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.661731:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1b0b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0379 expref: 9 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.661804:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1b0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0379 expref: 9 pid: 6482 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834979.661821:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba369180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253981184:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788834979.662030:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1b04 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0372 expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.662040:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1b04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0372 expref: 9 pid: 6481 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834979.662050:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253981312:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788834979.662157:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdb2e62400/0xdf60171e5a5d1af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1aef expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.662165:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afdb2e62400/0xdf60171e5a5d1af6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1aef expref: 23 pid: 6481 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834979.662174:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba368e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253981440:0@lo:104: 00000100:00100000:3.0:1788834979.662209:0:10303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788834979.662248:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdb2e62e00/0xdf60171e5a5d1acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1ac5 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.662255:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afdb2e62e00/0xdf60171e5a5d1acc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1ac5 expref: 23 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834979.662262:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253981568:0@lo:104: 00000100:00100000:3.0:1788834979.662280:0:10303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788834979.662306:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdb2e61400/0xdf60171e5a5d1ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1aa9 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.662335:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afdb2e61400/0xdf60171e5a5d1ab0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1aa9 expref: 23 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834979.662344:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253981696:0@lo:104: 00000100:00100000:3.0:1788834979.662363:0:10303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788834979.662384:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdc204a000/0xdf60171e5a5d1a86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1a7f expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.662391:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afdc204a000/0xdf60171e5a5d1a86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1a7f expref: 23 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834979.662411:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253981824:0@lo:104: 00000100:00100000:3.0:1788834979.662433:0:10303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788834979.662447:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdc204a600/0xdf60171e5a5d1a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1a63 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.662454:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afdc204a600/0xdf60171e5a5d1a6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1a63 expref: 23 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834979.662472:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9edc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253981952:0@lo:104: 00010000:00010000:3.0:1788834979.662493:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdb2e63200/0xdf60171e5a5d1a5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1a55 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.662500:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afdb2e63200/0xdf60171e5a5d1a5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1a55 expref: 23 pid: 6482 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834979.662507:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdaaf3f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253982080:0@lo:104: 00010000:00010000:3.0:1788834979.662524:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdb2e62c00/0xdf60171e5a5d1a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1a47 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.662530:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afdb2e62c00/0xdf60171e5a5d1a4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1a47 expref: 23 pid: 6481 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834979.662537:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdaaf3ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253982208:0@lo:104: 00010000:00010000:3.0:1788834979.662554:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdb2e63c00/0xdf60171e5a5d1a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1a08 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.662560:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afdb2e63c00/0xdf60171e5a5d1a0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1a08 expref: 23 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834979.662579:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253982336:0@lo:104: 00010000:00010000:3.0:1788834979.662614:0:10303:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d19e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d19de expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.662621:0:10303:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d19e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d19de expref: 23 pid: 6482 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834979.662629:0:10303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253982464:0@lo:104: 00000100:00100000:3.0:1788834979.662645:0:10303:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda0a8ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788834979.662756:0:7440:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1788834979.662775:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834979.662788:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834979.662798:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834979.662805:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834979.662812:0:7440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834979.662820:0:7440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253981440 00000100:00100000:2.0:1788834979.662826:0:7440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253981440 00000100:00100000:2.0:1788834979.662881:0:7440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253981568 00000100:00100000:2.0:1788834979.662884:0:7440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253981568 00000100:00100000:2.0:1788834979.662897:0:7440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253981696 00000100:00100000:2.0:1788834979.662899:0:7440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253981696 00000100:00100000:2.0:1788834979.662907:0:7440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253981824 00000100:00100000:2.0:1788834979.662909:0:7440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253981824 00000100:00100000:2.0:1788834979.662917:0:7440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253981952 00000100:00100000:2.0:1788834979.662920:0:7440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253981952 00000100:00100000:2.0:1788834979.662929:0:7440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253982080 00000100:00100000:2.0:1788834979.662932:0:7440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253982080 00000100:00100000:2.0:1788834979.662950:0:7440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253982208 00000100:00100000:2.0:1788834979.662953:0:7440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253982208 00000100:00100000:2.0:1788834979.662960:0:7440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253982336 00000100:00100000:2.0:1788834979.662962:0:7440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253982336 00000100:00100000:2.0:1788834979.662969:0:7440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253982464 00000100:00100000:2.0:1788834979.662970:0:7440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253982464 00000100:00100000:2.0:1788834979.662982:0:7440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788834979.662990:0:7440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+11:10303:x1875729253981440:12345-0@lo:104: 00010000:00010000:2.0:1788834979.663002:0:7440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdc204b000/0xdf60171e5a5d1aef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1af6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.663051:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788834979.663057:0:7440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ece00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+11:10303:x1875729253981440:12345-0@lo:104: Request processed in 68us (848us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834979.663248:0:7440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788834979.663267:0:7440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788834979.663274:0:7440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+10:10303:x1875729253981568:12345-0@lo:104: 00010000:00010000:2.0:1788834979.663282:0:7440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63e00/0xdf60171e5a5d1ac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1acc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.663341:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788834979.663346:0:7440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ec380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+10:10303:x1875729253981568:12345-0@lo:104: Request processed in 73us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834979.663351:0:7440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788834979.663364:0:7440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788834979.663369:0:7440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+9:10303:x1875729253981696:12345-0@lo:104: 00010000:00010000:2.0:1788834979.663376:0:7440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d1aa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1ab0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.663422:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1788834979.663428:0:7440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ef480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+9:10303:x1875729253981696:12345-0@lo:104: Request processed in 59us (1064us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834979.663435:0:7440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788834979.663447:0:7440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788834979.663452:0:7440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+8:10303:x1875729253981824:12345-0@lo:104: 00010000:00010000:2.0:1788834979.663459:0:7440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1a7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1a86 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.663493:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1788834979.663498:0:7440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+8:10303:x1875729253981824:12345-0@lo:104: Request processed in 47us (1065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834979.663504:0:7440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788834979.663533:0:7440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788834979.663539:0:7440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+7:10303:x1875729253981952:12345-0@lo:104: 00010000:00010000:2.0:1788834979.663547:0:7440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1a63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1a6a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.663574:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1788834979.663579:0:7440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+7:10303:x1875729253981952:12345-0@lo:104: Request processed in 40us (804us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834979.663584:0:7440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788834979.663595:0:7440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788834979.663600:0:7440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+6:10303:x1875729253982080:12345-0@lo:104: 00010000:00010000:2.0:1788834979.663606:0:7440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1a55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1a5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.663636:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:2.0:1788834979.663641:0:7440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36df80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+6:10303:x1875729253982080:12345-0@lo:104: Request processed in 41us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834979.663646:0:7440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788834979.663657:0:7440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788834979.663662:0:7440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+5:10303:x1875729253982208:12345-0@lo:104: 00010000:00010000:2.0:1788834979.663668:0:7440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1a4e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.663690:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:2.0:1788834979.663694:0:7440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+5:10303:x1875729253982208:12345-0@lo:104: Request processed in 33us (897us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834979.663700:0:7440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788834979.663709:0:7440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788834979.663714:0:7440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:10303:x1875729253982336:12345-0@lo:104: 00010000:00010000:2.0:1788834979.663720:0:7440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63000/0xdf60171e5a5d1a08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1a0f expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.663807:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/8 locks to priority blp list, 8 blwis in pool 00000100:00100000:2.0:1788834979.663813:0:7440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:10303:x1875729253982336:12345-0@lo:104: Request processed in 99us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834979.663819:0:7440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788834979.663831:0:7440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788834979.663837:0:7440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:10303:x1875729253982464:12345-0@lo:104: 00010000:00010000:2.0:1788834979.663911:0:7440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61a00/0xdf60171e5a5d19de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d19e5 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.663946:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/9 locks to priority blp list, 9 blwis in pool 00000100:00100000:2.0:1788834979.663951:0:7440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:10303:x1875729253982464:12345-0@lo:104: Request processed in 115us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834979.663958:0:7440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:2.0:1788834979.663978:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 8 total in blp. (8 blwis in pool) 00010000:00010000:2.0:1788834979.663985:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdc204b000/0xdf60171e5a5d1aef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1af6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.663993:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204b000 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788834979.663997:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdc204b000/0xdf60171e5a5d1aef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1af6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664006:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdc204b000/0xdf60171e5a5d1aef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1af6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788834979.664013:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdc204b000/0xdf60171e5a5d1aef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1af6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834979.664019:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788834979.664050:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdc204b000/0xdf60171e5a5d1aef lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1af6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664056:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788834979.664409:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdc204b000/0xdf60171e5a5d1aef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1af6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664418:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdc204b000/0xdf60171e5a5d1aef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1af6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664444:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 7 total in blp. (7 blwis in pool) 00010000:00010000:2.0:1788834979.664448:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63e00/0xdf60171e5a5d1ac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1acc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664454:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e63e00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788834979.664467:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63e00/0xdf60171e5a5d1ac5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1acc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664475:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63e00/0xdf60171e5a5d1ac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1acc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788834979.664482:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63e00/0xdf60171e5a5d1ac5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1acc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834979.664488:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788834979.664503:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63e00/0xdf60171e5a5d1ac5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1acc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664509:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788834979.664523:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63e00/0xdf60171e5a5d1ac5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1acc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664530:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63e00/0xdf60171e5a5d1ac5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1acc expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664539:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:2.0:1788834979.664542:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d1aa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1ab0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664559:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61000 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788834979.664562:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d1aa9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1ab0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664569:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d1aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1ab0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788834979.664576:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d1aa9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1ab0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834979.664582:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788834979.664595:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d1aa9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1ab0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664601:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788834979.664606:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d1aa9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1ab0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664612:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d1aa9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1ab0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664621:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:2.0:1788834979.664624:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1a7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1a86 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664629:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80030c00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788834979.664631:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1a7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1a86 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664646:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1a86 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788834979.664652:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1a7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1a86 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834979.664657:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788834979.664669:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1a7f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1a86 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664675:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788834979.664680:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1a7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1a86 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664686:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1a7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1a86 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664695:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1788834979.664698:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1a63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1a6a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664703:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80031e00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788834979.664706:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1a63 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1a6a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.664713:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1a6a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788834979.664718:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1a63 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1a6a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834979.664728:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788834979.664740:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1a63 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1a6a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834979.664946:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba368e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253981440:0@lo:104: 00000100:00100000:3.0:1788834979.664958:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ec000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253981568:0@lo:104: 00000100:00100000:3.0:1788834979.664967:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ec700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253981696:0@lo:104: 00000100:00100000:3.0:1788834979.664975:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ee300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253981824:0@lo:104: 00000100:00100000:3.0:1788834979.664982:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9edc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253981952:0@lo:104: 00000100:00100000:3.0:1788834979.664990:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdaaf3f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253982080:0@lo:104: 00000100:00100000:3.0:1788834979.664997:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdaaf3ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253982208:0@lo:104: 00000100:00100000:3.0:1788834979.665006:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253982336:0@lo:104: 00000100:00100000:3.0:1788834979.665013:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253982464:0@lo:104: 00010000:00010000:2.0:1788834979.666210:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788834979.666223:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1a63 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1a6a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.666231:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1a63 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1a6a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.666247:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1788834979.666250:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1a55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1a5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.666257:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e62600 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788834979.666260:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1a55 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1a5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.666268:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1a55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1a5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788834979.666275:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1a55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1a5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834979.666280:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788834979.666348:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1a55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1a5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.666354:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788834979.666364:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1a55 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1a5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.666369:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1a55 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1a5c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.666377:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788834979.666381:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1a4e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.666386:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e62000 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788834979.666388:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1a47 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1a4e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.666394:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1a4e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788834979.666399:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1a47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1a4e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834979.666403:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788834979.666416:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1a47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1a4e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.666421:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788834979.666426:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1a47 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1a4e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.666431:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1a47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1a4e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.666439:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788834979.666447:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63000/0xdf60171e5a5d1a08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1a0f expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.666452:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e63000 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788834979.666455:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63000/0xdf60171e5a5d1a08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1a0f expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.667172:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63000/0xdf60171e5a5d1a08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1a0f expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788834979.667181:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63000/0xdf60171e5a5d1a08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1a0f expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834979.667186:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788834979.667204:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63000/0xdf60171e5a5d1a08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1a0f expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.667208:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788834979.667213:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63000/0xdf60171e5a5d1a08 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1a0f expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.667220:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63000/0xdf60171e5a5d1a08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1a0f expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.667230:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788834979.667234:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61a00/0xdf60171e5a5d19de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d19e5 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.667240:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61a00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788834979.667243:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61a00/0xdf60171e5a5d19de lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d19e5 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.667261:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61a00/0xdf60171e5a5d19de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d19e5 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788834979.667267:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61a00/0xdf60171e5a5d19de lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d19e5 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834979.667273:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1788834979.667286:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61a00/0xdf60171e5a5d19de lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d19e5 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.667291:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788834979.667296:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61a00/0xdf60171e5a5d19de lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d19e5 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.667302:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61a00/0xdf60171e5a5d19de lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d19e5 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.667821:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834979.668149:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834979.668152:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788834979.668154:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788834979.668183:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729253982592:0@lo:103: 00000100:00100000:2.0:1788834979.668250:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834979.668286:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729253983104:0@lo:103: 00000100:00100000:2.0:1788834979.668307:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834979.668446:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729253983616:0@lo:103: 00000100:00100000:2.0:1788834979.668481:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788834979.668779:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788834979.668792:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253982976:0@lo:103: 00000100:00100000:2.0:1788834979.670108:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253982720:0@lo:103: 00000100:00100000:2.0:1788834979.670163:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834979.670288:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253982592 00000100:00100000:0.0:1788834979.670296:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253982592 00010000:00010000:0.0:1788834979.670342:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdb2e62400/0xdf60171e5a5d1af6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1aef expref: 24 pid: 6481 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834979.670368:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253983104 00000100:00100000:0.0:1788834979.670371:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253983104 00010000:00010000:0.0:1788834979.670383:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdc204a600/0xdf60171e5a5d1a6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1a63 expref: 25 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834979.670396:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253983616 00000100:00100000:0.0:1788834979.670399:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253983616 00010000:00010000:0.0:1788834979.670408:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d19e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d19de expref: 26 pid: 6482 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834979.670422:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788834979.670429:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaae6e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+26:3615:x1875729253982592:12345-0@lo:103: 00010000:00010000:0.0:1788834979.670448:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788834979.670454:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdb2e62400/0xdf60171e5a5d1af6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1aef expref: 26 pid: 6481 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.670477:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdb2e62400/0xdf60171e5a5d1af6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1aef expref: 26 pid: 6481 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.670494:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e62400/0xdf60171e5a5d1af6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1aef expref: 26 pid: 6481 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.670509:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788834979.670547:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaae6e450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+25:3615:x1875729253982592:12345-0@lo:103: Request processed in 118us (2297us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834979.670555:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788834979.670594:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788834979.670600:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83687100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3615:x1875729253983104:12345-0@lo:103: 00010000:00010000:0.0:1788834979.670607:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788834979.670611:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdc204a600/0xdf60171e5a5d1a6a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1a63 expref: 24 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.670622:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdc204a600/0xdf60171e5a5d1a6a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1a63 expref: 24 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.670630:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdc204a600/0xdf60171e5a5d1a6a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1a63 expref: 24 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.670640:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788834979.670661:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83687100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:3615:x1875729253983104:12345-0@lo:103: Request processed in 62us (2355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834979.670677:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788834979.670690:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788834979.670695:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83686300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:3615:x1875729253983616:12345-0@lo:103: 00010000:00010000:0.0:1788834979.670702:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788834979.670706:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d19e5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d19de expref: 22 pid: 6482 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.670714:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d19e5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d19de expref: 22 pid: 6482 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.670723:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d19e5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d19de expref: 22 pid: 6482 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.670731:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788834979.670768:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83686300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:3615:x1875729253983616:12345-0@lo:103: Request processed in 73us (2287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834979.670774:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788834979.671252:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253983232:0@lo:103: 00000100:00100000:2.0:1788834979.671281:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834979.671309:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788834979.671334:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253982848:0@lo:103: 00000100:00100000:2.0:1788834979.671355:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834979.671377:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253983360:0@lo:103: 00000100:00100000:2.0:1788834979.671398:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834979.671434:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834979.671453:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253983488:0@lo:103: 00000100:00100000:2.0:1788834979.671502:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834979.671535:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253982720 00000100:00100000:2.0:1788834979.671541:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253982720 00010000:00010000:2.0:1788834979.671564:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdb2e62e00/0xdf60171e5a5d1acc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1ac5 expref: 21 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834979.671578:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253983232 00000100:00100000:2.0:1788834979.671580:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253983232 00010000:00010000:2.0:1788834979.671608:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdb2e63200/0xdf60171e5a5d1a5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1a55 expref: 22 pid: 6482 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834979.671618:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253982848 00000100:00100000:2.0:1788834979.671621:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253982848 00010000:00010000:2.0:1788834979.671629:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdb2e61400/0xdf60171e5a5d1ab0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1aa9 expref: 23 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834979.671637:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253983360 00000100:00100000:2.0:1788834979.671640:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253983360 00010000:00010000:2.0:1788834979.671647:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdb2e62c00/0xdf60171e5a5d1a4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1a47 expref: 24 pid: 6481 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834979.671665:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253982976 00000100:00100000:2.0:1788834979.671668:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253982976 00010000:00010000:2.0:1788834979.671679:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdc204a000/0xdf60171e5a5d1a86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1a7f expref: 25 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834979.671688:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253983488 00000100:00100000:2.0:1788834979.671690:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253983488 00010000:00010000:2.0:1788834979.671698:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdb2e63c00/0xdf60171e5a5d1a0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1a08 expref: 26 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834979.671709:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788834979.671715:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83684700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f0122c5-c616-4176-9ca1-6fdce4068f64+26:3616:x1875729253982720:12345-0@lo:103: 00010000:00010000:2.0:1788834979.671723:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788834979.671727:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdb2e62e00/0xdf60171e5a5d1acc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1ac5 expref: 26 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.671735:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdb2e62e00/0xdf60171e5a5d1acc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1ac5 expref: 26 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834979.672309:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788834979.672333:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83684380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+26:3616:x1875729253983232:12345-0@lo:103: 00010000:00010000:0.0:1788834979.672343:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788834979.672348:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdb2e63200/0xdf60171e5a5d1a5c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1a55 expref: 26 pid: 6482 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.672397:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e62e00/0xdf60171e5a5d1acc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1ac5 expref: 26 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834979.672672:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834979.672688:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834979.672770:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834979.672792:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242395520 00000100:00100000:3.0:1788834979.672797:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242395520 00000100:00100000:3.0:1788834979.672831:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 200 00000100:00100000:3.0:1788834979.672853:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+10:6160:x1875729242395520:12345-192.168.203.22@tcp:101: 00010000:00010000:3.0:1788834979.672867:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788834979.672889:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afc8374c600/0xdf60171e5a5d1b51 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae03e9 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834979.673542:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242395264 00000100:00100000:1.0:1788834979.673549:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242395264 00010000:00010000:1.0:1788834979.673574:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1b0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0379 expref: 12 pid: 6482 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834979.673594:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242395392 00000100:00100000:1.0:1788834979.673597:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242395392 00010000:00010000:1.0:1788834979.673609:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1b04 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0372 expref: 13 pid: 6481 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834979.673623:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788834979.673631:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83684e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+25:3616:x1875729253982848:12345-0@lo:103: 00010000:00010000:1.0:1788834979.673652:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788834979.673658:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdb2e61400/0xdf60171e5a5d1ab0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1aa9 expref: 25 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.674244:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdb2e63200/0xdf60171e5a5d1a5c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1a55 expref: 25 pid: 6482 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.674263:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e63200/0xdf60171e5a5d1a5c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1a55 expref: 25 pid: 6482 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.674288:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788834979.674366:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83684380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729253983232:12345-0@lo:103: Request processed in 2036us (3083us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834979.674374:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788834979.674398:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788834979.674407:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83687480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:3616:x1875729253983360:12345-0@lo:103: 00010000:00010000:0.0:1788834979.674416:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788834979.674420:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdb2e62c00/0xdf60171e5a5d1a4e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1a47 expref: 23 pid: 6481 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.674428:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdb2e62c00/0xdf60171e5a5d1a4e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1a47 expref: 23 pid: 6481 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.674438:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e62c00/0xdf60171e5a5d1a4e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1a47 expref: 23 pid: 6481 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.674447:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788834979.674930:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83687480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:3616:x1875729253983360:12345-0@lo:103: Request processed in 523us (3528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834979.674938:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788834979.674955:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788834979.674963:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaae6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:3614:x1875729253982976:12345-0@lo:103: 00010000:00010000:0.0:1788834979.674971:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788834979.674976:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdc204a000/0xdf60171e5a5d1a86 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1a7f expref: 21 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.674985:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdc204a000/0xdf60171e5a5d1a86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1a7f expref: 21 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.675003:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdc204a000/0xdf60171e5a5d1a86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1a7f expref: 21 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.675013:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788834979.675050:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaae6dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:3614:x1875729253982976:12345-0@lo:103: Request processed in 88us (3615us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834979.675057:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00010000:2.0:1788834979.675162:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788834979.675194:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83684700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:3616:x1875729253982720:12345-0@lo:103: Request processed in 3477us (5030us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834979.675201:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1788834979.675217:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788834979.675224:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83685c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:3614:x1875729253983488:12345-0@lo:103: 00010000:00010000:2.0:1788834979.675240:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788834979.675245:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdb2e63c00/0xdf60171e5a5d1a0f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1a08 expref: 19 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.675254:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdb2e63c00/0xdf60171e5a5d1a0f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1a08 expref: 19 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.675264:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e63c00/0xdf60171e5a5d1a0f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1a08 expref: 19 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.675274:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788834979.675296:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83685c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:3614:x1875729253983488:12345-0@lo:103: Request processed in 73us (3794us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834979.675302:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788834979.675331:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:2.0:1788834979.675338:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83681880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e8f7875b-4951-482c-9de0-d3888250010c+13:2386:x1875729242395264:12345-192.168.203.22@tcp:103: 00010000:00010000:2.0:1788834979.675345:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788834979.675350:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1b0b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0379 expref: 13 pid: 6482 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.675360:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1b0b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0379 expref: 13 pid: 6482 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.675370:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788834979.675407:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83681880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e8f7875b-4951-482c-9de0-d3888250010c+13:2386:x1875729242395264:12345-192.168.203.22@tcp:103: Request processed in 69us (2737us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834979.675414:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:2.0:1788834979.675427:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:2.0:1788834979.675434:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83680a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e8f7875b-4951-482c-9de0-d3888250010c+12:2385:x1875729242395392:12345-192.168.203.22@tcp:103: 00010000:00010000:2.0:1788834979.675447:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788834979.675452:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1b04 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0372 expref: 12 pid: 6481 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.675603:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1b04 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0372 expref: 12 pid: 6481 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834979.675614:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788834979.675635:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83680a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e8f7875b-4951-482c-9de0-d3888250010c+12:2385:x1875729242395392:12345-192.168.203.22@tcp:103: Request processed in 202us (2946us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834979.675642:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:2.0:1788834979.675684:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ec380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253982976:0@lo:103: 00000100:00100000:2.0:1788834979.675694:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83685500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253983488:0@lo:103: 00010000:00010000:3.0:1788834979.675842:0:6481:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afc8374d200/0xdf60171e5a5d1b4a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.675854:0:6481:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afc8374c600/0xdf60171e5a5d1b51 lrc: 4/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03e9 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.675872:0:6481:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: MGS lock: ffff9afc8374d200/0xdf60171e5a5d1b4a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.675898:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afc8374c600/0xdf60171e5a5d1b51 lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03e9 expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.675905:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374c600, rc 0) 00000100:00100000:3.0:1788834979.675931:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+11:6160:x1875729242395520:12345-192.168.203.22@tcp:101: Request processed in 3085us (3161us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834979.675938:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 200 00010000:00010000:3.0:1788834979.675995:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdc204ae00/0xdf60171e5a5d1b0b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0379 expref: 10 pid: 6482 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834979.676005:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba369180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253981184:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788834979.676015:0:10303:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1b04 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0372 expref: 9 pid: 6481 timeout: 321 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834979.676023:0:10303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10303:1875729253981312:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788834979.676147:0:10303:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afc8374d200/0xdf60171e5a5d1b4a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834979.676294:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729253982592:0@lo:103: 00000100:00100000:2.0:1788834979.676304:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ef480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729253983104:0@lo:103: 00000100:00100000:2.0:1788834979.676311:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83687b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729253983616:0@lo:103: 00000100:00100000:2.0:1788834979.676370:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83686d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253983360:0@lo:103: 00000100:00100000:2.0:1788834979.676379:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253982720:0@lo:103: 00000100:00100000:2.0:1788834979.676387:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253983232:0@lo:103: 00010000:00010000:1.0:1788834979.676451:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdb2e61400/0xdf60171e5a5d1ab0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1aa9 expref: 16 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834979.676542:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e61400/0xdf60171e5a5d1ab0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1aa9 expref: 16 pid: 6483 timeout: 371 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834979.676554:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afc8374d200/0xdf60171e5a5d1b4a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834979.676562:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afc8374d200/0xdf60171e5a5d1b4a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40290400000020 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834979.676574:0:6473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afc8374d200/0xdf60171e5a5d1b4a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834979.676580:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afc8374d200/0xdf60171e5a5d1b4a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834979.676586:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afc8374d200/0xdf60171e5a5d1b4a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000020 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834979.676594:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afc8374d200/0xdf60171e5a5d1b4a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834979.676600:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d200 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:1.0:1788834979.676604:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afc8374d200/0xdf60171e5a5d1b4a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834979.676622:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afc8374d200/0xdf60171e5a5d1b4a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000020 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834979.676641:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afc8374c600/0xdf60171e5a5d1b51 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03e9 expref: 8 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834979.676648:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afc8374c600/0xdf60171e5a5d1b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03e9 expref: 8 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834979.676673:0:6473:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: MGS lock: ffff9afc8374c600/0xdf60171e5a5d1b51 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03e9 expref: 8 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834979.676686:0:6473:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:6473:1875729253983744:192.168.203.22@tcp:105: 00010000:00010000:3.0:1788834979.676957:0:10303:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afc8374d200/0xdf60171e5a5d1b4a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834979.676964:0:10303:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afc8374d200/0xdf60171e5a5d1b4a lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834979.677902:0:6473:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b2cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788834979.680193:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834979.680226:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242395648 00000100:00100000:3.0:1788834979.680234:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242395648 00000100:00100000:3.0:1788834979.680279:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 201 00000100:00100000:3.0:1788834979.680287:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+9:6160:x1875729242395648:12345-192.168.203.22@tcp:501: 00000100:00100000:3.0:1788834979.680452:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+9:6160:x1875729242395648:12345-192.168.203.22@tcp:501: Request processed in 164us (266us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834979.680459:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 201 00000100:00100000:0.0:1788834979.680706:0:6473:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:MGS:6473:1875729253983744:192.168.203.22@tcp:105: 00010000:00010000:0.0:1788834979.680733:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afc8374d200/0xdf60171e5a5d1b4a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.680755:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afc8374d200/0xdf60171e5a5d1b4a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000020 nid: local remote: 0x0 expref: -99 pid: 10303 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834979.680767:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788834979.680814:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83684e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:3616:x1875729253982848:12345-0@lo:103: Request processed in 7183us (9457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834979.680826:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788834979.680971:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253982848:0@lo:103: 00000100:00100000:0.0:1788834979.682689:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834979.682752:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242395776 00000100:00100000:3.0:1788834979.682760:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242395776 00000100:00100000:3.0:1788834979.682804:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 202 00000100:00100000:3.0:1788834979.682812:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+9:6160:x1875729242395776:12345-192.168.203.22@tcp:503: 00000100:00100000:3.0:1788834979.682949:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+9:6160:x1875729242395776:12345-192.168.203.22@tcp:503: Request processed in 136us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834979.682957:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 202 00000100:00100000:2.0:1788834979.699072:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788834979.699184:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242395904 00000100:00100000:0.0:1788834979.699194:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242395904 00000100:00100000:0.0:1788834979.699238:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 203 00000100:00100000:0.0:1788834979.699246:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+9:6624:x1875729242395904:12345-192.168.203.22@tcp:502: 00000100:00100000:0.0:1788834979.699403:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+9:6624:x1875729242395904:12345-192.168.203.22@tcp:502: Request processed in 156us (345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834979.699411:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 203 00000100:00100000:1.0:1788834979.710508:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834979.710582:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242396032 00000100:00100000:2.0:1788834979.710591:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242396032 00000100:00100000:2.0:1788834979.710645:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 204 00000100:00100000:2.0:1788834979.710657:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+9:6624:x1875729242396032:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788834979.710815:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+9:6624:x1875729242396032:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 160us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834979.710835:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 204 00000100:00100000:2.0:1788834979.715095:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788834979.715228:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242396160 00000100:00100000:1.0:1788834979.715239:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242396160 00000100:00100000:1.0:1788834979.715290:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 205 00000100:00100000:1.0:1788834979.715299:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+9:6160:x1875729242396160:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788834979.715332:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788834979.715350:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e61400/0xdf60171e5a5d1b58 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae03f0 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834979.715376:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e61400/0xdf60171e5a5d1b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03f0 expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834979.715389:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e61400/0xdf60171e5a5d1b58 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03f0 expref: 10 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834979.715408:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61400, rc 0) 00000100:00100000:1.0:1788834979.715463:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+10:6160:x1875729242396160:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 164us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834979.715470:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 205 00000100:00100000:0.0:1788834979.752260:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788834979.752419:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242396288 00000100:00100000:1.0:1788834979.752429:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242396288 00000100:00100000:1.0:1788834979.752479:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 206 00000100:00100000:1.0:1788834979.752488:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+10:6160:x1875729242396288:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788834979.752593:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+10:6160:x1875729242396288:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 106us (351us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788834979.752600:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 206 00010000:00010000:2.0:1788834980.330374:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788834980.725105:0:10356:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1018b500 20000000:00000080:2.0:1788834980.726977:0:10356:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9afdba2f9800 uarg=0000000000000000 20000000:01000000:2.0:1788834980.727027:0:10356:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788834980.727033:0:10356:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1788834980.727038:0:10356:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788834980.736803:0:10357:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1788834980.736908:0:10356:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1788834980.745476:0:10356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1788834980.745517:0:10356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1788834980.745547:0:10356:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1788834980.745566:0:10356:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788834980.745586:0:10356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afdb2e63e00/0xdf60171e5a5d1b5f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834980.745604:0:10356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1879 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1872 expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834980.745612:0:10356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdc204b800/0xdf60171e5a5d1887 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1880 expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834980.745619:0:10356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18db lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d18d4 expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834980.745626:0:10356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdb2e63600/0xdf60171e5a5d1a01 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d19fa expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834980.745661:0:10356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdb2e62200/0xdf60171e5a5d1b19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03b1 expref: 9 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834980.745669:0:10356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afdb2e63e00/0xdf60171e5a5d1b5f lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834980.745707:0:10356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdb2e62200/0xdf60171e5a5d1b19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03b1 expref: 9 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834980.745722:0:10356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afdb2e62200/0xdf60171e5a5d1b19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03b1 expref: 9 pid: 6483 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834980.745735:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83684a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1875729253983872:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788834980.745913:0:10356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdb2e63600/0xdf60171e5a5d1a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d19fa expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834980.745923:0:10356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afdb2e63600/0xdf60171e5a5d1a01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d19fa expref: 14 pid: 6483 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834980.746004:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83686d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1875729253984000:0@lo:104: 00000100:00100000:2.0:1788834980.746043:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788834980.746082:0:10356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18db lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d18d4 expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834980.746091:0:10356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d18d4 expref: 14 pid: 6482 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834980.746100:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83685500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1875729253984128:0@lo:104: 00000100:00100000:0.0:1788834980.746114:0:7440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253984000 00000100:00100000:0.0:1788834980.746122:0:7440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253984000 00000100:00100000:2.0:1788834980.746131:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788834980.746162:0:10356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdc204b800/0xdf60171e5a5d1887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1880 expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834980.746169:0:7440:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:2.0:1788834980.746170:0:10356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afdc204b800/0xdf60171e5a5d1887 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1880 expref: 14 pid: 6481 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834980.746177:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83684000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1875729253984256:0@lo:104: 00000100:00100000:0.0:1788834980.746178:0:7440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253984128 00000100:00100000:0.0:1788834980.746181:0:7440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253984128 00000100:00100000:2.0:1788834980.746196:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834980.746196:0:7440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788834980.746204:0:7440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83687b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:10356:x1875729253984000:12345-0@lo:104: 00010000:00010000:2.0:1788834980.746211:0:10356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1879 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1872 expref: 14 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.746214:0:7440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdc204bc00/0xdf60171e5a5d19fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1a01 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834980.746218:0:10356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1879 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1872 expref: 14 pid: 6483 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834980.746225:0:10356:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83686a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1875729253984384:0@lo:104: 00000100:00100000:2.0:1788834980.746242:0:10356:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834980.746251:0:10356:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc826bfc00 going to sleep for 11 seconds 00010000:00010000:0.0:1788834980.746257:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788834980.746262:0:7440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83687b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:10356:x1875729253984000:12345-0@lo:104: Request processed in 60us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834980.746267:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83686d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1875729253984000:0@lo:104: 00000100:00100000:0.0:1788834980.746280:0:7440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788834980.746296:0:7440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253984256 00000100:00100000:0.0:1788834980.746300:0:7440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253984256 00000100:00100000:0.0:1788834980.746310:0:7440:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253984384 00000100:00100000:0.0:1788834980.746445:0:7440:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253984384 00000100:00100000:0.0:1788834980.746463:0:7440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788834980.746468:0:7440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba2f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+5:10356:x1875729253984128:12345-0@lo:104: 00010000:00010000:0.0:1788834980.746475:0:7440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdc2167e00/0xdf60171e5a5d18d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d18db expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.746515:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788834980.746519:0:7440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba2f8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+5:10356:x1875729253984128:12345-0@lo:104: Request processed in 52us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834980.746525:0:7440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00010000:1.0:1788834980.746549:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00000100:00100000:0.0:1788834980.746552:0:7440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1788834980.746557:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdc204bc00/0xdf60171e5a5d19fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1a01 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834980.746557:0:7440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:10356:x1875729253984256:12345-0@lo:104: 00010000:00010000:1.0:1788834980.746564:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204bc00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:1.0:1788834980.746568:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdc204bc00/0xdf60171e5a5d19fa lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1a01 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.746569:0:7440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d1880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1887 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834980.746576:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdc204bc00/0xdf60171e5a5d19fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1a01 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788834980.746583:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdc204bc00/0xdf60171e5a5d19fa lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1a01 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834980.746589:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788834980.746600:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788834980.746605:0:7440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83685f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:10356:x1875729253984256:12345-0@lo:104: Request processed in 48us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834980.746610:0:7440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:1.0:1788834980.746620:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdc204bc00/0xdf60171e5a5d19fa lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1a01 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834980.746621:0:7440:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1788834980.746626:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788834980.746626:0:7440:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83685180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:10356:x1875729253984384:12345-0@lo:104: 00010000:00010000:0.0:1788834980.746632:0:7440:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdc2167200/0xdf60171e5a5d1872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1879 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.746654:0:7440:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:1.0:1788834980.746659:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdc204bc00/0xdf60171e5a5d19fa lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1a01 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834980.746660:0:7440:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83685180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:10356:x1875729253984384:12345-0@lo:104: Request processed in 33us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834980.746665:0:7440:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00010000:1.0:1788834980.746667:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdc204bc00/0xdf60171e5a5d19fa lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1a01 expref: -99 pid: 9479 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834980.746678:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788834980.746681:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788834980.746682:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdc2167e00/0xdf60171e5a5d18d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d18db expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.746685:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d1880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1887 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834980.746687:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc2167e00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:1.0:1788834980.746691:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdc2167e00/0xdf60171e5a5d18d4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d18db expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.746691:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5400 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:0.0:1788834980.746694:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d1880 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1887 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834980.746698:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdc2167e00/0xdf60171e5a5d18d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d18db expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.746701:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d1880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1887 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788834980.746704:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdc2167e00/0xdf60171e5a5d18d4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d18db expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788834980.746708:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d1880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1887 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834980.746710:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788834980.746718:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788834980.746721:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdc2167e00/0xdf60171e5a5d18d4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d18db expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834980.746726:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788834980.746729:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d1880 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1887 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834980.746731:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdc2167e00/0xdf60171e5a5d18d4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d18db expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.746735:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788834980.746747:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdc2167e00/0xdf60171e5a5d18d4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d18db expref: -99 pid: 8396 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.746748:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d1880 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1887 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.746755:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d1880 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1887 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834980.746758:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788834980.746760:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdc2167200/0xdf60171e5a5d1872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1879 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.746764:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834980.746766:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc2167200 already unused, calling callback (ffffffffc149fc20) 00010000:00010000:0.0:1788834980.746766:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788834980.746767:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:00010000:1.0:1788834980.746769:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdc2167200/0xdf60171e5a5d1872 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1879 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.746773:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834980.746775:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdc2167200/0xdf60171e5a5d1872 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1879 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788834980.746781:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdc2167200/0xdf60171e5a5d1872 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1879 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834980.746781:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253984768:0@lo:103: 10000000:01000000:1.0:1788834980.746787:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788834980.746799:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdc2167200/0xdf60171e5a5d1872 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1879 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834980.746804:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1788834980.746806:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788834980.746809:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdc2167200/0xdf60171e5a5d1872 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1879 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834980.746815:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdc2167200/0xdf60171e5a5d1872 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1879 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834980.746830:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00010000:00010000:1.0:1788834980.746833:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788834980.746835:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253984896:0@lo:103: 00010000:00010000:1.0:1788834980.746839:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834980.746841:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788834980.746854:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834980.746890:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253984768 00000100:00100000:0.0:1788834980.746894:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253984768 00010000:00010000:0.0:1788834980.746910:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdc204b800/0xdf60171e5a5d1887 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1880 expref: 15 pid: 6481 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834980.746926:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253984896 00000100:00100000:0.0:1788834980.746928:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253984896 00010000:00010000:0.0:1788834980.746937:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1879 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1872 expref: 16 pid: 6483 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834980.746965:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788834980.746971:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:3614:x1875729253984768:12345-0@lo:103: 00010000:00010000:0.0:1788834980.746981:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788834980.746985:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdc204b800/0xdf60171e5a5d1887 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1880 expref: 16 pid: 6481 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.746994:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdc204b800/0xdf60171e5a5d1887 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1880 expref: 16 pid: 6481 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.747008:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788834980.747031:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:3614:x1875729253984768:12345-0@lo:103: Request processed in 60us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834980.747036:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788834980.747048:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788834980.747053:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:3614:x1875729253984896:12345-0@lo:103: 00010000:00010000:0.0:1788834980.747059:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788834980.747063:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1879 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1872 expref: 15 pid: 6483 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.747071:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1879 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1872 expref: 15 pid: 6483 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.747079:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788834980.747096:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:3614:x1875729253984896:12345-0@lo:103: Request processed in 44us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834980.747101:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788834980.747128:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253984896:0@lo:103: 00000100:00100000:0.0:1788834980.747142:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729253984768:0@lo:103: 00000100:00100000:0.0:1788834980.747176:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253984512:0@lo:103: 00000100:00100000:0.0:1788834980.747198:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834980.747213:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788834980.747218:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253984640:0@lo:103: 00000100:00100000:0.0:1788834980.747237:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834980.747260:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253984512 00000100:00100000:0.0:1788834980.747264:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253984512 00010000:00010000:0.0:1788834980.747277:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdb2e63600/0xdf60171e5a5d1a01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d19fa expref: 15 pid: 6483 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834980.747292:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253984640 00000100:00100000:0.0:1788834980.747295:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253984640 00010000:00010000:0.0:1788834980.747304:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d18d4 expref: 16 pid: 6482 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834980.747341:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788834980.747347:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:3616:x1875729253984512:12345-0@lo:103: 00010000:00010000:0.0:1788834980.747355:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788834980.747359:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdb2e63600/0xdf60171e5a5d1a01 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d19fa expref: 16 pid: 6483 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.747368:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdb2e63600/0xdf60171e5a5d1a01 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d19fa expref: 16 pid: 6483 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.747379:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e63600/0xdf60171e5a5d1a01 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d19fa expref: 16 pid: 6483 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.747387:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788834980.747417:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:3616:x1875729253984512:12345-0@lo:103: Request processed in 70us (218us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834980.747423:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788834980.747435:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788834980.747440:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaae6d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:3616:x1875729253984640:12345-0@lo:103: 00010000:00010000:0.0:1788834980.747448:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788834980.747451:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18db lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d18d4 expref: 14 pid: 6482 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.747458:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18db lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d18d4 expref: 14 pid: 6482 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.747467:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788834980.747485:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaae6d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:3616:x1875729253984640:12345-0@lo:103: Request processed in 45us (247us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834980.747490:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788834980.747527:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253984640:0@lo:103: 00000100:00100000:0.0:1788834980.747535:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253984512:0@lo:103: 00010000:00010000:2.0:1788834980.748555:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d18db lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d18d4 expref: 13 pid: 6482 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834980.748570:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83685500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1875729253984128:0@lo:104: 00010000:00010000:2.0:1788834980.748581:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdc204b800/0xdf60171e5a5d1887 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1880 expref: 12 pid: 6481 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834980.748589:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83684000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1875729253984256:0@lo:104: 00010000:00010000:2.0:1788834980.748597:0:10356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1879 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1872 expref: 11 pid: 6483 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834980.748620:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83686a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1875729253984384:0@lo:104: 00000100:00100000:0.0:1788834980.749729:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834980.749831:0:10356:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83684a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:10356:1875729253983872:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788834980.749859:0:10356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afdb2e63e00/0xdf60171e5a5d1b5f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834980.750687:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242396416 00000100:00100000:0.0:1788834980.750695:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242396416 00010000:00010000:0.0:1788834980.750741:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdb2e62200/0xdf60171e5a5d1b19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03b1 expref: 10 pid: 6483 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834980.750777:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:0.0:1788834980.750785:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8f7875b-4951-482c-9de0-d3888250010c+10:2385:x1875729242396416:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788834980.750798:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788834980.750988:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdb2e62200/0xdf60171e5a5d1b19 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03b1 expref: 10 pid: 6483 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.751001:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdb2e62200/0xdf60171e5a5d1b19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03b1 expref: 10 pid: 6483 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.751018:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e62200/0xdf60171e5a5d1b19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03b1 expref: 10 pid: 6483 timeout: 322 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.751033:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afdb2e63e00/0xdf60171e5a5d1b5f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.751041:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e63e00/0xdf60171e5a5d1b5f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.751057:0:6473:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afdb2e63e00/0xdf60171e5a5d1b5f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.751065:0:6473:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afdb2e63e00/0xdf60171e5a5d1b5f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.751072:0:6473:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afdb2e63e00/0xdf60171e5a5d1b5f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.751079:0:6473:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afdb2e63e00/0xdf60171e5a5d1b5f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.751085:0:6473:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e63e00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788834980.751088:0:6473:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afdb2e63e00/0xdf60171e5a5d1b5f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.751096:0:6473:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afdb2e63e00/0xdf60171e5a5d1b5f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834980.754389:0:10356:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afdb2e63e00/0xdf60171e5a5d1b5f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834980.754427:0:10356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afdb2e63e00/0xdf60171e5a5d1b5f lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.755900:0:6473:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afdb2e63e00/0xdf60171e5a5d1b5f lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.755917:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e63e00/0xdf60171e5a5d1b5f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 10356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834980.756103:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788834980.756175:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8f7875b-4951-482c-9de0-d3888250010c+9:2385:x1875729242396416:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 5386us (6456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834980.756184:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:3.0:1788834981.087977:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834981.088186:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242396544 00000100:00100000:2.0:1788834981.088196:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242396544 00000100:00100000:2.0:1788834981.088269:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 207 00000100:00100000:2.0:1788834981.088279:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+9:6160:x1875729242396544:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788834981.088295:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788834981.088348:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e62200/0xdf60171e5a5d1b66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae03f7 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.088376:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e62200/0xdf60171e5a5d1b66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03f7 expref: 10 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.088388:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e62200/0xdf60171e5a5d1b66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03f7 expref: 10 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.088397:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e62200, rc 0) 00000100:00100000:2.0:1788834981.088453:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+10:6160:x1875729242396544:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 174us (484us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834981.088459:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 207 00000100:00100000:3.0:1788834981.090514:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834981.093520:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242396672 00000100:00100000:2.0:1788834981.093534:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242396672 00000100:00100000:2.0:1788834981.093607:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 208 00000100:00100000:2.0:1788834981.093618:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+10:6160:x1875729242396672:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788834981.093788:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+10:6160:x1875729242396672:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 171us (3281us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834981.093796:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 208 00000100:00100000:0.0:1788834981.107033:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834981.107192:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242396800 00000100:00100000:3.0:1788834981.107213:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242396800 00000100:00100000:3.0:1788834981.107277:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 209 00000100:00100000:3.0:1788834981.107287:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+10:6160:x1875729242396800:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.107467:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+10:6160:x1875729242396800:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 181us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.107475:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 209 00000100:00100000:3.0:1788834981.112639:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788834981.113086:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242396928 00000100:00100000:1.0:1788834981.113097:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242396928 00000100:00100000:1.0:1788834981.113151:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 210 00000100:00100000:1.0:1788834981.113161:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+10:6677:x1875729242396928:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788834981.113357:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+10:6677:x1875729242396928:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 196us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834981.113365:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 210 00000100:00100000:0.0:1788834981.118099:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834981.118195:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242397056 00000100:00100000:2.0:1788834981.118220:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242397056 00000100:00100000:2.0:1788834981.118285:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 211 00000100:00100000:2.0:1788834981.118295:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+10:6677:x1875729242397056:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788834981.118499:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+10:6677:x1875729242397056:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 205us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834981.118506:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 211 10000000:01000000:2.0:1788834981.288302:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788834981.288309:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afc82611000 from 48 10000000:01000000:2.0:1788834981.288447:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788834981.288495:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63600/0xdf60171e5a5d1b6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.288507:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63600/0xdf60171e5a5d1b6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.288519:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63600/0xdf60171e5a5d1b6d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834981.288542:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83684a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253985024:0@lo:101: 00000100:00100000:2.0:1788834981.288610:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834981.288659:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc826bfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788834981.289003:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253985024 00000100:00100000:3.0:1788834981.289010:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253985024 00000100:00100000:3.0:1788834981.289062:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 212 00000100:00100000:3.0:1788834981.289071:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+11:6485:x1875729253985024:12345-0@lo:101: 00010000:00010000:3.0:1788834981.289084:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788834981.289098:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afc8374c800/0xdf60171e5a5d1b74 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1b6d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.289121:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afc8374c800/0xdf60171e5a5d1b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1b6d expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.289132:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afc8374c800/0xdf60171e5a5d1b74 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1b6d expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.289167:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374c800, rc 0) 00000100:00100000:3.0:1788834981.289212:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:6485:x1875729253985024:12345-0@lo:101: Request processed in 140us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.289218:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 212 00000100:00100000:2.0:1788834981.290304:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83684a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253985024:0@lo:101: 00010000:00010000:2.0:1788834981.290344:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63600/0xdf60171e5a5d1b6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1b74 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.290363:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63600/0xdf60171e5a5d1b6d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1b74 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834981.290447:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83684a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253985152:0@lo:501: 00000100:00100000:2.0:1788834981.290488:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834981.290515:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc826bfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788834981.290832:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253985152 00000100:00100000:3.0:1788834981.290839:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253985152 00000100:00100000:3.0:1788834981.290890:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 213 00000100:00100000:3.0:1788834981.290898:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:6485:x1875729253985152:12345-0@lo:501: 00000100:00100000:3.0:1788834981.291914:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:6485:x1875729253985152:12345-0@lo:501: Request processed in 1011us (1420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.291923:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 213 00000100:00100000:2.0:1788834981.292127:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83684a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253985152:0@lo:501: 00000100:00100000:2.0:1788834981.292285:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83684a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253985280:0@lo:503: 00000100:00100000:2.0:1788834981.292399:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834981.292431:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc826bfcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788834981.292502:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253985280 00000100:00100000:3.0:1788834981.292508:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253985280 00000100:00100000:3.0:1788834981.292546:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:3.0:1788834981.292554:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:6485:x1875729253985280:12345-0@lo:503: 00000100:00100000:3.0:1788834981.292646:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:6485:x1875729253985280:12345-0@lo:503: Request processed in 92us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.292653:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788834981.292911:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83684a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253985280:0@lo:503: 00000100:00100000:3.0:1788834981.297014:0:10371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10371:1875729253985408:0@lo:502: 00000100:00100000:3.0:1788834981.297100:0:10371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834981.297196:0:10371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eac3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834981.302910:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253985408 00000100:00100000:2.0:1788834981.302985:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253985408 00000100:00100000:2.0:1788834981.304033:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:2.0:1788834981.304047:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:10371:x1875729253985408:12345-0@lo:502: 00000100:00100000:2.0:1788834981.304213:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:10371:x1875729253985408:12345-0@lo:502: Request processed in 170us (7113us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834981.304221:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:0.0:1788834981.304311:0:10371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10371:1875729253985408:0@lo:502: 00000100:00100000:0.0:1788834981.304400:0:10371:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10371:1875729253985536:0@lo:502: 00000100:00100000:0.0:1788834981.304440:0:10371:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834981.310082:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253985536 00000100:00100000:3.0:1788834981.310098:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253985536 00000100:00100000:3.0:1788834981.310150:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788834981.311948:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:10371:x1875729253985536:12345-0@lo:502: 00000100:00100000:3.0:1788834981.312117:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:10371:x1875729253985536:12345-0@lo:502: Request processed in 178us (7675us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.312125:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:0.0:1788834981.312493:0:10371:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb38a6c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.312519:0:10371:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10371:1875729253985536:0@lo:502: 00000040:00080000:0.0:1788834981.312553:0:10371:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:2.0:1788834981.312722:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:2.0:1788834981.312742:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788834981.312753:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63600/0xdf60171e5a5d1b6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1b74 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.312764:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63600/0xdf60171e5a5d1b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1b74 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834981.312785:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1788834981.312787:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1788834981.312790:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1788834981.312898:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1b7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.312907:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1b7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.312916:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1b7b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834981.312993:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83684a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253985664:0@lo:101: 00000100:00100000:2.0:1788834981.313034:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834981.313062:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc826bf480 going to sleep for 11 seconds 00000100:00100000:3.0:1788834981.313116:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253985664 00000100:00100000:3.0:1788834981.313123:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253985664 00000100:00100000:3.0:1788834981.313228:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:3.0:1788834981.313236:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+12:6485:x1875729253985664:12345-0@lo:101: 00010000:00010000:3.0:1788834981.313246:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788834981.313258:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afc8374de00/0xdf60171e5a5d1b82 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1b7b expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.313279:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afc8374de00/0xdf60171e5a5d1b82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1b7b expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.313290:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afc8374de00/0xdf60171e5a5d1b82 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1b7b expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.313298:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374de00, rc 0) 00000100:00100000:3.0:1788834981.313378:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:6485:x1875729253985664:12345-0@lo:101: Request processed in 143us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.313385:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00000100:00100000:0.0:1788834981.314006:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83684a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253985664:0@lo:101: 00010000:00010000:0.0:1788834981.314020:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1b7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1b82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.314030:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1b7b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1b82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834981.314092:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253985792:0@lo:501: 00000100:00100000:0.0:1788834981.314131:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834981.314233:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb38a6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788834981.314283:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253985792 00000100:00100000:2.0:1788834981.314288:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253985792 00000100:00100000:2.0:1788834981.314346:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:2.0:1788834981.314354:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:6485:x1875729253985792:12345-0@lo:501: 00000100:00100000:2.0:1788834981.314467:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:6485:x1875729253985792:12345-0@lo:501: Request processed in 114us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834981.314473:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:0.0:1788834981.316641:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253985792:0@lo:501: 00000100:00100000:0.0:1788834981.316699:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253985920:0@lo:503: 00000100:00100000:0.0:1788834981.316765:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834981.316806:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb38a6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788834981.317245:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253985920 00000100:00100000:3.0:1788834981.317252:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253985920 00000100:00100000:3.0:1788834981.317302:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788834981.317311:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd829d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:6485:x1875729253985920:12345-0@lo:503: 00000100:00100000:3.0:1788834981.320175:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd829d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:6485:x1875729253985920:12345-0@lo:503: Request processed in 2858us (3402us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.320188:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:0.0:1788834981.320354:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253985920:0@lo:503: 00000100:00100000:2.0:1788834981.321085:0:10375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83686a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10375:1875729253986048:0@lo:502: 00000100:00100000:2.0:1788834981.321133:0:10375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834981.321170:0:10375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc826bf780 going to sleep for 11 seconds 00000100:00100000:3.0:1788834981.321561:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253986048 00000100:00100000:3.0:1788834981.321567:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253986048 00000100:00100000:3.0:1788834981.321616:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 220 00000100:00100000:3.0:1788834981.321625:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd878e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:10375:x1875729253986048:12345-0@lo:502: 00000100:00100000:3.0:1788834981.321736:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd878e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:10375:x1875729253986048:12345-0@lo:502: Request processed in 112us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.321745:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 220 00000100:00100000:0.0:1788834981.321832:0:10375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83686a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10375:1875729253986048:0@lo:502: 00000020:01000000:0.0:1788834981.321855:0:10375:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788834981.321873:0:10375:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788834981.321876:0:10375:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788834981.321881:0:10375:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1788834981.321902:0:10375:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10375:1875729253986176:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788834981.322052:0:10375:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834981.322081:0:10375:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb38a6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788834981.322530:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253986176 00000100:00100000:2.0:1788834981.322535:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253986176 00000100:00100000:2.0:1788834981.322569:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1788834981.322575:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd878e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:10375:x1875729253986176:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788834981.322660:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd878e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:10375:x1875729253986176:12345-0@lo:502:llog_process_th.0 Request processed in 84us (607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834981.322667:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:0.0:1788834981.323084:0:10375:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10375:1875729253986176:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788834981.323107:0:10375:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788834981.323112:0:10375:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788834981.323113:0:10375:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788834981.323117:0:10375:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 11 count 11 00000020:01000000:2.0:1788834981.323640:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1788834981.323662:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1788834981.323671:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1b7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1b82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.323682:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1b82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834981.323690:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788834981.323693:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afc82611000 from 4 10000000:01000000:2.0:1788834981.323696:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788834981.323724:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62e00/0xdf60171e5a5d1b89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.323733:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62e00/0xdf60171e5a5d1b89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.323743:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62e00/0xdf60171e5a5d1b89 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834981.323759:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83684000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253986304:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788834981.323793:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834981.323836:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc826bfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788834981.323961:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253986304 00000100:00100000:3.0:1788834981.323967:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253986304 00000100:00100000:3.0:1788834981.324004:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 222 00000100:00100000:3.0:1788834981.324013:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd878e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+13:6485:x1875729253986304:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788834981.324024:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788834981.324036:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afc8374c000/0xdf60171e5a5d1b90 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1b89 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.324057:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afc8374c000/0xdf60171e5a5d1b90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1b89 expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.324068:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afc8374c000/0xdf60171e5a5d1b90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1b89 expref: 14 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.324076:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374c000, rc 0) 00000100:00100000:3.0:1788834981.324117:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd878e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:6485:x1875729253986304:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (323us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.324123:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 222 00000100:00100000:2.0:1788834981.325962:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83684000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253986304:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788834981.325992:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62e00/0xdf60171e5a5d1b89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1b90 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.326005:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62e00/0xdf60171e5a5d1b89 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1b90 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834981.326073:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83684000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253986432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788834981.326124:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834981.326151:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc826bfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788834981.327931:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253986432 00000100:00100000:3.0:1788834981.327942:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253986432 00000100:00100000:3.0:1788834981.327991:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1788834981.328000:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd878d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:6485:x1875729253986432:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.328154:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd878d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:6485:x1875729253986432:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 154us (2028us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.328161:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1788834981.328489:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83684000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253986432:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.328535:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253986560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.328578:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834981.328613:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb38a6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788834981.328674:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253986560 00000100:00100000:2.0:1788834981.328680:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253986560 00000100:00100000:2.0:1788834981.328718:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:2.0:1788834981.328727:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:6485:x1875729253986560:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788834981.328805:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:6485:x1875729253986560:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 79us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834981.328825:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788834981.329044:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253986560:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.329461:0:10376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10376:1875729253986688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788834981.329500:0:10376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834981.329531:0:10376:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834981.329644:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253986688 00000100:00100000:2.0:1788834981.329648:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253986688 00000100:00100000:2.0:1788834981.329679:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1788834981.329685:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:10376:x1875729253986688:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788834981.329763:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:10376:x1875729253986688:12345-0@lo:502:llog_process_th.0 Request processed in 78us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834981.329769:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1788834981.330060:0:10376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10376:1875729253986688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788834981.330083:0:10376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788834981.330092:0:10376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788834981.330095:0:10376:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788834981.330102:0:10376:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afc82611000 00000020:00000080:3.0:1788834981.330105:0:10376:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788834981.330179:0:10376:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10376:1875729253986816:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788834981.330212:0:10376:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834981.330234:0:10376:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b2cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834981.332055:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253986816 00000100:00100000:2.0:1788834981.332067:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253986816 00000100:00100000:2.0:1788834981.332109:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:2.0:1788834981.332117:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:10376:x1875729253986816:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788834981.332252:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:10376:x1875729253986816:12345-0@lo:502:llog_process_th.0 Request processed in 134us (2038us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834981.332259:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:3.0:1788834981.332508:0:10376:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10376:1875729253986816:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788834981.332539:0:10376:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788834981.332546:0:10376:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788834981.332547:0:10376:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1788834981.332551:0:10376:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1788834981.333079:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1788834981.333102:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788834981.333112:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62e00/0xdf60171e5a5d1b89 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1b90 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.333122:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62e00/0xdf60171e5a5d1b89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1b90 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834981.333133:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1788834981.333136:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afdba102000 from 48 10000000:01000000:2.0:1788834981.333139:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788834981.333169:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63c00/0xdf60171e5a5d1b97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.333176:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63c00/0xdf60171e5a5d1b97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.333185:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63c00/0xdf60171e5a5d1b97 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834981.333204:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83685500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253986944:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788834981.333247:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834981.333284:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc826bf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788834981.333513:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253986944 00000100:00100000:3.0:1788834981.333519:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253986944 00000100:00100000:3.0:1788834981.333551:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1788834981.333559:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+14:6485:x1875729253986944:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788834981.333571:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788834981.333584:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afc8374d400/0xdf60171e5a5d1b9e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1b97 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.333614:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afc8374d400/0xdf60171e5a5d1b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1b97 expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.333625:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afc8374d400/0xdf60171e5a5d1b9e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1b97 expref: 15 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.333634:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374d400, rc 0) 00000100:00100000:3.0:1788834981.333671:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:6485:x1875729253986944:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.333677:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1788834981.335115:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83685500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253986944:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788834981.335137:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63c00/0xdf60171e5a5d1b97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1b9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.335156:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63c00/0xdf60171e5a5d1b97 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1b9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834981.335225:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83685500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253987072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788834981.335269:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834981.335305:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc826bf9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788834981.338050:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253987072 00000100:00100000:3.0:1788834981.338064:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253987072 00000100:00100000:3.0:1788834981.338116:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:3.0:1788834981.338126:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:6485:x1875729253987072:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.338278:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:6485:x1875729253987072:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 153us (3007us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.338285:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:2.0:1788834981.339783:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83685500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253987072:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788834981.340290:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83685500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253987200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788834981.340403:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834981.341518:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc826bf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.347162:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253987200 00000100:00100000:0.0:1788834981.347178:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253987200 00000100:00100000:0.0:1788834981.347233:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788834981.347242:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:6485:x1875729253987200:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.347421:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:6485:x1875729253987200:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 179us (7017us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.347428:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788834981.347497:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83685500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253987200:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.347720:0:10379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10379:1875729253987328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788834981.347763:0:10379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834981.347787:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253987328 00000100:00100000:0.0:1788834981.347790:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253987328 00000100:00100000:0.0:1788834981.349627:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788834981.349645:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:10379:x1875729253987328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788834981.349782:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:10379:x1875729253987328:12345-0@lo:502:llog_process_th.0 Request processed in 144us (2018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.349789:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 230 00000100:00100000:0.0:1788834981.349859:0:10379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb38a63c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.349891:0:10379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10379:1875729253987328:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788834981.349961:0:10379:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10379:1875729253987456:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788834981.350002:0:10379:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834981.350025:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253987456 00000100:00100000:0.0:1788834981.350030:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253987456 00000100:00100000:0.0:1788834981.350061:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788834981.350067:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:10379:x1875729253987456:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788834981.350127:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:10379:x1875729253987456:12345-0@lo:502:llog_process_th.0 Request processed in 60us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.350133:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1788834981.350161:0:10379:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2e0e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.350172:0:10379:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10379:1875729253987456:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1788834981.350189:0:10379:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788834981.350249:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788834981.350270:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788834981.350279:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63c00/0xdf60171e5a5d1b97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1b9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.350288:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63c00/0xdf60171e5a5d1b97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1b9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788834981.350296:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:0.0:1788834981.350299:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:0.0:1788834981.350301:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1788834981.350341:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031800/0xdf60171e5a5d1ba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.350349:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd80031800/0xdf60171e5a5d1ba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.350358:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd80031800/0xdf60171e5a5d1ba5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834981.350370:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253987584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.350395:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834981.350417:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2e0e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.350430:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253987584 00000100:00100000:0.0:1788834981.350433:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253987584 00000100:00100000:0.0:1788834981.350456:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788834981.350463:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+15:6485:x1875729253987584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788834981.350472:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788834981.350485:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd80030000/0xdf60171e5a5d1bac lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1ba5 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.350507:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd80030000/0xdf60171e5a5d1bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1ba5 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.350516:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd80030000/0xdf60171e5a5d1bac lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1ba5 expref: 16 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.350524:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd80030000, rc 0) 00000100:00100000:0.0:1788834981.350549:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253987584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 88us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.350555:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:0.0:1788834981.350585:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253987584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788834981.350596:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd80031800/0xdf60171e5a5d1ba5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1bac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.350604:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd80031800/0xdf60171e5a5d1ba5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1bac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834981.350643:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253987712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.350665:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834981.350686:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2e0e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.350698:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253987712 00000100:00100000:0.0:1788834981.350701:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253987712 00000100:00100000:0.0:1788834981.350722:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788834981.350727:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253987712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.350824:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253987712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.350830:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1788834981.350858:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253987712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.350897:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253987840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.350945:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834981.350959:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2e0e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.350970:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253987840 00000100:00100000:0.0:1788834981.350973:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253987840 00000100:00100000:0.0:1788834981.350995:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788834981.351001:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253987840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.351070:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253987840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (125us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.351077:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:0.0:1788834981.351115:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253987840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.358137:0:10380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10380:1875729253987968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788834981.358221:0:10380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834981.358258:0:10380:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda0a8c240 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.358420:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253987968 00000100:00100000:0.0:1788834981.358428:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253987968 00000100:00100000:0.0:1788834981.358481:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:0.0:1788834981.358490:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:10380:x1875729253987968:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788834981.358621:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:10380:x1875729253987968:12345-0@lo:502:llog_process_th.0 Request processed in 131us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.358636:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788834981.358934:0:10380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10380:1875729253987968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788834981.359077:0:10380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788834981.359086:0:10380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788834981.359088:0:10380:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1788834981.359093:0:10380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1788834981.359115:0:10380:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10380:1875729253988096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788834981.359154:0:10380:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834981.359177:0:10380:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8b7b2d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.359225:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253988096 00000100:00100000:0.0:1788834981.359230:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253988096 00000100:00100000:0.0:1788834981.359261:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:0.0:1788834981.359269:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:10380:x1875729253988096:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788834981.359365:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:10380:x1875729253988096:12345-0@lo:502:llog_process_th.0 Request processed in 96us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.359372:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788834981.360375:0:10380:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10380:1875729253988096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788834981.360404:0:10380:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788834981.360410:0:10380:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788834981.360413:0:10380:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1788834981.360416:0:10380:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 14 count 14 00000020:01000000:2.0:1788834981.360570:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1788834981.360591:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788834981.360602:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031800/0xdf60171e5a5d1ba5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1bac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.360612:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd80031800/0xdf60171e5a5d1ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1bac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788834981.360621:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788834981.360623:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afdba102000 from 4 10000000:01000000:2.0:1788834981.360626:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788834981.360649:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1bb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.360657:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1bb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.360678:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1bb3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834981.360693:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83686d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253988224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788834981.360731:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834981.360760:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc826bf900 going to sleep for 11 seconds 00000100:00100000:3.0:1788834981.360817:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253988224 00000100:00100000:3.0:1788834981.360824:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253988224 00000100:00100000:3.0:1788834981.360871:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1788834981.360880:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+16:6485:x1875729253988224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788834981.360890:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788834981.360903:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afc8374da00/0xdf60171e5a5d1bba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1bb3 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.361116:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afc8374da00/0xdf60171e5a5d1bba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1bb3 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.361128:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afc8374da00/0xdf60171e5a5d1bba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1bb3 expref: 17 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.361136:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374da00, rc 0) 00000100:00100000:3.0:1788834981.361179:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253988224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 301us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.361186:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1788834981.361251:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83686d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253988224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788834981.361262:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1bb3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1bba expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.361270:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1bb3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1bba expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788834981.361346:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83686d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253988352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788834981.361372:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834981.361387:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc826bf900 going to sleep for 11 seconds 00000100:00100000:3.0:1788834981.362425:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253988352 00000100:00100000:3.0:1788834981.362433:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253988352 00000100:00100000:3.0:1788834981.362473:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1788834981.362481:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253988352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.362605:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253988352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 125us (1232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.362612:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1788834981.362691:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83686d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253988352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788834981.362726:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83686d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253988480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788834981.362767:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834981.362790:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc826bf900 going to sleep for 11 seconds 00000100:00100000:3.0:1788834981.362840:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253988480 00000100:00100000:3.0:1788834981.362843:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253988480 00000100:00100000:3.0:1788834981.362906:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1788834981.362914:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253988480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.363025:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253988480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 111us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.363032:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:2.0:1788834981.364583:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83686d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253988480:0@lo:503:ll_cfg_requeue.0 00010000:00010000:2.0:1788834981.369554:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788834981.369769:0:10381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10381:1875729253988608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788834981.369850:0:10381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834981.369896:0:10381:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd98a0bf00 going to sleep for 11 seconds 00000100:00100000:2.0:1788834981.370044:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253988608 00000100:00100000:2.0:1788834981.370051:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253988608 00000100:00100000:2.0:1788834981.370096:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1788834981.370112:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:10381:x1875729253988608:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788834981.370232:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:10381:x1875729253988608:12345-0@lo:502:llog_process_th.0 Request processed in 119us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834981.370240:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1788834981.370473:0:10381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10381:1875729253988608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788834981.370500:0:10381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788834981.370509:0:10381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788834981.370512:0:10381:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788834981.370520:0:10381:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afdba102000 00000020:00000080:1.0:1788834981.370522:0:10381:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788834981.370591:0:10381:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10381:1875729253988736:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788834981.370626:0:10381:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834981.370646:0:10381:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8b333600 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.373038:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253988736 00000100:00100000:0.0:1788834981.373049:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253988736 00000100:00100000:0.0:1788834981.373104:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788834981.373114:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:10381:x1875729253988736:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788834981.373262:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:10381:x1875729253988736:12345-0@lo:502:llog_process_th.0 Request processed in 150us (2634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.373270:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:0.0:1788834981.377100:0:10381:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10381:1875729253988736:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788834981.377148:0:10381:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788834981.377159:0:10381:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788834981.377161:0:10381:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1788834981.377166:0:10381:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1788834981.377352:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1788834981.377376:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788834981.377385:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1bb3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1bba expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.377396:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1bb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1bba expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788834981.377405:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1788834981.377407:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afdb279f000 from 48 10000000:01000000:3.0:1788834981.377410:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1788834981.377442:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d1bc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.377449:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d1bc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.377458:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d1bc1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834981.377487:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253988864:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.377542:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834981.377576:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8375a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.377628:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253988864 00000100:00100000:0.0:1788834981.377634:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253988864 00000100:00100000:0.0:1788834981.377680:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1788834981.377688:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+17:6485:x1875729253988864:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788834981.377699:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788834981.377710:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d1bc8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1bc1 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.377737:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d1bc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1bc1 expref: 18 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.377747:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d1bc8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1bc1 expref: 18 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.377755:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd80031c00, rc 0) 00000100:00100000:0.0:1788834981.377788:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253988864:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.377795:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1788834981.378014:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253988864:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788834981.378026:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d1bc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1bc8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.378035:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d1bc1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1bc8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834981.378083:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253988992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.378107:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834981.378129:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8375a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.381062:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253988992 00000100:00100000:0.0:1788834981.381076:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253988992 00000100:00100000:0.0:1788834981.381131:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1788834981.381140:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253988992:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.381304:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253988992:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 165us (3195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.381330:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1788834981.381466:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253988992:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.381511:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253989120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.381557:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834981.381594:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8375a900 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.381770:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253989120 00000100:00100000:0.0:1788834981.381775:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253989120 00000100:00100000:0.0:1788834981.381808:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1788834981.381823:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253989120:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.381908:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253989120:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 86us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.381914:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1788834981.382068:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253989120:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.382243:0:10384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10384:1875729253989248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788834981.382273:0:10384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834981.382288:0:10384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8375af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.382353:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253989248 00000100:00100000:0.0:1788834981.382357:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253989248 00000100:00100000:0.0:1788834981.382385:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1788834981.382391:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:10384:x1875729253989248:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788834981.382454:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:10384:x1875729253989248:12345-0@lo:502:llog_process_th.0 Request processed in 63us (180us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.382461:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1788834981.382533:0:10384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10384:1875729253989248:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788834981.382564:0:10384:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10384:1875729253989376:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788834981.382596:0:10384:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834981.382618:0:10384:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8375af00 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.382655:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253989376 00000100:00100000:0.0:1788834981.382659:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253989376 00000100:00100000:0.0:1788834981.382686:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1788834981.382692:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:10384:x1875729253989376:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788834981.382748:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:10384:x1875729253989376:12345-0@lo:502:llog_process_th.0 Request processed in 55us (150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.382753:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1788834981.383622:0:10384:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10384:1875729253989376:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788834981.383649:0:10384:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788834981.383903:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:0.0:1788834981.383921:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788834981.385084:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d1bc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1bc8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.385098:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d1bc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1bc8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788834981.385110:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0001 10000000:01000000:0.0:1788834981.385113:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 43 10000000:01000000:0.0:1788834981.385116:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788834981.385146:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1bcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.385155:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1bcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.385177:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1bcf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834981.385197:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253989504:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.385250:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834981.385289:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd86b53b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788834981.386028:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253989504 00000100:00100000:3.0:1788834981.386036:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253989504 00000100:00100000:3.0:1788834981.386086:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788834981.386096:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+18:6485:x1875729253989504:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788834981.386108:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788834981.386121:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d1bd6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1bcf expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.386143:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d1bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1bcf expref: 19 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.386155:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d1bd6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1bcf expref: 19 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.386163:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374d800, rc 0) 00000100:00100000:3.0:1788834981.386210:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:6485:x1875729253989504:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (959us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.386216:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1788834981.386259:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253989504:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788834981.386272:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1bcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1bd6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.386281:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1bcf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1bd6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788834981.386359:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253989632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.386386:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834981.386401:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8375a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788834981.386413:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253989632 00000100:00100000:3.0:1788834981.386416:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253989632 00000100:00100000:3.0:1788834981.386438:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788834981.386445:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:6485:x1875729253989632:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.386548:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:6485:x1875729253989632:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (160us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.386555:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:3.0:1788834981.386583:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253989632:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.386605:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253989760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.386642:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834981.386655:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8375a600 going to sleep for 11 seconds 00000100:00100000:3.0:1788834981.386666:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253989760 00000100:00100000:3.0:1788834981.386670:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253989760 00000100:00100000:3.0:1788834981.386689:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788834981.386695:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:6485:x1875729253989760:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.386765:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:6485:x1875729253989760:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (122us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.386772:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1788834981.386810:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253989760:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.395054:0:10385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10385:1875729253989888:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788834981.395133:0:10385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834981.395213:0:10385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb38a66c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834981.402076:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253989888 00000100:00100000:2.0:1788834981.402089:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253989888 00000100:00100000:2.0:1788834981.402382:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788834981.402392:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:10385:x1875729253989888:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788834981.402551:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:10385:x1875729253989888:12345-0@lo:502:llog_process_th.0 Request processed in 160us (7418us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834981.402559:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1788834981.402626:0:10385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836bb800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10385:1875729253989888:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788834981.402660:0:10385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788834981.402670:0:10385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788834981.402672:0:10385:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788834981.402678:0:10385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1788834981.402709:0:10385:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83686d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10385:1875729253990016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788834981.402751:0:10385:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834981.402777:0:10385:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc826bf6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.404125:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253990016 00000100:00100000:0.0:1788834981.404136:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253990016 00000100:00100000:0.0:1788834981.404183:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:0.0:1788834981.404193:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:10385:x1875729253990016:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788834981.404356:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:10385:x1875729253990016:12345-0@lo:502:llog_process_th.0 Request processed in 164us (1604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.404364:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1788834981.405084:0:10385:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83686d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10385:1875729253990016:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788834981.405119:0:10385:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788834981.405127:0:10385:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788834981.405129:0:10385:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788834981.405133:0:10385:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 46 count 46 00000020:01000000:1.0:1788834981.405460:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 43-45 (rc=0) 10000000:01000000:1.0:1788834981.405483:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:1.0:1788834981.405492:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1bcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1bd6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834981.405503:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1bcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1bd6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834981.405521:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788834981.405523:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afdb279f000 from 4 10000000:01000000:1.0:1788834981.405526:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788834981.405557:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1bdd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834981.405566:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1bdd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834981.405575:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1bdd lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834981.405593:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253990144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788834981.405636:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834981.405668:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8b333240 going to sleep for 11 seconds 00000100:00100000:2.0:1788834981.405729:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253990144 00000100:00100000:2.0:1788834981.405734:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253990144 00000100:00100000:2.0:1788834981.405774:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1788834981.405787:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:6485:x1875729253990144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788834981.405798:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788834981.406853:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1be4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1bdd expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.406895:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1be4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1bdd expref: 20 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.406906:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1be4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1bdd expref: 20 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788834981.406915:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e63800, rc 0) 00000100:00100000:2.0:1788834981.407142:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:6485:x1875729253990144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1354us (1504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834981.407149:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1788834981.412167:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253990144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788834981.412198:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1bdd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1be4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834981.412211:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1bdd lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1be4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834981.412300:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253990272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.419353:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834981.419403:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8b333240 going to sleep for 11 seconds 00000100:00100000:3.0:1788834981.420052:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253990272 00000100:00100000:3.0:1788834981.420074:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253990272 00000100:00100000:3.0:1788834981.420122:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1788834981.420132:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:6485:x1875729253990272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.420274:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:6485:x1875729253990272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 144us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.420283:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1788834981.421388:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253990272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788834981.421438:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253990400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788834981.421496:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834981.421540:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8b333240 going to sleep for 11 seconds 00000100:00100000:3.0:1788834981.421908:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253990400 00000100:00100000:3.0:1788834981.421914:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253990400 00000100:00100000:3.0:1788834981.421970:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788834981.421978:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:6485:x1875729253990400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.422076:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:6485:x1875729253990400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 99us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.422083:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1788834981.422215:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253990400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788834981.424267:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10388:1875729253990528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788834981.424361:0:10388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834981.424402:0:10388:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8b333540 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.424474:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253990528 00000100:00100000:0.0:1788834981.424481:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253990528 00000100:00100000:0.0:1788834981.424520:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:0.0:1788834981.424529:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:10388:x1875729253990528:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788834981.424643:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:10388:x1875729253990528:12345-0@lo:502:llog_process_th.0 Request processed in 114us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.424651:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:1.0:1788834981.424750:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10388:1875729253990528:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788834981.424777:0:10388:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788834981.424786:0:10388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788834981.424789:0:10388:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788834981.424797:0:10388:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afdb279f000 00000020:00000080:1.0:1788834981.424800:0:10388:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788834981.424894:0:10388:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10388:1875729253990656:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788834981.426726:0:10388:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834981.426771:0:10388:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8b333540 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.426883:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253990656 00000100:00100000:0.0:1788834981.426890:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253990656 00000100:00100000:0.0:1788834981.427028:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:0.0:1788834981.427037:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:10388:x1875729253990656:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788834981.427163:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:10388:x1875729253990656:12345-0@lo:502:llog_process_th.0 Request processed in 127us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.427170:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1788834981.433552:0:10388:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10388:1875729253990656:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788834981.433598:0:10388:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788834981.433608:0:10388:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788834981.433611:0:10388:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788834981.433615:0:10388:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788834981.438403:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788834981.438441:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788834981.438453:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1bdd lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1be4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.438466:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1bdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1be4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788834981.438478:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1788834981.438481:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afd85554000 from 48 10000000:01000000:0.0:1788834981.438483:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788834981.438520:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1beb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.438528:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1beb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.438539:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1beb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834981.438560:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253990784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.438618:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834981.438665:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c240 going to sleep for 11 seconds 00000100:00100000:1.0:1788834981.438748:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253990784 00000100:00100000:1.0:1788834981.438756:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253990784 00000100:00100000:1.0:1788834981.438804:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1788834981.438824:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:6485:x1875729253990784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788834981.438836:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788834981.438847:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e61800/0xdf60171e5a5d1bf2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1beb expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834981.438877:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e61800/0xdf60171e5a5d1bf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1beb expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834981.438887:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e61800/0xdf60171e5a5d1bf2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1beb expref: 21 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834981.438904:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61800, rc 0) 00000100:00100000:1.0:1788834981.438954:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729253990784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 132us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834981.438960:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1788834981.439147:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253990784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788834981.439162:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1beb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1bf2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.439171:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1beb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1bf2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834981.439227:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253990912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.439348:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834981.439367:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c240 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.439381:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253990912 00000100:00100000:0.0:1788834981.439386:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253990912 00000100:00100000:0.0:1788834981.439414:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788834981.439422:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729253990912:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.439524:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729253990912:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 103us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.439531:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1788834981.439552:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253990912:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.439576:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253991040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.439616:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834981.439626:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c240 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.439640:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253991040 00000100:00100000:0.0:1788834981.439643:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253991040 00000100:00100000:0.0:1788834981.439661:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788834981.439666:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729253991040:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.439744:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729253991040:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 77us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.439751:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:0.0:1788834981.439779:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253991040:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.442456:0:10391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10391:1875729253991168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788834981.442531:0:10391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834981.442565:0:10391:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8375ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788834981.442764:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253991168 00000100:00100000:1.0:1788834981.442771:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253991168 00000100:00100000:1.0:1788834981.442819:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1788834981.442829:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:10391:x1875729253991168:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788834981.442967:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:10391:x1875729253991168:12345-0@lo:502:llog_process_th.0 Request processed in 139us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834981.442973:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1788834981.443385:0:10391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10391:1875729253991168:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788834981.443431:0:10391:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10391:1875729253991296:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788834981.443469:0:10391:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834981.443491:0:10391:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8375ac00 going to sleep for 11 seconds 00000100:00100000:1.0:1788834981.444352:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253991296 00000100:00100000:1.0:1788834981.444360:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253991296 00000100:00100000:1.0:1788834981.444401:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1788834981.444409:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:10391:x1875729253991296:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788834981.444506:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:10391:x1875729253991296:12345-0@lo:502:llog_process_th.0 Request processed in 97us (1036us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834981.444513:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1788834981.445687:0:10391:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10391:1875729253991296:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1788834981.445723:0:10391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:1.0:1788834981.445902:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 48-51 (rc=0) 10000000:01000000:1.0:1788834981.445922:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788834981.445941:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1beb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1bf2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834981.445952:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1beb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1bf2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834981.445977:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1788834981.445980:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 43 10000000:01000000:1.0:1788834981.445982:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1788834981.446012:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60a00/0xdf60171e5a5d1bf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834981.446020:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60a00/0xdf60171e5a5d1bf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834981.446027:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60a00/0xdf60171e5a5d1bf9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834981.446044:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253991424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788834981.446095:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834981.446134:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8b333600 going to sleep for 11 seconds 00000100:00100000:3.0:1788834981.447036:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253991424 00000100:00100000:3.0:1788834981.447045:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253991424 00000100:00100000:3.0:1788834981.447090:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1788834981.447107:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729253991424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788834981.447120:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788834981.447134:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afc8374ca00/0xdf60171e5a5d1c00 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1bf9 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.447157:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afc8374ca00/0xdf60171e5a5d1c00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1bf9 expref: 22 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.447168:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afc8374ca00/0xdf60171e5a5d1c00 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1bf9 expref: 22 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788834981.447176:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374ca00, rc 0) 00000100:00100000:3.0:1788834981.447236:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729253991424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (1139us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.447253:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788834981.447394:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253991424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788834981.447408:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60a00/0xdf60171e5a5d1bf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.447417:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60a00/0xdf60171e5a5d1bf9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1c00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834981.447475:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253991552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.447504:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834981.447532:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788834981.447587:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253991552 00000100:00100000:3.0:1788834981.447591:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253991552 00000100:00100000:3.0:1788834981.447625:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788834981.447631:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729253991552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788834981.447739:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729253991552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 107us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834981.447747:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788834981.449373:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253991552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.449417:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253991680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.449473:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834981.449507:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.449527:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253991680 00000100:00100000:0.0:1788834981.449532:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253991680 00000100:00100000:0.0:1788834981.449561:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788834981.449568:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729253991680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.449662:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729253991680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 93us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.449678:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1788834981.449715:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253991680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788834981.450676:0:10392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10392:1875729253991808:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788834981.450723:0:10392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834981.450757:0:10392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8b333600 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.450886:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253991808 00000100:00100000:0.0:1788834981.450893:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253991808 00000100:00100000:0.0:1788834981.451036:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1788834981.451046:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:10392:x1875729253991808:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788834981.451146:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:10392:x1875729253991808:12345-0@lo:502:llog_process_th.0 Request processed in 102us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.457021:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788834981.457099:0:10392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10392:1875729253991808:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788834981.457136:0:10392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788834981.457145:0:10392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788834981.457147:0:10392:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788834981.457154:0:10392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788834981.457185:0:10392:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10392:1875729253991936:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788834981.475086:0:10392:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834981.475131:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253991936 00000100:00100000:1.0:1788834981.475140:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253991936 00000100:00100000:1.0:1788834981.475199:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788834981.475208:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:10392:x1875729253991936:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788834981.475376:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:10392:x1875729253991936:12345-0@lo:502:llog_process_th.0 Request processed in 169us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834981.475384:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1788834981.482469:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834981.482509:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834981.482544:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834981.482566:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834981.482588:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834981.482629:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242397568 00000100:00100000:2.0:1788834981.482639:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242397568 00000100:00100000:2.0:1788834981.482697:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242397696 00000100:00100000:2.0:1788834981.482700:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242397696 00000100:00100000:2.0:1788834981.482743:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:2.0:1788834981.482754:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242397568:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788834981.482836:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83687800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242397568:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 84us (325us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834981.482845:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:2.0:1788834981.482872:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:2.0:1788834981.482878:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242397696:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788834981.482903:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242397696:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (314us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834981.482909:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:2.0:1788834981.482942:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242397312 00000100:00100000:2.0:1788834981.482946:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242397312 00000100:00100000:2.0:1788834981.482975:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242397440 00000100:00100000:2.0:1788834981.482978:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242397440 00000100:00100000:2.0:1788834981.482998:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:2.0:1788834981.483005:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+6:2386:x1875729242397312:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788834981.483033:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83686d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+6:2386:x1875729242397312:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 29us (574us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834981.483039:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:2.0:1788834981.483052:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:2.0:1788834981.483058:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242397440:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788834981.483081:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83686680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242397440:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834981.483086:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00080000:2.0:1788834981.483106:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788834981.483116:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788834981.483119:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788834981.483121:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788834981.484427:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242397184 00000100:00100000:2.0:1788834981.484438:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242397184 00000100:00100000:2.0:1788834981.484491:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 267 00000100:00100000:2.0:1788834981.484500:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+10:2386:x1875729242397184:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788834981.484552:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+10:2386:x1875729242397184:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 53us (2007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834981.484559:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 267 00000100:00100000:1.0:1788834981.490157:0:10392:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd98a0bf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788834981.490202:0:10392:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10392:1875729253991936:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788834981.490252:0:10392:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788834981.490261:0:10392:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788834981.490263:0:10392:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1788834981.490270:0:10392:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:1.0:1788834981.491373:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 43-45 (rc=0) 10000000:01000000:1.0:1788834981.491398:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1788834981.491408:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60a00/0xdf60171e5a5d1bf9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834981.491421:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60a00/0xdf60171e5a5d1bf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788834981.491430:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788834981.491433:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afd85554000 from 4 10000000:01000000:1.0:1788834981.491436:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788834981.491466:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d1c07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834981.491474:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d1c07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834981.491485:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d1c07 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834981.491511:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253992064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788834981.491564:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834981.491597:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8b333600 going to sleep for 11 seconds 00000100:00100000:1.0:1788834981.491615:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253992064 00000100:00100000:1.0:1788834981.491620:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253992064 00000100:00100000:1.0:1788834981.491660:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788834981.491667:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729253992064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788834981.491679:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788834981.491691:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e60400/0xdf60171e5a5d1c0e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1c07 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834981.491712:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e60400/0xdf60171e5a5d1c0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1c07 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834981.491722:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e60400/0xdf60171e5a5d1c0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1c07 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834981.491730:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60400, rc 0) 00000100:00100000:1.0:1788834981.491759:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729253992064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 92us (195us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834981.491765:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788834981.491799:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253992064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788834981.491809:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d1c07 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c0e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788834981.491896:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d1c07 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1c0e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788834981.492010:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253992192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788834981.492034:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834981.492049:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd83e4e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788834981.492060:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253992192 00000100:00100000:1.0:1788834981.492063:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253992192 00000100:00100000:1.0:1788834981.492083:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788834981.492088:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729253992192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788834981.492178:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729253992192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 89us (143us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834981.492185:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788834981.492207:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253992192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788834981.492229:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253992320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788834981.492713:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834981.492733:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd83e4e480 going to sleep for 11 seconds 00000100:00100000:1.0:1788834981.493148:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253992320 00000100:00100000:1.0:1788834981.493154:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253992320 00000100:00100000:1.0:1788834981.493179:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788834981.493185:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729253992320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788834981.494192:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729253992320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1002us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834981.494202:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1788834981.494416:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253992320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788834981.495586:0:10393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83685500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10393:1875729253992448:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788834981.495649:0:10393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834981.495688:0:10393:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc826bf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.495735:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253992448 00000100:00100000:0.0:1788834981.495742:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253992448 00000100:00100000:0.0:1788834981.495785:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788834981.495793:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:10393:x1875729253992448:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788834981.496044:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:10393:x1875729253992448:12345-0@lo:502:llog_process_th.0 Request processed in 128us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.496054:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1788834981.496136:0:10393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83685500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10393:1875729253992448:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788834981.496161:0:10393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788834981.496170:0:10393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788834981.496172:0:10393:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788834981.496180:0:10393:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afd85554000 00000020:00000080:2.0:1788834981.496183:0:10393:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1788834981.496265:0:10393:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83685500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10393:1875729253992576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788834981.496298:0:10393:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834981.496336:0:10393:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc826bf9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788834981.496349:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253992576 00000100:00100000:2.0:1788834981.496352:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253992576 00000100:00100000:2.0:1788834981.496374:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788834981.496380:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:10393:x1875729253992576:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788834981.496443:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:10393:x1875729253992576:12345-0@lo:502:llog_process_th.0 Request processed in 63us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834981.496455:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1788834981.496490:0:10393:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83685500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:10393:1875729253992576:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788834981.496507:0:10393:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788834981.496510:0:10393:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788834981.496511:0:10393:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1788834981.496515:0:10393:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1788834981.500465:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1788834981.500502:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788834981.500515:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d1c07 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c0e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.500526:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d1c07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c0e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788834981.500535:0:6485:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1788834981.500537:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9afdab4bb370 from 1 10000000:01000000:0.0:1788834981.500546:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1788834981.500577:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80030400/0xdf60171e5a5d1c15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.500585:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd80030400/0xdf60171e5a5d1c15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.500596:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd80030400/0xdf60171e5a5d1c15 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834981.500616:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253992704:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.500678:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834981.500717:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.500737:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253992704 00000100:00100000:0.0:1788834981.500743:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253992704 00000100:00100000:0.0:1788834981.500783:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788834981.500791:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729253992704:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788834981.500803:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788834981.505011:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d1c1c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1c15 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.505056:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d1c1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1c15 expref: 24 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.505070:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d1c1c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1c15 expref: 24 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.505079:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd80031600, rc 0) 00000100:00100000:0.0:1788834981.505158:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:6485:x1875729253992704:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 4366us (4480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834981.505176:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:0.0:1788834981.505243:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253992704:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788834981.505261:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd80030400/0xdf60171e5a5d1c15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c1c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.505271:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd80030400/0xdf60171e5a5d1c15 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1c1c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788834981.505361:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253992832:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.505395:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834981.505423:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788834981.505439:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253992832 00000100:00100000:0.0:1788834981.505444:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253992832 00000100:00100000:0.0:1788834981.505471:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788834981.505479:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:6485:x1875729253992832:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788834981.505552:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:6485:x1875729253992832:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 73us (156us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788834981.505558:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:0.0:1788834981.505586:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729253992832:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1788834981.505610:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1788834981.505616:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80030400/0xdf60171e5a5d1c15 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c1c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834981.505624:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd80030400/0xdf60171e5a5d1c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c1c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788834982.373684:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788834983.205547:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788834983.205570:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253992960:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788834983.205637:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834983.205791:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253992960 00000100:00100000:1.0:1788834983.205812:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253992960 00000100:00100000:1.0:1788834983.205885:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788834983.205895:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253992960:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788834983.205925:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788834983.205969:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83685500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253992960:12345-0@lo:13:osp-pre-0-1.0 Request processed in 76us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834983.205977:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788834983.206031:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729253993216:0@lo:400:kworker.0 00000100:00100000:0.0:1788834983.206049:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253993344:0@lo:400:kworker.0 00000100:00100000:1.0:1788834983.206061:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834983.206080:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729253993728:0@lo:400:kworker.0 00000100:00100000:0.0:1788834983.206090:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834983.206099:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834983.206111:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729253993856:0@lo:400:kworker.0 00000100:00100000:1.0:1788834983.206112:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729253994240:0@lo:400:kworker.0 00000100:00100000:1.0:1788834983.206130:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834983.206138:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253993216 00000100:00100000:0.0:1788834983.206141:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253993216 00000100:00100000:1.0:1788834983.206160:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729253993472:0@lo:400:kworker.0 00000100:00100000:1.0:1788834983.206183:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834983.206201:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253993984:0@lo:400:kworker.0 00000100:00100000:1.0:1788834983.206224:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834983.206239:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253993728 00000100:00100000:1.0:1788834983.206242:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253994496:0@lo:400:kworker.0 00000100:00100000:0.0:1788834983.206242:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253993728 00000100:00100000:0.0:1788834983.206256:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253994240 00000100:00100000:0.0:1788834983.206258:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253994240 00000100:00100000:1.0:1788834983.206261:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834983.206270:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253993472 00000100:00100000:0.0:1788834983.206273:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253993472 00000100:00100000:1.0:1788834983.206283:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788834983.206285:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788834983.206288:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253993088:0@lo:400:kworker.0 00000100:00100000:0.0:1788834983.206290:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729253993216:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788834983.206337:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834983.206359:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253993600:0@lo:400:kworker.0 00000100:00100000:1.0:1788834983.206381:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834983.206396:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875729253994112:0@lo:400:kworker.0 00000100:00100000:0.0:1788834983.206411:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83109180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729253993216:12345-0@lo:400:kworker.0 Request processed in 120us (349us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834983.206418:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788834983.206426:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834983.206430:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253994112 00000100:00100000:0.0:1788834983.206433:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253994112 00000100:00100000:1.0:1788834983.206448:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788834983.206522:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253993344 00000100:00100000:3.0:1788834983.206526:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253993344 00000100:00100000:3.0:1788834983.206545:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253993600 00000100:00100000:3.0:1788834983.206548:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253993600 00000100:00100000:3.0:1788834983.206560:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788834983.206567:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253993344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788834983.206615:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253993344:12345-0@lo:400:kworker.0 Request processed in 48us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834983.206622:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788834983.206634:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788834983.206641:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253993600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788834983.206669:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253993600:12345-0@lo:400:kworker.0 Request processed in 29us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834983.206676:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788834983.206709:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253993600:0@lo:400:kworker.0 00000100:00100000:3.0:1788834983.206722:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788834983.206728:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253994624:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788834983.206752:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834983.206777:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253994624 00000100:00100000:3.0:1788834983.206781:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253994624 00000100:00100000:3.0:1788834983.206805:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1788834983.206812:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253994624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788834983.206825:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788834983.206870:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253994624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 59us (117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834983.206876:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1788834983.206905:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83682d80 x1875729253994624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834983.206920:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253994624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788834983.207065:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729253993728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788834983.207104:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729253993728:12345-0@lo:400:kworker.0 Request processed in 649us (1003us total) trans 0 rc 0/0 00000100:00080000:2.0:1788834983.207750:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788834983.207754:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788834983.207757:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788834983.209247:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253993984 00000100:00100000:3.0:1788834983.209260:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253993984 00000100:00100000:3.0:1788834983.209355:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253994496 00000100:00100000:3.0:1788834983.209359:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253994496 00000100:00100000:3.0:1788834983.209391:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788834983.209400:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253993984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788834983.209482:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253993984:12345-0@lo:400:kworker.0 Request processed in 83us (3257us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834983.209489:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788834983.209504:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1788834983.209510:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253994496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788834983.209539:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e813800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729253994496:12345-0@lo:400:kworker.0 Request processed in 29us (3277us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834983.209545:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788834983.209712:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788834983.209725:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729253994240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788834983.209766:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729253994240:12345-0@lo:400:kworker.0 Request processed in 45us (3634us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834983.209772:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788834983.209789:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788834983.209796:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729253993472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788834983.209836:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729253993472:12345-0@lo:400:kworker.0 Request processed in 41us (3651us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834983.209843:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788834983.209868:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788834983.209876:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875729253994112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788834983.209905:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82074e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875729253994112:12345-0@lo:400:kworker.0 Request processed in 31us (3478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834983.209910:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1788834983.215402:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788834983.215418:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253993088 00000100:00100000:0.0:1788834983.215428:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253993088 00000100:00100000:1.0:1788834983.215470:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834983.215474:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788834983.215482:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729253993088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788834983.215514:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253994368:0@lo:400:kworker.0 00000100:00100000:0.0:1788834983.215548:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729253993088:12345-0@lo:400:kworker.0 Request processed in 67us (9233us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834983.215549:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834983.215555:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:0.0:1788834983.215591:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253993856 00000100:00100000:0.0:1788834983.215594:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253993856 00000100:00100000:1.0:1788834983.215599:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253993344:0@lo:400:kworker.0 00000100:00100000:1.0:1788834983.215612:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788834983.215619:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253994752:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788834983.215621:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788834983.215627:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729253993856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788834983.215644:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834983.215657:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729253993856:12345-0@lo:400:kworker.0 Request processed in 30us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834983.215665:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00080000:1.0:1788834983.215669:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc836ba680 x1875729253993856/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834983.215680:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729253993856:0@lo:400:kworker.0 00000100:00100000:2.0:1788834983.215682:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253994368 00000100:00100000:2.0:1788834983.215689:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253994368 00000100:00100000:0.0:1788834983.215702:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253994752 00000100:00100000:0.0:1788834983.215707:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253994752 00000100:00100000:1.0:1788834983.215727:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729253993216:0@lo:400:kworker.0 00000100:00100000:2.0:1788834983.215736:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788834983.215740:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788834983.215741:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729253993728:0@lo:400:kworker.0 00000100:00100000:2.0:1788834983.215748:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82075c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253994368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788834983.215751:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253994752:12345-0@lo:41:osp-pre-1-0.0 00010000:00080000:1.0:1788834983.215756:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba3e3100 x1875729253994240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788834999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834983.215764:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729253994240:0@lo:400:kworker.0 00000004:00000024:0.0:1788834983.215795:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00010000:00080000:1.0:1788834983.215799:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8310aa00 x1875729253992960/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834983.215806:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82075c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253994368:12345-0@lo:400:kworker.0 Request processed in 59us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834983.215817:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788834983.215833:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82077480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253994752:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834983.215836:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253992960:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788834983.215840:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:2.0:1788834983.215845:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788834983.215864:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788834983.215883:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253993088:0@lo:400:kworker.0 00000100:00100000:1.0:1788834983.215897:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875729253994112:0@lo:400:kworker.0 00000100:00100000:0.0:1788834983.215900:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253994752:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788834983.215909:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729253993472:0@lo:400:kworker.0 00010000:00080000:0.0:1788834983.215909:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba3e2300 x1875729253994368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788834999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834983.215917:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253994368:0@lo:400:kworker.0 00010000:00080000:1.0:1788834983.215920:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc836b9f80 x1875729253993984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788834999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834983.215928:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253993984:0@lo:400:kworker.0 00010000:00080000:1.0:1788834983.215939:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba3e0700 x1875729253994496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788834999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834983.215946:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729253994496:0@lo:400:kworker.0 00010000:00010000:1.0:1788834983.398706:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788834983.718474:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788834983.718497:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253994880:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788834983.718568:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834983.718746:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253994880 00000100:00100000:1.0:1788834983.718755:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253994880 00000100:00100000:1.0:1788834983.718811:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788834983.718820:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253994880:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788834983.718858:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788834983.718984:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83682d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253994880:12345-0@lo:13:osp-pre-1-1.0 Request processed in 164us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834983.718993:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788834983.719934:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788834983.719947:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253995008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788834983.719992:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834983.720039:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253995008 00000100:00100000:1.0:1788834983.720043:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253995008 00000100:00100000:1.0:1788834983.720076:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788834983.720085:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253995008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788834983.720102:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788834983.720281:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253995008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 193us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834983.720289:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1788834983.720348:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8310aa00 x1875729253995008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788834983.720368:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253995008:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1788834983.724300:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc82076300 x1875729253994880/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788834999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834983.724356:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82076300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253994880:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788834984.423544:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788834984.741558:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253995136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788834984.741630:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834984.741934:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253995136 00000100:00100000:3.0:1788834984.741943:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253995136 00000100:00100000:3.0:1788834984.741995:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1788834984.742004:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253995136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788834984.742034:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788834984.742082:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253995136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 79us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834984.742089:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788834984.742290:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83683b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253995136:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788834985.445584:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834986.469450:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788834986.590195:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834986.590234:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834986.590262:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834986.590298:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834986.590346:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834986.590372:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242398336 00000100:00100000:3.0:1788834986.590381:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242398336 00000100:00100000:3.0:1788834986.590428:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242398208 00000100:00100000:3.0:1788834986.590431:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242398208 00000100:00100000:3.0:1788834986.590453:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:3.0:1788834986.590462:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242398336:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788834986.590531:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242398336:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 71us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834986.590539:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:3.0:1788834986.590555:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:3.0:1788834986.590562:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242398208:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788834986.590586:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242398208:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834986.590592:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:2.0:1788834986.590767:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242398080 00000100:00100000:2.0:1788834986.590773:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242398080 00000100:00100000:2.0:1788834986.590810:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242397952 00000100:00100000:2.0:1788834986.590813:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242397952 00000100:00100000:2.0:1788834986.590848:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 74 00000100:00100000:2.0:1788834986.590855:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242398080:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788834986.590889:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83683100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242398080:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 35us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834986.590902:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 74 00000100:00100000:2.0:1788834986.590915:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 75 00000100:00100000:2.0:1788834986.590920:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+6:2386:x1875729242397952:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788834986.590946:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83680700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+6:2386:x1875729242397952:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 26us (647us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834986.590952:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 75 00000100:00080000:2.0:1788834986.590976:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788834986.590980:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788834986.590983:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788834986.590985:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788834986.591469:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242397824 00000100:00100000:0.0:1788834986.591474:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242397824 00000100:00100000:0.0:1788834986.591522:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 276 00000100:00100000:0.0:1788834986.591530:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+10:2386:x1875729242397824:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788834986.591568:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+10:2386:x1875729242397824:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 38us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834986.591575:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 276 00000001:02000400:3.0:1788834987.348307:0:10667:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:1.0:1788834987.496128:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788834988.325572:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253995264:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788834988.325641:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834988.325726:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253995264 00000100:00100000:1.0:1788834988.325732:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253995264 00000100:00100000:3.0:1788834988.325887:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788834988.325897:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253995392:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788834988.325925:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834988.325956:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253995392 00000100:00100000:3.0:1788834988.325959:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253995392 00000100:00100000:3.0:1788834988.325990:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788834988.325999:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253995392:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788834988.326024:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788834988.326067:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253995392:12345-0@lo:13:osp-pre-0-1.0 Request processed in 68us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834988.326083:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:3.0:1788834988.326135:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83683480 x1875729253995392/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834988.326152:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83683480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253995392:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788834988.326407:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788834988.326416:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729253995264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788834988.326429:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788834988.326467:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729253995264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834988.326473:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1788834988.326554:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83680e00 x1875729253995264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834988.326567:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253995264:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788834988.327041:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788834988.327052:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253995648:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788834988.327085:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834988.327126:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253995648 00000100:00100000:3.0:1788834988.327131:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253995648 00000100:00100000:3.0:1788834988.327160:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788834988.327167:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253995648:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788834988.327191:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788834988.327406:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253995648:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834988.327414:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788834988.327450:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253995648:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788834988.327609:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253995904:0@lo:400:kworker.0 00000100:00100000:0.0:1788834988.327641:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834988.327668:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729253996416:0@lo:400:kworker.0 00000100:00100000:1.0:1788834988.327782:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729253996032:0@lo:400:kworker.0 00000100:00100000:1.0:1788834988.327812:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834988.327841:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729253996544:0@lo:400:kworker.0 00000100:00100000:1.0:1788834988.327862:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834988.327887:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788834988.327893:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253995520:0@lo:400:kworker.0 00000100:00100000:1.0:1788834988.327919:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834988.327940:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729253996160:0@lo:400:kworker.0 00000100:00100000:1.0:1788834988.327960:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788834988.327977:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253996672:0@lo:400:kworker.0 00000100:00100000:1.0:1788834988.327998:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834988.328148:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834988.328185:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788834988.328191:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875729253995776:0@lo:400:kworker.0 00000100:00100000:0.0:1788834988.328214:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834988.328302:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729253996288:0@lo:400:kworker.0 00000100:00100000:0.0:1788834988.328354:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834988.328367:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253996800:0@lo:400:kworker.0 00000100:00100000:0.0:1788834988.328387:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834988.328416:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253995520 00000100:00100000:0.0:1788834988.328421:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253995520 00000100:00100000:0.0:1788834988.328453:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788834988.328460:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729253995520:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788834988.328499:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729253995520:12345-0@lo:400:kworker.0 Request processed in 40us (579us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834988.328505:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1788834988.328531:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253996032 00000100:00100000:0.0:1788834988.328535:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253996032 00000100:00100000:0.0:1788834988.328552:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253996544 00000100:00100000:0.0:1788834988.328554:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253996544 00000100:00100000:0.0:1788834988.328566:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253996160 00000100:00100000:0.0:1788834988.328568:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253996160 00000100:00100000:0.0:1788834988.328578:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253996416 00000100:00100000:0.0:1788834988.328580:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253996416 00000100:00100000:0.0:1788834988.328589:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253995776 00000100:00100000:0.0:1788834988.328591:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253995776 00000100:00100000:0.0:1788834988.328600:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253996288 00000100:00100000:0.0:1788834988.328602:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253996288 00000100:00100000:0.0:1788834988.328613:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788834988.328619:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729253996032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788834988.328649:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729253996032:12345-0@lo:400:kworker.0 Request processed in 30us (836us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834988.328663:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788834988.328675:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788834988.328680:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729253996544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788834988.328802:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788834988.328810:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729253996160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788834988.328854:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729253996160:12345-0@lo:400:kworker.0 Request processed in 45us (892us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834988.328860:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788834988.328880:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788834988.328885:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729253996416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788834988.328922:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729253996416:12345-0@lo:400:kworker.0 Request processed in 36us (774us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834988.328927:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1788834988.328939:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788834988.328944:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875729253995776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788834988.328971:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875729253995776:12345-0@lo:400:kworker.0 Request processed in 27us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834988.328976:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788834988.328987:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788834988.328993:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729253996288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788834988.329019:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729253996288:12345-0@lo:400:kworker.0 Request processed in 26us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834988.329024:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1788834988.329042:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253996672 00000100:00100000:3.0:1788834988.329046:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253996672 00000100:00100000:3.0:1788834988.329073:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253996800 00000100:00100000:3.0:1788834988.329079:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253996800 00000100:00100000:3.0:1788834988.329112:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788834988.329119:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253996672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788834988.329149:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253996672:12345-0@lo:400:kworker.0 Request processed in 32us (1151us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834988.329154:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788834988.329165:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788834988.329170:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253996800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788834988.329208:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253996800:12345-0@lo:400:kworker.0 Request processed in 37us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834988.329214:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788834988.329548:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729253996544:12345-0@lo:400:kworker.0 Request processed in 866us (1683us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834988.329555:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788834988.329597:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875729253995776:0@lo:400:kworker.0 00010000:00080000:0.0:1788834988.329610:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbf9b7800 x1875729253996288/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834988.329621:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729253996288:0@lo:400:kworker.0 00010000:00080000:0.0:1788834988.329632:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbf9b6d80 x1875729253996800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834988.329640:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253996800:0@lo:400:kworker.0 00000100:00100000:0.0:1788834988.329650:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729253996416:0@lo:400:kworker.0 00000100:00100000:0.0:1788834988.329676:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253995904 00000100:00100000:0.0:1788834988.329681:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253995904 00000100:00100000:0.0:1788834988.329931:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788834988.329940:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253995904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788834988.329987:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253995904:12345-0@lo:400:kworker.0 Request processed in 49us (2345us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834988.329993:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788834988.330044:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253995904:0@lo:400:kworker.0 00000100:00080000:2.0:1788834988.330218:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788834988.330233:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788834988.330236:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788834988.330238:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788834988.330429:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729253995520:0@lo:400:kworker.0 00000100:00100000:2.0:1788834988.330444:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729253996160:0@lo:400:kworker.0 00010000:00080000:2.0:1788834988.330454:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbf9b4a80 x1875729253996672/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834988.330462:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253996672:0@lo:400:kworker.0 00000100:00100000:2.0:1788834988.330472:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729253996032:0@lo:400:kworker.0 00010000:00080000:2.0:1788834988.330481:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbf9b5880 x1875729253996544/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834988.330488:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729253996544:0@lo:400:kworker.0 00010000:00010000:3.0:1788834988.519420:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788834988.837566:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788834988.837589:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253996928:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788834988.837661:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834988.837735:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788834988.837745:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253997056:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788834988.837797:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834988.837839:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253996928 00000100:00100000:3.0:1788834988.837855:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253996928 00000100:00100000:3.0:1788834988.837894:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253997056 00000100:00100000:3.0:1788834988.837898:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253997056 00000100:00100000:3.0:1788834988.837915:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788834988.837923:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253996928:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788834988.837955:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788834988.838004:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253996928:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834988.838012:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788834988.838030:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788834988.838038:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253997056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788834988.838049:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788834988.838078:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83680000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729253997056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 42us (281us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834988.838085:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1788834988.838120:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8345f100 x1875729253997056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834988.838148:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729253997056:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1788834988.838179:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83686a00 x1875729253996928/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834988.838189:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253996928:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788834989.546392:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788834989.863789:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253997184:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788834989.863861:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834989.863937:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253997184 00000100:00100000:3.0:1788834989.863944:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253997184 00000100:00100000:3.0:1788834989.863988:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788834989.863996:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253997184:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788834989.864027:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788834989.864131:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83682a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253997184:12345-0@lo:41:osp-pre-0-1.0 Request processed in 134us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834989.864138:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788834989.864155:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83681f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253997184:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788834990.565759:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788834991.590831:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788834991.710214:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834991.710270:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788834991.710299:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242398464 00000100:00100000:3.0:1788834991.710311:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788834991.710313:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242398464 00000100:00100000:1.0:1788834991.710420:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 278 00000100:00100000:1.0:1788834991.710433:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+10:2385:x1875729242398464:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788834991.710482:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788834991.710536:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+10:2385:x1875729242398464:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 104us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834991.710545:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 278 00000100:00100000:1.0:1788834991.710594:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242398720 00000100:00100000:1.0:1788834991.710599:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242398720 00000100:00100000:1.0:1788834991.710636:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242398592 00000100:00100000:1.0:1788834991.710639:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242398592 00000100:00100000:1.0:1788834991.710663:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:1.0:1788834991.710680:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242398720:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788834991.711038:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834991.711082:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:3.0:1788834991.711097:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+6:2385:x1875729242398592:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788834991.711167:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83681f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+6:2385:x1875729242398592:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 75us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834991.711188:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:3.0:1788834991.711221:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242398976 00000100:00100000:3.0:1788834991.711228:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242398976 00000100:00100000:3.0:1788834991.711268:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242398848 00000100:00100000:3.0:1788834991.711271:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242398848 00000100:00100000:3.0:1788834991.711295:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:3.0:1788834991.711301:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242398976:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788834991.711354:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83683800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242398976:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 52us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834991.711361:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:3.0:1788834991.711374:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:3.0:1788834991.711381:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242398848:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788834991.711404:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83683b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242398848:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834991.711409:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00080000:0.0:1788834991.712005:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788834991.712013:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788834991.712027:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788834991.712030:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788834991.715080:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83681180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242398720:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 4389us (4799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834991.716561:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 82 00000001:02000400:1.0:1788834992.501758:0:10911:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing yml_node 00010000:00010000:0.0:1788834992.615309:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788834993.448519:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253997312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788834993.448591:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834993.448648:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788834993.448656:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253997440:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788834993.448681:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834993.448713:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253997568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788834993.448736:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834993.448773:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253997440 00000100:00100000:3.0:1788834993.448792:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253997440 00000100:00100000:3.0:1788834993.448833:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253997568 00000100:00100000:3.0:1788834993.448848:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253997568 00000100:00100000:3.0:1788834993.448868:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788834993.448875:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729253997440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788834993.448903:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788834993.448941:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729253997440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834993.448948:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788834993.448963:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788834993.448969:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253997568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788834993.448977:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788834993.449001:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253997568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 33us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834993.449006:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1788834993.449023:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1788834993.449057:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83680a80 x1875729253997568/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834993.449074:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253997568:0@lo:13:osp-pre-0-1.0 00010000:00080000:3.0:1788834993.449101:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83681880 x1875729253997440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834993.449111:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253997440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788834993.449913:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253997312 00000100:00100000:0.0:1788834993.449921:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253997312 00000100:00100000:0.0:1788834993.449958:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788834993.449965:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729253997312:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788834993.449992:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788834993.450041:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729253997312:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (1450us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834993.450047:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1788834993.450364:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253997312:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788834993.451916:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729253997696:0@lo:400:kworker.0 00000100:00100000:3.0:1788834993.451987:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834993.452023:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729253998208:0@lo:400:kworker.0 00000100:00100000:3.0:1788834993.452060:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834993.452080:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253998720:0@lo:400:kworker.0 00000100:00100000:3.0:1788834993.452100:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834993.452119:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1788834993.452124:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729253998080:0@lo:400:kworker.0 00000100:00100000:3.0:1788834993.452143:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834993.452157:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729253998592:0@lo:400:kworker.0 00000100:00100000:3.0:1788834993.452173:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834993.452199:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253997696 00000100:00100000:3.0:1788834993.452205:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253997696 00000100:00100000:3.0:1788834993.452247:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788834993.452254:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729253997696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788834993.452298:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729253997696:12345-0@lo:400:kworker.0 Request processed in 44us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834993.452306:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1788834993.452361:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253998208 00000100:00100000:3.0:1788834993.452365:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253998208 00000100:00100000:3.0:1788834993.452398:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253998080 00000100:00100000:3.0:1788834993.452401:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253998080 00000100:00100000:3.0:1788834993.452417:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253998592 00000100:00100000:3.0:1788834993.452420:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253998592 00000100:00100000:3.0:1788834993.452434:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788834993.452440:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729253998208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788834993.452471:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729253998208:12345-0@lo:400:kworker.0 Request processed in 31us (411us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834993.452477:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788834993.452487:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788834993.452498:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729253998080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788834993.452521:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729253998080:12345-0@lo:400:kworker.0 Request processed in 24us (378us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834993.452526:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788834993.452535:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788834993.452540:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875729253998592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788834993.452558:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875729253998592:12345-0@lo:400:kworker.0 Request processed in 18us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834993.452563:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788834993.452578:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253998720 00000100:00100000:3.0:1788834993.452580:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253998720 00000100:00100000:3.0:1788834993.452603:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788834993.452608:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253998720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788834993.452631:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729253998720:12345-0@lo:400:kworker.0 Request processed in 24us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834993.452636:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1788834993.452659:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788834993.452663:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788834993.452665:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788834993.452687:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729253998080:0@lo:400:kworker.0 00010000:00080000:3.0:1788834993.452698:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365dc00 x1875729253998592/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834993.452708:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729253998592:0@lo:400:kworker.0 00000100:00100000:3.0:1788834993.452716:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729253997696:0@lo:400:kworker.0 00000100:00100000:3.0:1788834993.452723:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729253998208:0@lo:400:kworker.0 00010000:00080000:3.0:1788834993.452738:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365c000 x1875729253998720/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834993.452747:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729253998720:0@lo:400:kworker.0 00000100:00100000:0.0:1788834993.452857:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253997952:0@lo:400:kworker.0 00000100:00100000:0.0:1788834993.452888:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834993.452914:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729253998464:0@lo:400:kworker.0 00000100:00100000:0.0:1788834993.452932:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834993.452944:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788834993.452950:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875729253997824:0@lo:400:kworker.0 00000100:00100000:0.0:1788834993.452965:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834993.452975:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729253998336:0@lo:400:kworker.0 00000100:00100000:0.0:1788834993.452990:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834993.452999:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253998848:0@lo:400:kworker.0 00000100:00100000:0.0:1788834993.453014:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834993.453050:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253998464 00000100:00100000:0.0:1788834993.453054:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253998464 00000100:00100000:0.0:1788834993.453075:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253997824 00000100:00100000:0.0:1788834993.453077:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253997824 00000100:00100000:0.0:1788834993.453086:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253998336 00000100:00100000:0.0:1788834993.453093:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253998336 00000100:00100000:0.0:1788834993.453107:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788834993.453112:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729253998464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788834993.453143:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729253998464:12345-0@lo:400:kworker.0 Request processed in 30us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834993.453149:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788834993.453159:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788834993.453164:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875729253997824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788834993.453182:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875729253997824:12345-0@lo:400:kworker.0 Request processed in 18us (216us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834993.453187:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788834993.453195:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788834993.453200:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729253998336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788834993.453217:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729253998336:12345-0@lo:400:kworker.0 Request processed in 17us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834993.453223:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788834993.453243:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875729253997824:0@lo:400:kworker.0 00010000:00080000:0.0:1788834993.453252:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365ce00 x1875729253998336/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834993.453261:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729253998336:0@lo:400:kworker.0 00000100:00100000:0.0:1788834993.453268:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729253998464:0@lo:400:kworker.0 00000100:00100000:3.0:1788834993.455606:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253998848 00000100:00100000:3.0:1788834993.455621:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253998848 00000100:00100000:3.0:1788834993.455686:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788834993.455695:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253998848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788834993.455798:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253998848:12345-0@lo:400:kworker.0 Request processed in 103us (2781us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834993.455805:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:3.0:1788834993.455843:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788834993.455847:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788834993.455851:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788834993.455861:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253997952 00000100:00100000:3.0:1788834993.455866:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253997952 00000100:00100000:3.0:1788834993.455892:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788834993.455897:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253997952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788834993.455934:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253997952:12345-0@lo:400:kworker.0 Request processed in 36us (3044us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834993.455940:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:3.0:1788834993.455982:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365df80 x1875729253998848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834993.455997:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253998848:0@lo:400:kworker.0 00000100:00100000:3.0:1788834993.456009:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253997952:0@lo:400:kworker.0 00010000:00010000:1.0:1788834993.638445:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788834993.958653:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253998976:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788834993.958738:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834993.958826:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253998976 00000100:00100000:3.0:1788834993.958833:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253998976 00000100:00100000:3.0:1788834993.958881:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788834993.958891:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253998976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788834993.958922:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788834993.958968:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729253998976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834993.958976:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1788834993.959018:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc836bb480 x1875729253998976/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834993.959035:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729253998976:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788834993.965616:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253999104:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788834993.965687:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834993.965756:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253999104 00000100:00100000:2.0:1788834993.965764:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253999104 00000100:00100000:2.0:1788834993.965817:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788834993.965825:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253999104:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788834993.965846:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788834993.965890:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83685c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253999104:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (202us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834993.965898:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1788834993.965939:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83684a80 x1875729253999104/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835009 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834993.965957:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83684a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253999104:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788834994.663172:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788834994.981919:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788834994.981948:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253999232:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788834994.982034:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834994.982344:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253999232 00000100:00100000:3.0:1788834994.982353:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253999232 00000100:00100000:3.0:1788834994.982399:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1788834994.982406:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253999232:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788834994.982436:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788834994.982482:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729253999232:12345-0@lo:41:osp-pre-0-1.0 Request processed in 77us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834994.982487:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788834994.982607:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729253999232:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788834995.686390:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788834996.643376:0:11094:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.108 00010000:00010000:1.0:1788834996.710863:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788834996.829566:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834996.829642:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834996.829696:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788834996.829723:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242399360 00000100:00100000:3.0:1788834996.829733:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242399360 00000100:00100000:3.0:1788834996.829811:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242399232 00000100:00100000:3.0:1788834996.829814:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242399232 00000100:00100000:3.0:1788834996.829838:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 90 00000100:00100000:3.0:1788834996.829858:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2388:x1875729242399360:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788834996.829944:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2388:x1875729242399360:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 98us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834996.829951:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 90 00000100:00100000:3.0:1788834996.829967:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 91 00000100:00100000:3.0:1788834996.829974:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+6:2388:x1875729242399232:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788834996.829997:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+6:2388:x1875729242399232:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 24us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834996.830002:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 91 00000100:00080000:3.0:1788834996.830019:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788834996.830023:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788834996.835724:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242399104 00000100:00100000:1.0:1788834996.835735:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242399104 00000100:00100000:2.0:1788834996.836814:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788834996.836861:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788834996.836991:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 280 00000100:00100000:0.0:1788834996.837003:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+10:2388:x1875729242399104:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788834996.837044:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242399488 00000100:00100000:1.0:1788834996.837049:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242399488 00000100:00100000:0.0:1788834996.837076:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+10:2388:x1875729242399104:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 76us (7520us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834996.837083:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 280 00000100:00100000:1.0:1788834996.837093:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242399616 00000100:00100000:1.0:1788834996.837096:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242399616 00000100:00100000:1.0:1788834996.837115:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:1.0:1788834996.837122:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2384:x1875729242399488:12345-192.168.203.22@tcp:9:kworker.0 00000020:00000080:1.0:1788834996.837146:0:8403:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1b2e 00000100:00080000:2.0:1788834996.837233:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788834996.837237:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788834996.837340:0:8403:0:(import.c:65:import_set_state_nolock()) ffff9afc8369e000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788834996.837390:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788834996.837507:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83684a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+2:2384:x1875729242399488:12345-192.168.203.22@tcp:9:kworker.0 Request processed in 384us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834996.837514:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:1.0:1788834996.837529:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:1.0:1788834996.837536:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2384:x1875729242399616:12345-192.168.203.22@tcp:9:kworker.0 00000020:00000080:1.0:1788834996.837548:0:8403:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1b35 00000100:00080000:1.0:1788834996.837554:0:8403:0:(import.c:65:import_set_state_nolock()) ffff9afc8337e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788834996.837578:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788834996.837653:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+2:2384:x1875729242399616:12345-192.168.203.22@tcp:9:kworker.0 Request processed in 117us (792us total) trans 0 rc 0/0 00000100:00100000:1.0:1788834996.837670:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00010000:00010000:2.0:1788834996.837817:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788834996.841539:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788834997.733553:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788834998.567071:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253999360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788834998.567140:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834998.567893:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253999488:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788834998.567933:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834998.567978:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253999488 00000100:00100000:3.0:1788834998.567986:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253999488 00000100:00100000:3.0:1788834998.568037:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788834998.568047:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253999488:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788834998.568076:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788834998.568116:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729253999488:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834998.568122:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:3.0:1788834998.568162:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83682680 x1875729253999488/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834998.568198:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729253999488:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788834998.568545:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788834998.568976:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729253999744:0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.569017:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834998.569044:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875729254000256:0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.569078:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834998.569094:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254000768:0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.569115:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834998.569145:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788834998.569151:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729253999616:0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.569176:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834998.569196:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254000128:0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.569216:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834998.569232:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254000640:0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.569251:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834998.569277:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253999872:0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.569301:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834998.569351:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254000384:0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.569373:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834998.569392:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254000896:0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.569413:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834998.569433:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788834998.569439:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254000000:0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.569458:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834998.569475:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875729254000512:0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.569510:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788834998.569537:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253999744 00000100:00100000:2.0:1788834998.569542:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253999744 00000100:00100000:2.0:1788834998.569570:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254000256 00000100:00100000:2.0:1788834998.569573:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254000256 00000100:00100000:2.0:1788834998.569602:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254000128 00000100:00100000:2.0:1788834998.569606:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254000128 00000100:00100000:2.0:1788834998.569617:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254000640 00000100:00100000:2.0:1788834998.569620:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254000640 00000100:00100000:2.0:1788834998.569631:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254000000 00000100:00100000:2.0:1788834998.569633:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254000000 00000100:00100000:2.0:1788834998.569644:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254000512 00000100:00100000:2.0:1788834998.569646:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254000512 00000100:00100000:2.0:1788834998.569661:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788834998.569668:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729253999744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.569714:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729253999744:12345-0@lo:400:kworker.0 Request processed in 46us (697us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834998.569722:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788834998.569736:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788834998.569742:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875729254000256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.569781:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875729254000256:12345-0@lo:400:kworker.0 Request processed in 39us (702us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834998.569786:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788834998.569797:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788834998.569803:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254000128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.570896:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ef480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254000128:12345-0@lo:400:kworker.0 Request processed in 1088us (1675us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834998.570905:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788834998.570926:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788834998.570936:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875729254000640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.570979:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9edc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875729254000640:12345-0@lo:400:kworker.0 Request processed in 46us (1727us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834998.570998:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788834998.571011:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788834998.571017:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254000000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.571054:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254000000:12345-0@lo:400:kworker.0 Request processed in 38us (1595us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834998.571059:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788834998.571070:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788834998.571076:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875729254000512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.571099:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875729254000512:12345-0@lo:400:kworker.0 Request processed in 24us (1590us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834998.571105:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788834998.571133:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254000768 00000100:00100000:2.0:1788834998.571138:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254000768 00000100:00100000:2.0:1788834998.571170:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254000384 00000100:00100000:2.0:1788834998.571173:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254000384 00000100:00100000:2.0:1788834998.571185:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254000896 00000100:00100000:2.0:1788834998.571187:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254000896 00000100:00100000:2.0:1788834998.571199:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788834998.571204:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254000768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.571232:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ece00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254000768:12345-0@lo:400:kworker.0 Request processed in 28us (2116us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834998.571237:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788834998.571246:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788834998.571250:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254000384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.571272:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254000384:12345-0@lo:400:kworker.0 Request processed in 21us (1898us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834998.571287:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788834998.571298:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788834998.571304:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254000896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.571349:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254000896:12345-0@lo:400:kworker.0 Request processed in 46us (1935us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834998.571354:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788834998.571371:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253999616 00000100:00100000:2.0:1788834998.571375:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253999616 00000100:00100000:2.0:1788834998.571398:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788834998.571402:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729253999616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.571427:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729253999616:12345-0@lo:400:kworker.0 Request processed in 25us (2251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834998.571432:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1788834998.571466:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253999360 00000100:00100000:2.0:1788834998.571469:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253999360 00000100:00100000:2.0:1788834998.571485:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729253999872 00000100:00100000:2.0:1788834998.571487:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729253999872 00000100:00100000:2.0:1788834998.571497:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788834998.571503:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729253999360:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788834998.571528:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788834998.571560:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83686300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729253999360:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (4420us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834998.571566:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788834998.571578:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1788834998.571584:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253999872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.571610:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729253999872:12345-0@lo:400:kworker.0 Request processed in 27us (2308us total) trans 0 rc 0/0 00000100:00100000:2.0:1788834998.571623:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00080000:2.0:1788834998.571658:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788834998.571662:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788834998.571665:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788834998.571668:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788834998.571699:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254000000:0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.571710:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875729254000512:0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.571721:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83684700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729253999872:0@lo:400:kworker.0 00010000:00080000:2.0:1788834998.571732:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36c700 x1875729254000384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834998.571742:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254000384:0@lo:400:kworker.0 00000100:00100000:3.0:1788834998.572796:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729253999616:0@lo:400:kworker.0 00000100:00100000:3.0:1788834998.572812:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254000128:0@lo:400:kworker.0 00010000:00080000:3.0:1788834998.572881:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36c000 x1875729254000640/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834998.572892:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254000640:0@lo:400:kworker.0 00000100:00100000:3.0:1788834998.572906:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729253999744:0@lo:400:kworker.0 00010000:00080000:3.0:1788834998.572917:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83684000 x1875729254000256/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834998.572924:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875729254000256:0@lo:400:kworker.0 00010000:00080000:3.0:1788834998.572934:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36c380 x1875729254000768/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834998.572942:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254000768:0@lo:400:kworker.0 00010000:00080000:2.0:1788834998.573442:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36dc00 x1875729254000896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788834998.573455:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254000896:0@lo:400:kworker.0 00000100:00100000:2.0:1788834998.573474:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729253999360:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788834998.573497:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788834998.573505:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254001024:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788834998.573553:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788834998.574709:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254001024 00000100:00100000:0.0:1788834998.574719:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254001024 00000100:00100000:0.0:1788834998.574919:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788834998.574929:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254001024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788834998.574951:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788834998.575011:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c22300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254001024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (1456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788834998.575018:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:0.0:1788834998.575051:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbf9b5880 x1875729254001024/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835014 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788834998.575068:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254001024:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1788834998.759024:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788834998.921133:0:11192:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.108 00000100:00100000:3.0:1788834999.077483:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254001152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788834999.077554:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834999.077637:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254001152 00000100:00100000:3.0:1788834999.077646:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254001152 00000100:00100000:3.0:1788834999.077783:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1788834999.077794:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254001152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788834999.077895:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788834999.078029:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83680a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254001152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 236us (474us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834999.078044:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:3.0:1788834999.078088:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83682680 x1875729254001152/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834999.078106:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254001152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788834999.078635:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788834999.078645:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254001280:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788834999.078680:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788834999.078725:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254001280 00000100:00100000:3.0:1788834999.078730:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254001280 00000100:00100000:3.0:1788834999.078766:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1788834999.078774:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254001280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788834999.078787:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788834999.078828:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254001280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 45us (137us total) trans 0 rc 0/0 00000100:00100000:3.0:1788834999.078835:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1788834999.078861:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83682680 x1875729254001280/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788834999.078874:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254001280:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788834999.784283:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835000.102120:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254001408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788835000.102189:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835000.102292:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254001408 00000100:00100000:2.0:1788835000.102301:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254001408 00000100:00100000:2.0:1788835000.102370:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788835000.102379:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254001408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788835000.102425:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788835000.107206:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254001408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 4818us (5007us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835000.107221:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788835000.107369:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254001408:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788835000.805518:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788835001.386870:0:11289:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.108 00010000:00010000:2.0:1788835001.829554:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835001.952567:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835001.953406:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242399872 00000100:00100000:2.0:1788835001.953417:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242399872 00000100:00100000:2.0:1788835001.953551:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 98 00000100:00100000:2.0:1788835001.953563:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+6:2388:x1875729242399872:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835001.953647:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+6:2388:x1875729242399872:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 87us (1092us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835001.953655:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 98 00000100:00080000:0.0:1788835001.956572:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788835001.956738:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835001.956920:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835001.956939:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242399744 00000100:00100000:0.0:1788835001.956963:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242399744 00000100:00100000:0.0:1788835001.957027:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 282 00000100:00100000:0.0:1788835001.957037:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+10:2387:x1875729242399744:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835001.957157:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+10:2387:x1875729242399744:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 120us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835001.957164:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 282 00000100:00100000:3.0:1788835001.963963:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242400000 00000100:00100000:3.0:1788835001.963979:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242400000 00000100:00100000:3.0:1788835001.964142:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 99 00000100:00100000:3.0:1788835001.964153:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+5:2387:x1875729242400000:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835001.964260:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+5:2387:x1875729242400000:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 109us (7471us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835001.964283:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 99 00000100:00080000:2.0:1788835001.964704:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:00100000:0.0:1788835002.663961:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b8987b33-76f7-43a0-9448-1013c4af787f 00000020:00000080:0.0:1788835002.663971:0:8398:0:(genops.c:885:class_export_put()) final put ffff9afc83699000/b8987b33-76f7-43a0-9448-1013c4af787f 00000020:00000080:3.0:1788835002.664022:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc83699000/b8987b33-76f7-43a0-9448-1013c4af787f for lustre-OST0000 00000020:00000080:3.0:1788835002.664076:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afc8369e000 for lustre-OST0000 00000001:00100000:2.0:1788835002.664820:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b8987b33-76f7-43a0-9448-1013c4af787f 00000020:00000080:2.0:1788835002.664825:0:9481:0:(genops.c:885:class_export_put()) final put ffff9afc8337f800/b8987b33-76f7-43a0-9448-1013c4af787f 00000020:00000080:3.0:1788835002.664889:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc8337f800/b8987b33-76f7-43a0-9448-1013c4af787f for lustre-OST0001 00000020:00000080:3.0:1788835002.664926:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afc8337e800 for lustre-OST0001 00010000:00010000:0.0:1788835002.853454:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788835003.101365:0:11337:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Sep 7 22:36:42 EDT 2026 00000100:00100000:2.0:1788835003.686459:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788835003.686483:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254001536:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788835003.686553:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835003.686929:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254001536 00000100:00100000:3.0:1788835003.686937:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254001536 00000100:00100000:3.0:1788835003.686998:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1788835003.687008:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254001536:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788835003.687036:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788835003.687079:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c20380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254001536:12345-0@lo:13:osp-pre-0-1.0 Request processed in 73us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835003.687087:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1788835003.687254:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788835003.687302:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254001664:0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.687460:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254002048:0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.687496:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835003.687519:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254002560:0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.687548:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835003.687566:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254003072:0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.687587:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835003.687614:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788835003.687620:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254001920:0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.687645:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835003.687666:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729254002432:0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.687685:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835003.687699:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254002944:0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.687730:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835003.687763:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254001792:0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.687804:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835003.687821:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254002304:0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.687855:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835003.687875:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254002816:0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.687907:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835003.687935:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254001920 00000100:00100000:0.0:1788835003.687940:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254001920 00000100:00100000:0.0:1788835003.687968:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788835003.687976:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254001920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.688019:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254001920:12345-0@lo:400:kworker.0 Request processed in 44us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835003.688027:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788835003.688045:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254002048 00000100:00100000:0.0:1788835003.688049:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254002048 00000100:00100000:0.0:1788835003.688065:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254002432 00000100:00100000:0.0:1788835003.688067:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254002432 00000100:00100000:0.0:1788835003.688088:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254001792 00000100:00100000:0.0:1788835003.688090:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254001792 00000100:00100000:0.0:1788835003.688099:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254002304 00000100:00100000:0.0:1788835003.688101:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254002304 00000100:00100000:0.0:1788835003.688123:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254002816 00000100:00100000:0.0:1788835003.688126:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254002816 00000100:00100000:0.0:1788835003.688145:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788835003.688150:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254002048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.688180:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254002048:12345-0@lo:400:kworker.0 Request processed in 30us (684us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835003.688186:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788835003.688197:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788835003.688210:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729254002432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.688242:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729254002432:12345-0@lo:400:kworker.0 Request processed in 33us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835003.688248:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788835003.688260:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788835003.688265:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254001792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.688294:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254001792:12345-0@lo:400:kworker.0 Request processed in 29us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835003.688302:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788835003.688332:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788835003.688339:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254002304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.688363:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254002304:12345-0@lo:400:kworker.0 Request processed in 26us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835003.688368:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788835003.688377:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788835003.688383:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875729254002816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.688406:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875729254002816:12345-0@lo:400:kworker.0 Request processed in 24us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835003.688412:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:0.0:1788835003.688438:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788835003.688442:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788835003.688486:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254001792:0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.688498:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254002304:0@lo:400:kworker.0 00010000:00080000:0.0:1788835003.688508:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365e300 x1875729254002816/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835003.688531:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254002816:0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.688561:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254001920:0@lo:400:kworker.0 00010000:00080000:0.0:1788835003.688572:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365ed80 x1875729254002432/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835003.688580:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729254002432:0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.688590:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254002048:0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.688635:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254002560 00000100:00100000:0.0:1788835003.688639:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254002560 00000100:00100000:0.0:1788835003.688669:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254003072 00000100:00100000:0.0:1788835003.688673:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254003072 00000100:00100000:0.0:1788835003.688686:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254002944 00000100:00100000:0.0:1788835003.688688:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254002944 00000100:00100000:0.0:1788835003.688699:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788835003.688705:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba75a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254002560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.688750:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba75a050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254002560:12345-0@lo:400:kworker.0 Request processed in 45us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835003.688756:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788835003.688875:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788835003.688882:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254003072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.688909:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254003072:12345-0@lo:400:kworker.0 Request processed in 28us (1321us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835003.688915:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788835003.688924:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788835003.688930:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254002944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835003.688963:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254002944:12345-0@lo:400:kworker.0 Request processed in 33us (1233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835003.688968:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1788835003.688984:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788835003.688986:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788835003.689003:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36c380 x1875729254001536/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835003.689019:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254001536:0@lo:13:osp-pre-0-1.0 00010000:00080000:0.0:1788835003.689041:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365df80 x1875729254002944/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835003.689049:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254002944:0@lo:400:kworker.0 00010000:00080000:0.0:1788835003.689058:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365d500 x1875729254002560/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835003.689064:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254002560:0@lo:400:kworker.0 00010000:00080000:0.0:1788835003.689072:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365f480 x1875729254003072/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835003.689078:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254003072:0@lo:400:kworker.0 00000100:00100000:2.0:1788835003.689647:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835003.689689:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254002176:0@lo:400:kworker.0 00000100:00100000:2.0:1788835003.689728:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835003.689756:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875729254002688:0@lo:400:kworker.0 00000100:00100000:2.0:1788835003.689791:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835003.689810:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254003200:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788835003.689830:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835003.689875:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254002176 00000100:00100000:2.0:1788835003.689880:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254002176 00000100:00100000:1.0:1788835003.690375:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254003200 00000100:00100000:1.0:1788835003.690380:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254003200 00000100:00100000:1.0:1788835003.690422:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788835003.690430:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1875729254003200:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788835003.690459:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788835003.690515:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3616:x1875729254003200:12345-0@lo:41:osp-pre-1-0.0 Request processed in 85us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835003.690521:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788835003.690557:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254002688 00000100:00100000:1.0:1788835003.690560:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254002688 00000100:00100000:1.0:1788835003.690596:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788835003.690602:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875729254002688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835003.690636:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c23480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875729254002688:12345-0@lo:400:kworker.0 Request processed in 34us (844us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835003.690643:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00080000:1.0:1788835003.690661:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788835003.691609:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875729254002688:0@lo:400:kworker.0 00000100:00100000:3.0:1788835003.691630:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254003200:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835003.691648:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788835003.691664:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254003328:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788835003.691669:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254001664 00000100:00100000:0.0:1788835003.691676:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254001664 00000100:00100000:3.0:1788835003.691722:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835003.691728:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788835003.691737:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd829d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254001664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835003.691767:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254003328 00000100:00100000:3.0:1788835003.691773:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254003328 00000100:00100000:0.0:1788835003.691796:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd829d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254001664:12345-0@lo:400:kworker.0 Request processed in 59us (2148us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835003.691809:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1788835003.691810:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1788835003.691819:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254003328:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788835003.691839:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788835003.691900:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254003328:12345-0@lo:13:osp-pre-0-0.0 Request processed in 82us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835003.691918:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:3.0:1788835003.691950:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36c380 x1875729254003328/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835019 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835003.691965:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254003328:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788835003.691977:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254001664:0@lo:400:kworker.0 00000100:00100000:2.0:1788835003.692092:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1788835003.692101:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254002176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835003.692527:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254002176:12345-0@lo:400:kworker.0 Request processed in 425us (2795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835003.692535:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788835003.692836:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254002176:0@lo:400:kworker.0 00010000:00010000:1.0:1788835003.878487:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835004.198613:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788835004.198637:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254003456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788835004.198784:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835004.198847:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254003456 00000100:00100000:1.0:1788835004.198856:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254003456 00000100:00100000:1.0:1788835004.198906:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788835004.198917:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254003456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788835004.198949:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835004.199015:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254003456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 101us (230us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835004.199022:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788835004.199057:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788835004.199068:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254003584:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788835004.199100:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835004.199224:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254003584 00000100:00100000:1.0:1788835004.199230:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254003584 00010000:00080000:3.0:1788835004.199252:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36c380 x1875729254003456/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835004.199272:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254003456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788835004.199280:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1788835004.199290:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254003584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788835004.199301:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835004.199414:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c21f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254003584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835004.199420:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:2.0:1788835004.199603:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83c20000 x1875729254003584/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835004.199618:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83c20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254003584:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1788835004.901593:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835005.232490:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254003712:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788835005.232558:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835005.233383:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254003712 00000100:00100000:3.0:1788835005.233392:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254003712 00000100:00100000:3.0:1788835005.233437:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788835005.233446:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254003712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788835005.233478:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788835005.233525:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254003712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 80us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835005.233533:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788835005.233783:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254003712:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788835005.930095:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835006.949734:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835007.068886:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835007.068939:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835007.068976:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835007.068980:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242400256 00000100:00100000:3.0:1788835007.068990:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242400256 00000100:00080000:0.0:1788835007.069029:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788835007.069047:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242400384 00000100:00100000:0.0:1788835007.069051:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242400384 00000100:00100000:3.0:1788835007.069053:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 106 00000100:00100000:3.0:1788835007.069065:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+6:2385:x1875729242400256:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835007.069090:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 107 00000100:00100000:0.0:1788835007.069100:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242400384:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835007.069139:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+6:2385:x1875729242400256:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 76us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835007.069146:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 106 00000100:00100000:1.0:1788835007.069179:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242400128 00000100:00100000:1.0:1788835007.069184:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242400128 00000100:00100000:1.0:1788835007.069221:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 284 00000100:00100000:1.0:1788835007.069228:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd878e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+10:2385:x1875729242400128:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835007.069270:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242400384:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 172us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835007.069287:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 107 00000100:00080000:0.0:1788835007.069303:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788835007.076747:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd878e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+10:2385:x1875729242400128:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 7508us (7796us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835007.076761:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 284 00010000:00010000:2.0:1788835007.973503:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835008.807286:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729254003968:0@lo:400:kworker.0 00000100:00100000:2.0:1788835008.807446:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835008.807504:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729254004480:0@lo:400:kworker.0 00000100:00100000:2.0:1788835008.807529:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835008.807556:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875729254004992:0@lo:400:kworker.0 00000100:00100000:2.0:1788835008.807579:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835008.807608:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:2.0:1788835008.807629:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254004096:0@lo:400:kworker.0 00000100:00100000:2.0:1788835008.807657:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835008.808015:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254003968 00000100:00100000:1.0:1788835008.808024:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254003968 00000100:00100000:1.0:1788835008.808067:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254004480 00000100:00100000:1.0:1788835008.808070:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254004480 00000100:00100000:1.0:1788835008.808090:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254004992 00000100:00100000:1.0:1788835008.808093:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254004992 00000100:00100000:1.0:1788835008.808111:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788835008.808119:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729254003968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835008.808172:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729254003968:12345-0@lo:400:kworker.0 Request processed in 53us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835008.808185:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788835008.808201:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788835008.808206:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729254004480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835008.808237:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c22a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729254004480:12345-0@lo:400:kworker.0 Request processed in 30us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835008.808243:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788835008.808254:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788835008.808260:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875729254004992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835008.808285:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875729254004992:12345-0@lo:400:kworker.0 Request processed in 26us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835008.808290:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788835008.808447:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254004608:0@lo:400:kworker.0 00000100:00100000:2.0:1788835008.808471:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835008.808494:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729254005120:0@lo:400:kworker.0 00000100:00100000:2.0:1788835008.808514:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835008.808540:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729254003968:0@lo:400:kworker.0 00000100:00100000:2.0:1788835008.808549:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729254004480:0@lo:400:kworker.0 00000100:00100000:2.0:1788835008.808558:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875729254004992:0@lo:400:kworker.0 00000100:00100000:2.0:1788835008.808598:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254004608 00000100:00100000:2.0:1788835008.808602:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254004608 00000100:00100000:2.0:1788835008.808621:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254005120 00000100:00100000:2.0:1788835008.808623:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254005120 00000100:00100000:2.0:1788835008.808637:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788835008.808643:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254004608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835008.808815:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254003840:0@lo:400:kworker.0 00000100:00100000:0.0:1788835008.808850:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835008.808874:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254004352:0@lo:400:kworker.0 00000100:00100000:0.0:1788835008.808898:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835008.808928:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254004864:0@lo:400:kworker.0 00000100:00100000:0.0:1788835008.808952:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835008.808968:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254005376:0@lo:400:kworker.0 00000100:00100000:0.0:1788835008.808987:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835008.809007:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788835008.809013:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729254004224:0@lo:400:kworker.0 00000100:00100000:0.0:1788835008.809032:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835008.809042:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254004736:0@lo:400:kworker.0 00000100:00100000:0.0:1788835008.809059:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835008.809083:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254005248:0@lo:400:kworker.0 00000100:00100000:0.0:1788835008.809103:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835008.809129:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254004224 00000100:00100000:0.0:1788835008.809133:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254004224 00000100:00100000:0.0:1788835008.809155:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788835008.809161:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729254005120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835008.809388:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254004608:12345-0@lo:400:kworker.0 Request processed in 743us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835008.809396:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788835008.809412:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788835008.809419:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729254004224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835008.809454:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729254004224:12345-0@lo:400:kworker.0 Request processed in 37us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835008.809460:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1788835008.810081:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254004096 00000100:00100000:3.0:1788835008.810087:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254004096 00000100:00100000:3.0:1788835008.810112:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254004352 00000100:00100000:3.0:1788835008.810115:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254004352 00000100:00100000:3.0:1788835008.810128:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1788835008.810135:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254004096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835008.813042:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729254005120:12345-0@lo:400:kworker.0 Request processed in 3873us (4519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835008.813057:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1788835008.813095:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788835008.813101:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788835008.813173:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254003840 00000100:00100000:0.0:1788835008.813179:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254003840 00000100:00100000:0.0:1788835008.813220:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788835008.813228:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd878e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729254003840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835008.813287:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd878e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729254003840:12345-0@lo:400:kworker.0 Request processed in 60us (4436us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835008.813294:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788835008.813362:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254004864 00000100:00100000:0.0:1788835008.813367:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254004864 00000100:00100000:0.0:1788835008.813395:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254005376 00000100:00100000:0.0:1788835008.813398:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254005376 00000100:00100000:0.0:1788835008.813411:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254004736 00000100:00100000:0.0:1788835008.813413:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254004736 00000100:00100000:0.0:1788835008.813425:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254005248 00000100:00100000:0.0:1788835008.813427:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254005248 00000100:00100000:0.0:1788835008.813441:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788835008.813447:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254004864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835008.813481:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254004864:12345-0@lo:400:kworker.0 Request processed in 33us (4528us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835008.813499:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788835008.813511:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788835008.813518:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254005376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835008.813548:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254005376:12345-0@lo:400:kworker.0 Request processed in 31us (4560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835008.813554:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788835008.813564:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788835008.813570:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254004736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835008.813595:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254004736:12345-0@lo:400:kworker.0 Request processed in 26us (4535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835008.813601:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788835008.813611:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788835008.813616:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254005248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835008.813642:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254005248:12345-0@lo:400:kworker.0 Request processed in 26us (4539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835008.813647:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1788835008.813695:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788835008.813699:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788835008.813731:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729254004224:0@lo:400:kworker.0 00010000:00080000:0.0:1788835008.813902:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365ea00 x1875729254004736/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835008.813914:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254004736:0@lo:400:kworker.0 00010000:00080000:0.0:1788835008.813939:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365df80 x1875729254005248/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835008.813959:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254005248:0@lo:400:kworker.0 00000100:00100000:0.0:1788835008.813970:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254003840:0@lo:400:kworker.0 00010000:00080000:0.0:1788835008.813981:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365fb80 x1875729254004864/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835008.813988:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254004864:0@lo:400:kworker.0 00010000:00080000:0.0:1788835008.813996:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365e680 x1875729254005376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835008.814003:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254005376:0@lo:400:kworker.0 00000100:00100000:1.0:1788835008.814172:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788835008.814187:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254005504:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835008.814226:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835008.814310:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254005504 00000100:00100000:0.0:1788835008.814340:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254005504 00000100:00100000:1.0:1788835008.814499:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254005632:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788835008.814528:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835008.814611:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788835008.814618:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254005504:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788835008.814641:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835008.814859:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254005504:12345-0@lo:13:osp-pre-0-1.0 Request processed in 241us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835008.814867:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788835008.814888:0:6492:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1788835008.814896:0:6492:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00010000:00080000:1.0:1788835008.815010:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbf9bbb80 x1875729254005504/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835008.815027:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254005504:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788835008.815173:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788835008.815184:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254005760:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788835008.815215:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835008.815241:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254005760 00000100:00100000:0.0:1788835008.815245:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254005760 00000100:00100000:0.0:1788835008.815270:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788835008.815284:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254005760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788835008.815297:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835008.815425:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254005760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (208us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835008.815431:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:0.0:1788835008.815460:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365e300 x1875729254005760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835024 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835008.815475:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254005760:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788835008.815596:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365d880 x1875729254004608/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835008.815623:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254004608:0@lo:400:kworker.0 00010000:00080000:2.0:1788835008.815640:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365d500 x1875729254005120/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835008.815648:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729254005120:0@lo:400:kworker.0 00000100:00100000:0.0:1788835008.815712:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254005632 00000100:00100000:0.0:1788835008.815716:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254005632 00000100:00100000:1.0:1788835008.815966:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788835008.815974:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875729254004352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835008.816031:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875729254004352:12345-0@lo:400:kworker.0 Request processed in 58us (7132us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835008.816038:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1788835008.816060:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788835008.816065:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254005632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788835008.816085:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788835008.816119:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254005632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 55us (1591us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835008.816125:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1788835008.816151:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254005632:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835008.816223:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254004096:12345-0@lo:400:kworker.0 Request processed in 6087us (8563us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835008.816230:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788835008.817164:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254004096:0@lo:400:kworker.0 00000100:00100000:0.0:1788835008.817268:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254004352:0@lo:400:kworker.0 00010000:00010000:0.0:1788835008.997490:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835009.321374:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254005888:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788835009.321444:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835009.321522:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254005888 00000100:00100000:0.0:1788835009.321530:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254005888 00000100:00100000:0.0:1788835009.321583:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788835009.321593:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254005888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788835009.321626:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835009.321690:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254005888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (246us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835009.321699:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:0.0:1788835009.321755:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83c20a80 x1875729254005888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835009.321780:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254005888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788835009.324000:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788835009.324023:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254006016:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788835009.324083:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835009.324248:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254006016 00000100:00100000:1.0:1788835009.324255:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254006016 00000100:00100000:1.0:1788835009.324302:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788835009.324552:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254006016:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788835009.324574:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835009.324624:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254006016:12345-0@lo:13:osp-pre-1-1.0 Request processed in 78us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835009.324632:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:1.0:1788835009.324682:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbf9b8700 x1875729254006016/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835009.324701:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254006016:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788835010.022847:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835010.344703:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254006144:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788835010.344776:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835010.344961:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254006144 00000100:00100000:0.0:1788835010.344969:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254006144 00000100:00100000:0.0:1788835010.345020:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788835010.345029:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254006144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788835010.345061:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788835010.345109:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254006144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 82us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835010.345117:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788835010.345208:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254006144:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788835011.046370:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835012.069677:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835012.199572:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835012.199615:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835012.199642:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835012.199685:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242400768 00000100:00100000:2.0:1788835012.199697:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242400768 00000100:00100000:1.0:1788835012.199897:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242400512 00000100:00100000:1.0:1788835012.199903:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242400512 00000100:00100000:1.0:1788835012.199961:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 286 00000100:00100000:1.0:1788835012.199972:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd878e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+10:2385:x1875729242400512:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835012.200074:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd878e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+10:2385:x1875729242400512:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 103us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835012.200083:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 286 00000100:00100000:1.0:1788835012.200124:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242400640 00000100:00100000:1.0:1788835012.200128:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242400640 00000100:00100000:1.0:1788835012.200174:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:1.0:1788835012.200180:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+6:2385:x1875729242400640:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835012.200214:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+6:2385:x1875729242400640:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 34us (570us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835012.200220:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:2.0:1788835012.200488:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 115 00000100:00100000:2.0:1788835012.200496:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242400768:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835012.200528:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242400768:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 34us (912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835012.200535:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 115 00000100:00080000:1.0:1788835012.201962:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788835012.201972:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788835013.093671:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835013.926277:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788835013.926300:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254006272:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788835013.926412:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835013.926612:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254006272 00000100:00100000:1.0:1788835013.926620:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254006272 00000100:00100000:1.0:1788835013.926683:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788835013.926693:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254006272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788835013.926733:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835013.926782:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254006272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835013.926789:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:1.0:1788835013.926912:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788835013.927089:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729254006784:0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.927124:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835013.927162:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254007296:0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.927186:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835013.927210:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254007808:0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.927231:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835013.927252:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788835013.927258:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254006400:0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.927296:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835013.927343:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254006912:0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.927366:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835013.927382:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875729254007424:0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.927411:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835013.927435:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729254006528:0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.927456:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835013.927472:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729254007040:0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.927493:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835013.927508:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729254007552:0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.927527:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835013.927544:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788835013.927549:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254006656:0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.927570:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835013.927766:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254007168:0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.927795:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835013.927808:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254007680:0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.927828:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835013.927857:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254007296 00000100:00100000:3.0:1788835013.927863:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254007296 00000100:00100000:3.0:1788835013.927901:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254007808 00000100:00100000:3.0:1788835013.927904:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254007808 00000100:00100000:3.0:1788835013.927917:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254007680 00000100:00100000:3.0:1788835013.927919:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254007680 00000100:00100000:3.0:1788835013.927932:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788835013.927940:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254007296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.927992:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254007296:12345-0@lo:400:kworker.0 Request processed in 53us (804us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835013.928001:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788835013.928016:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788835013.928022:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254007808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.928047:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254007808:12345-0@lo:400:kworker.0 Request processed in 25us (815us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835013.928053:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788835013.928064:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788835013.928069:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254007680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.928098:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83687b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254007680:12345-0@lo:400:kworker.0 Request processed in 28us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835013.928103:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788835013.928124:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254006400 00000100:00100000:3.0:1788835013.928127:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254006400 00000100:00100000:3.0:1788835013.928152:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788835013.928158:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd878d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254006400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.928187:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd878d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254006400:12345-0@lo:400:kworker.0 Request processed in 29us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835013.928194:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00100000:3.0:1788835013.928219:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254006912 00000100:00100000:3.0:1788835013.928222:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254006912 00000100:00100000:3.0:1788835013.928242:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254006656 00000100:00100000:3.0:1788835013.928245:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254006656 00000100:00100000:3.0:1788835013.928258:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788835013.928264:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254006912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.928306:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83680380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254006912:12345-0@lo:400:kworker.0 Request processed in 42us (939us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835013.928312:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788835013.928355:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788835013.928361:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254006656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835013.928543:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254007936:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788835013.928571:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788835013.928610:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365d180 x1875729254006272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835013.928630:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254006272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788835013.928822:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254006784 00000100:00100000:2.0:1788835013.928823:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788835013.928828:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254006784 00000100:00100000:2.0:1788835013.928838:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254008064:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835013.928853:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254007424 00000100:00100000:1.0:1788835013.928857:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254007424 00000100:00100000:1.0:1788835013.928873:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254006528 00000100:00100000:1.0:1788835013.928875:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254006528 00000100:00100000:2.0:1788835013.928878:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835013.928899:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254007040 00000100:00100000:1.0:1788835013.928902:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254007040 00000100:00100000:1.0:1788835013.928914:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254007552 00000100:00100000:1.0:1788835013.928916:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254007552 00000100:00100000:1.0:1788835013.928926:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254007168 00000100:00100000:1.0:1788835013.928928:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254007168 00000100:00100000:1.0:1788835013.928942:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788835013.928947:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729254006784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835013.928985:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729254006784:12345-0@lo:400:kworker.0 Request processed in 38us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835013.928991:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788835013.929003:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788835013.929009:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875729254007424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835013.929034:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83683800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875729254007424:12345-0@lo:400:kworker.0 Request processed in 26us (1622us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835013.929039:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788835013.929049:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788835013.929054:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729254006528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835013.929076:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83683b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729254006528:12345-0@lo:400:kworker.0 Request processed in 22us (1620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835013.929081:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788835013.929090:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788835013.929095:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729254007040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835013.929117:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83682680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729254007040:12345-0@lo:400:kworker.0 Request processed in 22us (1624us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835013.929123:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788835013.929133:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788835013.929145:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729254007552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835013.929172:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83687800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729254007552:12345-0@lo:400:kworker.0 Request processed in 28us (1644us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835013.929178:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788835013.929188:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788835013.929193:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254007168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835013.929216:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83684a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254007168:12345-0@lo:400:kworker.0 Request processed in 23us (1422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835013.929221:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788835013.929235:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254008064 00000100:00100000:1.0:1788835013.929238:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254008064 00000100:00100000:1.0:1788835013.929273:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788835013.929279:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254008064:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788835013.929294:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835013.929349:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254008064:12345-0@lo:13:osp-pre-0-1.0 Request processed in 70us (472us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835013.929355:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:1.0:1788835013.929380:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbf9b9c00 x1875729254008064/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835029 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835013.930846:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83685880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254006656:12345-0@lo:400:kworker.0 Request processed in 29us (819us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835013.930864:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1788835013.930890:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254007936 00000100:00100000:3.0:1788835013.930895:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254007936 00000100:00100000:3.0:1788835013.930920:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788835013.930929:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254007936:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788835013.930958:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788835013.931027:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254007936:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (2455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835013.931033:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:3.0:1788835013.931088:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788835013.931093:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788835013.931097:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788835013.931099:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788835013.931126:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254006656:0@lo:400:kworker.0 00010000:00080000:3.0:1788835013.931142:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365fb80 x1875729254007168/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835013.931152:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254007168:0@lo:400:kworker.0 00010000:00080000:3.0:1788835013.931163:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365c380 x1875729254007680/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835013.931185:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254007680:0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.931200:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729254006528:0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.931210:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729254007040:0@lo:400:kworker.0 00010000:00080000:3.0:1788835013.931220:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365ea00 x1875729254007552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835013.931228:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729254007552:0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.931269:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254006400:0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.931281:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254006912:0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.931292:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875729254007424:0@lo:400:kworker.0 00000100:00100000:3.0:1788835013.931302:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729254006784:0@lo:400:kworker.0 00010000:00080000:3.0:1788835013.931332:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365ce00 x1875729254007296/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835013.931342:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254007296:0@lo:400:kworker.0 00010000:00080000:3.0:1788835013.931355:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365f480 x1875729254007808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835029 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835013.931363:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254007808:0@lo:400:kworker.0 00000100:00100000:1.0:1788835013.931586:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254008064:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788835013.931691:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254007936:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788835014.117433:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835014.437922:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254008192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788835014.437989:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835014.438076:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254008192 00000100:00100000:3.0:1788835014.438084:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254008192 00000100:00100000:3.0:1788835014.438128:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788835014.438138:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254008192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788835014.438166:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788835014.438221:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83684700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254008192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835014.438228:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:3.0:1788835014.438268:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83687100 x1875729254008192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835014.438286:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83687100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254008192:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788835014.440534:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254008320:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788835014.440612:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835014.440789:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254008320 00000100:00100000:3.0:1788835014.440796:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254008320 00000100:00100000:3.0:1788835014.440872:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788835014.440952:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254008320:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788835014.440974:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788835014.441016:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83687100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254008320:12345-0@lo:13:osp-pre-1-1.0 Request processed in 136us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835014.441023:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1788835014.441100:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbf9b8700 x1875729254008320/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835014.441118:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254008320:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788835015.147365:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835015.463782:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254008448:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788835015.463919:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835015.463989:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254008448 00000100:00100000:3.0:1788835015.464003:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254008448 00000100:00100000:3.0:1788835015.464051:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788835015.464060:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254008448:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788835015.464093:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788835015.464151:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254008448:12345-0@lo:41:osp-pre-0-1.0 Request processed in 92us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835015.464158:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788835015.464284:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254008448:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788835016.165565:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835017.189435:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835017.314310:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835017.314467:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835017.314549:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242400896 00000100:00100000:0.0:1788835017.314558:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242400896 00000100:00100000:0.0:1788835017.314617:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 288 00000100:00100000:0.0:1788835017.314639:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+10:2386:x1875729242400896:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835017.314709:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+10:2386:x1875729242400896:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 72us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835017.314716:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 288 00000100:00100000:2.0:1788835017.315380:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835017.320416:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242401152 00000100:00100000:3.0:1788835017.320431:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242401152 00000100:00100000:3.0:1788835017.327824:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242401024 00000100:00100000:3.0:1788835017.327840:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242401024 00000100:00100000:3.0:1788835017.327899:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:3.0:1788835017.327910:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242401152:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835017.327991:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa40700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242401152:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 83us (13523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835017.327999:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:3.0:1788835017.328018:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00100000:3.0:1788835017.328025:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+6:2386:x1875729242401024:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835017.328049:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa40380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+6:2386:x1875729242401024:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (12673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835017.328055:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00080000:3.0:1788835017.328073:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788835017.328078:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000001:02000400:3.0:1788835017.452173:0:11967:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:36:57 (1788835017) === 00000100:00100000:1.0:1788835017.820821:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835017.820950:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242401280 00000100:00100000:3.0:1788835017.820961:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242401280 00000100:00100000:3.0:1788835017.821021:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 289 00000100:00100000:3.0:1788835017.821050:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+10:8697:x1875729242401280:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788835017.821070:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835017.821089:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afc8374c400/0xdf60171e5a5d1c23 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae03fe expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835017.821119:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afc8374c400/0xdf60171e5a5d1c23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03fe expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835017.821131:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afc8374c400/0xdf60171e5a5d1c23 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03fe expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835017.821141:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374c400, rc 0) 00000100:00100000:3.0:1788835017.821200:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+11:8697:x1875729242401280:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 153us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835017.821208:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 289 00000100:00100000:1.0:1788835017.832680:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835017.832771:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242401408 00000100:00100000:0.0:1788835017.832795:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242401408 00000100:00100000:0.0:1788835017.832849:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 290 00000100:00100000:0.0:1788835017.832859:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+11:8697:x1875729242401408:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:0.0:1788835017.833010:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+11:8697:x1875729242401408:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 152us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835017.833018:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 290 00000100:00100000:2.0:1788835017.837301:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835017.837474:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242401536 00000100:00100000:0.0:1788835017.837483:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242401536 00000100:00100000:0.0:1788835017.837540:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 291 00000100:00100000:0.0:1788835017.837550:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+11:8697:x1875729242401536:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:0.0:1788835017.837722:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+11:8697:x1875729242401536:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 172us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835017.837730:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 291 00000100:00100000:1.0:1788835017.840379:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835017.840641:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242401664 00000100:00100000:3.0:1788835017.840650:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242401664 00000100:00100000:3.0:1788835017.840704:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 292 00000100:00100000:3.0:1788835017.840713:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+11:8701:x1875729242401664:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788835017.840859:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+11:8701:x1875729242401664:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 146us (486us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835017.840868:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 292 00000100:00100000:1.0:1788835017.858007:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835017.858093:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242401792 00000100:00100000:3.0:1788835017.858104:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242401792 00000100:00100000:3.0:1788835017.858158:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 293 00000100:00100000:3.0:1788835017.858170:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+11:8701:x1875729242401792:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788835017.858383:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+11:8701:x1875729242401792:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 216us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835017.858391:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 293 00000100:00100000:2.0:1788835017.866802:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835017.867148:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242401920 00000100:00100000:0.0:1788835017.867157:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242401920 00000100:00100000:0.0:1788835017.867214:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 294 00000100:00100000:0.0:1788835017.867225:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+11:8701:x1875729242401920:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788835017.867405:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+11:8701:x1875729242401920:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 181us (612us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835017.867413:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 294 00000100:00100000:2.0:1788835017.874117:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835017.874205:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242402048 00000100:00100000:1.0:1788835017.874227:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242402048 00000100:00100000:1.0:1788835017.874292:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 295 00000100:00100000:1.0:1788835017.874302:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+11:8697:x1875729242402048:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788835017.874349:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835017.874370:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e61600/0xdf60171e5a5d1c2a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae042f expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835017.874398:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e61600/0xdf60171e5a5d1c2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae042f expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835017.874409:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e61600/0xdf60171e5a5d1c2a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae042f expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835017.874419:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61600, rc 0) 00000100:00100000:1.0:1788835017.874469:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+12:8697:x1875729242402048:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 168us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835017.874476:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 295 00000100:00100000:1.0:1788835017.878283:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835017.878400:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242402176 00000100:00100000:3.0:1788835017.878409:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242402176 00000100:00100000:3.0:1788835017.878463:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 296 00000100:00100000:3.0:1788835017.878474:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+12:8697:x1875729242402176:12345-192.168.203.22@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788835017.878500:0:6482:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788835017.878522:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788835017.878526:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788835017.878529:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788835017.878532:0:6482:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788835017.878534:0:6482:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 6 00000100:00100000:3.0:1788835017.880419:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+12:8697:x1875729242402176:12345-192.168.203.22@tcp:256:mount.lustre.0 Request processed in 1939us (2138us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835017.880432:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 296 00000100:00100000:2.0:1788835017.883471:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835017.883569:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242402304 00000100:00100000:0.0:1788835017.883580:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242402304 00000100:00100000:0.0:1788835017.883640:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 297 00000100:00100000:0.0:1788835017.883649:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+12:8697:x1875729242402304:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:0.0:1788835017.883665:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835017.883703:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd80030a00/0xdf60171e5a5d1c31 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0436 expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835017.883731:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd80030a00/0xdf60171e5a5d1c31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0436 expref: 13 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835017.883742:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd80030a00/0xdf60171e5a5d1c31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0436 expref: 13 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835017.883751:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd80030a00, rc 0) 00000100:00100000:0.0:1788835017.883803:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:8697:x1875729242402304:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 155us (342us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835017.883809:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 297 00000100:00100000:1.0:1788835017.887708:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835017.887959:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242402432 00000100:00100000:3.0:1788835017.887968:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242402432 00000100:00100000:3.0:1788835017.888015:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 298 00000100:00100000:3.0:1788835017.888025:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:8697:x1875729242402432:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788835017.888178:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:8697:x1875729242402432:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 153us (478us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835017.888186:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 298 00000100:00100000:2.0:1788835017.897193:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835017.897297:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242402560 00000100:00100000:1.0:1788835017.897307:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242402560 00000100:00100000:1.0:1788835017.897395:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 299 00000100:00100000:1.0:1788835017.897405:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:8697:x1875729242402560:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788835017.898375:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:8697:x1875729242402560:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 160us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835017.898386:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 299 00000100:00100000:2.0:1788835017.902023:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835017.902344:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242402688 00000100:00100000:0.0:1788835017.902355:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242402688 00000100:00100000:0.0:1788835017.902406:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 300 00000100:00100000:0.0:1788835017.902417:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:8704:x1875729242402688:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788835017.902579:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:8704:x1875729242402688:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 162us (562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835017.902587:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 300 00000100:00100000:2.0:1788835017.910764:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835017.911096:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242402816 00000100:00100000:1.0:1788835017.911119:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242402816 00000100:00100000:1.0:1788835017.911173:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 301 00000100:00100000:1.0:1788835017.911184:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:8704:x1875729242402816:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788835017.911369:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:8704:x1875729242402816:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 186us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835017.911377:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 301 00000100:00100000:2.0:1788835017.921787:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835017.921830:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835017.922027:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242402944 00000100:00100000:3.0:1788835017.922036:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242402944 00000100:00100000:3.0:1788835017.922083:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242403200 00000100:00100000:3.0:1788835017.922098:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242403200 00000100:00100000:3.0:1788835017.922129:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:3.0:1788835017.922138:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2384:x1875729242402944:12345-192.168.203.22@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788835017.922166:0:9047:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e407b2f7-b5e2-4ec6-aa60-e6561b656d05@192.168.203.22@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:3.0:1788835017.922204:0:9047:0:(genops.c:1385:class_connect()) connect: client e407b2f7-b5e2-4ec6-aa60-e6561b656d05, cookie 0xdf60171e5a5d1c38 00000004:00100000:3.0:1788835017.922229:0:9047:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788835017.922389:0:9047:0:(import.c:65:import_set_state_nolock()) ffff9afc837f6000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788835017.922454:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa40e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2384:x1875729242402944:12345-192.168.203.22@tcp:38:mount.lustre.0 Request processed in 315us (674us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835017.922461:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:3.0:1788835017.922478:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:3.0:1788835017.922482:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2384:x1875729242403200:12345-192.168.203.22@tcp:38:mount.lustre.0 00010000:00080000:3.0:1788835017.922498:0:9047:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from e407b2f7-b5e2-4ec6-aa60-e6561b656d05@192.168.203.22@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:3.0:1788835017.922538:0:9047:0:(genops.c:1385:class_connect()) connect: client e407b2f7-b5e2-4ec6-aa60-e6561b656d05, cookie 0xdf60171e5a5d1c3f 00000004:00100000:3.0:1788835017.922552:0:9047:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:3.0:1788835017.922646:0:9047:0:(import.c:65:import_set_state_nolock()) ffff9afc837f5000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788835017.922672:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa43480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2384:x1875729242403200:12345-192.168.203.22@tcp:38:mount.lustre.0 Request processed in 187us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835017.922691:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:2.0:1788835017.926175:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835017.926213:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835017.926256:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835017.926345:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242403456 00000100:00100000:0.0:1788835017.926356:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242403456 00000100:00100000:0.0:1788835017.926423:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242403328 00000100:00100000:0.0:1788835017.926427:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242403328 00000100:00100000:0.0:1788835017.926450:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242403072 00000100:00100000:0.0:1788835017.926453:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242403072 00000100:00100000:0.0:1788835017.926470:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:0.0:1788835017.926479:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+7:8697:x1875729242403456:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788835017.926531:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788835017.926639:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa41c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+7:8697:x1875729242403456:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 161us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835017.926647:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:0.0:1788835017.926663:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:0.0:1788835017.926670:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:0:x1875729242403328:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788835017.926817:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788835017.926923:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa40000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:0:x1875729242403328:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 253us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835017.926930:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:0.0:1788835017.926944:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:0.0:1788835017.926951:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:0:x1875729242403072:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788835017.926962:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788835017.926985:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa41f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:0:x1875729242403072:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 35us (729us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835017.927662:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00080000:2.0:1788835017.927770:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788835017.927774:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788835017.936644:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835017.936846:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242403584 00000100:00100000:1.0:1788835017.936866:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242403584 00000100:00100000:1.0:1788835017.936930:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:1.0:1788835017.936940:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:8697:x1875729242403584:12345-192.168.203.22@tcp:40:mount.lustre.0 00000100:00100000:1.0:1788835017.937154:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa42a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:8697:x1875729242403584:12345-192.168.203.22@tcp:40:mount.lustre.0 Request processed in 213us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835017.937161:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:1.0:1788835017.942485:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835017.942965:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242403968 00000100:00100000:0.0:1788835017.942975:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242403968 00000100:00100000:0.0:1788835017.943105:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:0.0:1788835017.943116:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:8697:x1875729242403968:12345-192.168.203.22@tcp:900:mount.lustre.0 00000100:00100000:0.0:1788835017.943197:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:8697:x1875729242403968:12345-192.168.203.22@tcp:900:mount.lustre.0 Request processed in 83us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835017.943206:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:2.0:1788835017.944336:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835017.944371:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835017.944523:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242403712 00000100:00100000:3.0:1788835017.944530:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242403712 00000100:00100000:3.0:1788835017.945119:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242403840 00000100:00100000:3.0:1788835017.945125:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242403840 00000100:00100000:3.0:1788835017.945156:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:3.0:1788835017.945163:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2384:x1875729242403712:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788835017.945193:0:8403:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e407b2f7-b5e2-4ec6-aa60-e6561b656d05@192.168.203.22@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:3.0:1788835017.945234:0:8403:0:(genops.c:1385:class_connect()) connect: client e407b2f7-b5e2-4ec6-aa60-e6561b656d05, cookie 0xdf60171e5a5d1c46 00002000:00100000:3.0:1788835017.945260:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e407b2f7-b5e2-4ec6-aa60-e6561b656d05/ffff9afc837f7000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788835017.945279:0:8403:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788835017.945380:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788835017.945408:0:8403:0:(import.c:65:import_set_state_nolock()) ffff9afc837f7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788835017.945469:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa41180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2384:x1875729242403712:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 305us (1157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835017.945476:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:3.0:1788835017.945492:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:3.0:1788835017.945496:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2384:x1875729242403840:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788835017.945510:0:8403:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e407b2f7-b5e2-4ec6-aa60-e6561b656d05@192.168.203.22@tcp t0 exp 0000000000000000 cur 259 last 0 00000020:00000080:3.0:1788835017.945541:0:8403:0:(genops.c:1385:class_connect()) connect: client e407b2f7-b5e2-4ec6-aa60-e6561b656d05, cookie 0xdf60171e5a5d1c4d 00002000:00100000:3.0:1788835017.945546:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e407b2f7-b5e2-4ec6-aa60-e6561b656d05/ffff9afdbfa52000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788835017.945558:0:8403:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788835017.949830:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1788835017.950090:0:8403:0:(import.c:65:import_set_state_nolock()) ffff9afdbfa50000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788835017.950178:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa43800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2384:x1875729242403840:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 4676us (5802us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835017.950189:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:2.0:1788835017.953300:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835017.953416:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242404096 00000100:00100000:0.0:1788835017.953438:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242404096 00000100:00100000:0.0:1788835017.953492:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:0.0:1788835017.953501:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:8697:x1875729242404096:12345-192.168.203.22@tcp:33:mount.lustre.0 00000004:00200000:0.0:1788835017.953602:0:6490:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:0.0:1788835017.953701:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa42680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:8697:x1875729242404096:12345-192.168.203.22@tcp:33:mount.lustre.0 Request processed in 200us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835017.953708:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00010000:00010000:0.0:1788835018.214004:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835019.046269:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254008576:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788835019.046353:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254008832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835019.046391:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254008704:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788835019.046399:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835019.046456:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254008832 00000100:00100000:2.0:1788835019.046456:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729254009344:0@lo:400:kworker.0 00000100:00100000:3.0:1788835019.046465:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254008832 00000100:00100000:2.0:1788835019.046487:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835019.046511:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254009856:0@lo:400:kworker.0 00000100:00100000:3.0:1788835019.046517:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788835019.046528:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254008832:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788835019.046540:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835019.046568:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254010368:0@lo:400:kworker.0 00000004:00000024:3.0:1788835019.046570:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788835019.046593:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835019.046636:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254008832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 109us (237us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835019.046645:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788835019.046657:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254008832:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788835019.046679:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:2.0:1788835019.046686:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254008960:0@lo:400:kworker.0 00000100:00100000:2.0:1788835019.046713:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835019.046741:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254009472:0@lo:400:kworker.0 00000100:00100000:2.0:1788835019.046760:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835019.046779:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254009984:0@lo:400:kworker.0 00000100:00100000:3.0:1788835019.046781:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254008960 00000100:00100000:3.0:1788835019.046787:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254008960 00000100:00100000:3.0:1788835019.046818:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:3.0:1788835019.046825:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254008960:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835019.047100:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254008960:12345-0@lo:400:kworker.0 Request processed in 274us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835019.047107:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788835019.047130:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835019.047163:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254008576 00000100:00100000:3.0:1788835019.047168:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254008576 00000100:00100000:1.0:1788835019.047172:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729254009088:0@lo:400:kworker.0 00000100:00100000:1.0:1788835019.047202:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835019.047211:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788835019.047221:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254008576:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788835019.047226:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729254009600:0@lo:400:kworker.0 00002000:00000024:3.0:1788835019.047243:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835019.047251:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835019.047275:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdaaf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875729254010112:0@lo:400:kworker.0 00000100:00100000:3.0:1788835019.047285:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254008576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 65us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835019.047293:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1788835019.047303:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1788835019.047335:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788835019.047352:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254009344 00000100:00100000:3.0:1788835019.047356:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254009344 00010000:00080000:1.0:1788835019.047362:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365f100 x1875729254008576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835019.047382:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254009088 00000100:00100000:3.0:1788835019.047386:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254009088 00000100:00100000:3.0:1788835019.047397:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254009600 00000100:00100000:3.0:1788835019.047400:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254009600 00000100:00100000:3.0:1788835019.047416:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254010112 00000100:00100000:3.0:1788835019.047418:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254010112 00000100:00100000:3.0:1788835019.048406:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788835019.048415:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729254009344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835019.048622:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa42d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729254009344:12345-0@lo:400:kworker.0 Request processed in 207us (2134us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835019.048630:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788835019.048646:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788835019.048654:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729254009088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835019.048692:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729254009088:12345-0@lo:400:kworker.0 Request processed in 39us (1489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835019.048699:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788835019.048714:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788835019.048720:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729254009600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835019.048765:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729254009600:12345-0@lo:400:kworker.0 Request processed in 45us (1514us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835019.048773:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788835019.048789:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788835019.048796:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875729254010112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835019.048805:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254008576:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788835019.048826:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875729254010112:12345-0@lo:400:kworker.0 Request processed in 29us (1523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835019.048834:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788835019.048853:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83684000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729254009088:0@lo:400:kworker.0 00000100:00100000:1.0:1788835019.048867:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729254009600:0@lo:400:kworker.0 00000100:00080000:3.0:1788835019.048870:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788835019.048878:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdaaf3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875729254010112:0@lo:400:kworker.0 00000100:00100000:3.0:1788835019.048889:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835019.048962:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254009856 00000100:00100000:1.0:1788835019.048967:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254009856 00000100:00100000:1.0:1788835019.048997:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254010368 00000100:00100000:1.0:1788835019.049000:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254010368 00000100:00100000:1.0:1788835019.049018:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788835019.049023:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254009856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835019.049061:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa41500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254009856:12345-0@lo:400:kworker.0 Request processed in 37us (2524us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835019.049066:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788835019.049078:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788835019.049084:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254010368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835019.049114:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa43b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254010368:12345-0@lo:400:kworker.0 Request processed in 29us (2520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835019.049120:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788835019.049150:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835019.049220:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254010496:0@lo:400:kworker.0 00000100:00100000:3.0:1788835019.049249:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254009216:0@lo:400:kworker.0 00000100:00100000:2.0:1788835019.049257:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835019.049283:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835019.049302:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729254009728:0@lo:400:kworker.0 00000100:00100000:3.0:1788835019.049353:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835019.049370:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdaaf3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875729254010240:0@lo:400:kworker.0 00000100:00100000:3.0:1788835019.049389:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835019.049416:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254009728 00000100:00100000:3.0:1788835019.049420:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254009728 00000100:00100000:3.0:1788835019.049460:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254010240 00000100:00100000:3.0:1788835019.049464:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254010240 00000100:00100000:3.0:1788835019.049482:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788835019.049488:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729254009728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835019.049521:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba369180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729254009728:12345-0@lo:400:kworker.0 Request processed in 34us (169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835019.049527:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1788835019.049538:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788835019.049544:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875729254010240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835019.049568:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba368e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875729254010240:12345-0@lo:400:kworker.0 Request processed in 25us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835019.049574:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:3.0:1788835019.049589:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788835019.049593:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788835019.049595:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788835019.049604:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254009472 00000100:00100000:3.0:1788835019.049617:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254009472 00000100:00100000:3.0:1788835019.049637:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254009216 00000100:00100000:3.0:1788835019.049640:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254009216 00000100:00100000:3.0:1788835019.049652:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788835019.049659:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254009472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835019.049690:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254009472:12345-0@lo:400:kworker.0 Request processed in 33us (2930us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835019.049703:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1788835019.049716:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788835019.049721:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254009216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835019.049749:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254009216:12345-0@lo:400:kworker.0 Request processed in 27us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835019.049753:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788835019.049782:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254009216:0@lo:400:kworker.0 00010000:00080000:3.0:1788835019.049793:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb90f8a80 x1875729254009728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835019.049801:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729254009728:0@lo:400:kworker.0 00010000:00080000:3.0:1788835019.049809:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdaaf3f100 x1875729254010240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835019.049816:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdaaf3f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875729254010240:0@lo:400:kworker.0 00010000:00080000:2.0:1788835019.050928:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36b100 x1875729254010368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835019.050942:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254010368:0@lo:400:kworker.0 00000100:00100000:2.0:1788835019.050955:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729254009344:0@lo:400:kworker.0 00010000:00080000:2.0:1788835019.050965:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb90f8700 x1875729254009856/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835019.050991:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254009856:0@lo:400:kworker.0 00000100:00100000:2.0:1788835019.051014:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254008960:0@lo:400:kworker.0 00000100:00100000:2.0:1788835019.051025:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254009472:0@lo:400:kworker.0 00000100:00100000:3.0:1788835019.052453:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254008704 00000100:00100000:3.0:1788835019.052463:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254008704 00000100:00100000:3.0:1788835019.052513:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788835019.052522:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254008704:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788835019.052545:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788835019.052622:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254008704:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (3733us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835019.052630:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:3.0:1788835019.052671:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa41880 x1875729254008704/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835019.052708:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa41880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254008704:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835019.053304:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254009984 00000100:00100000:1.0:1788835019.053310:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254009984 00000100:00100000:2.0:1788835019.053339:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254010496 00000100:00100000:2.0:1788835019.053343:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254010496 00000100:00100000:1.0:1788835019.053366:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788835019.053555:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254009984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835019.053563:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788835019.053569:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254010496:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1788835019.053641:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788835019.053863:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254010496:12345-0@lo:400:kworker.0 Request processed in 292us (4607us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835019.053870:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1788835019.053907:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb90f9500 x1875729254009984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835019.053919:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254009984:0@lo:400:kworker.0 00010000:00080000:2.0:1788835019.053930:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba369f80 x1875729254010496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835019.053937:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba369f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254010496:0@lo:400:kworker.0 00000100:00100000:1.0:1788835019.058512:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254009984:12345-0@lo:400:kworker.0 Request processed in 4951us (9351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835019.058530:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1788835019.239046:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835019.561747:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254010624:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788835019.561816:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835019.561930:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254010624 00000100:00100000:2.0:1788835019.561938:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254010624 00000100:00100000:2.0:1788835019.561983:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788835019.561992:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254010624:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788835019.562039:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788835019.562082:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254010624:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (267us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835019.562090:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1788835019.562129:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83cd0700 x1875729254010624/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835019.562148:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254010624:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788835019.564925:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254010752:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788835019.564992:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835019.565084:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254010752 00000100:00100000:2.0:1788835019.565092:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254010752 00000100:00100000:2.0:1788835019.565142:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788835019.565152:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254010752:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788835019.565174:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788835019.565219:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254010752:12345-0@lo:13:osp-pre-1-1.0 Request processed in 68us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835019.565226:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:0.0:1788835019.566858:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbf9bbb80 x1875729254010752/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835019.566884:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254010752:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788835020.264816:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835020.582528:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788835020.582551:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254010880:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788835020.582627:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835020.582965:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254010880 00000100:00100000:2.0:1788835020.582984:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254010880 00000100:00100000:2.0:1788835020.583276:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1788835020.583286:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254010880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788835020.583355:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788835020.583533:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254010880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 248us (904us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835020.583540:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788835020.583728:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254010880:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788835021.286927:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835022.310225:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788835022.826124:0:12160:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:3.0:1788835022.940790:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835022.940824:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835022.940847:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835022.940899:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835022.940924:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835022.940940:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835022.940958:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835022.940985:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242404224 00000100:00100000:3.0:1788835022.940993:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242404224 00000100:00100000:3.0:1788835022.941037:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 303 00000100:00100000:3.0:1788835022.941046:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:2385:x1875729242404224:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835022.941106:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:2385:x1875729242404224:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 61us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835022.941113:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 303 00000100:00100000:3.0:1788835022.941142:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242404480 00000100:00100000:3.0:1788835022.941145:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242404480 00000100:00100000:3.0:1788835022.941171:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242404736 00000100:00100000:3.0:1788835022.941174:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242404736 00000100:00100000:3.0:1788835022.941184:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242404352 00000100:00100000:3.0:1788835022.941186:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242404352 00000100:00100000:3.0:1788835022.941205:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242404608 00000100:00100000:3.0:1788835022.941208:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242404608 00000100:00100000:3.0:1788835022.941220:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 130 00000100:00100000:3.0:1788835022.941225:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242404480:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835022.941255:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242404480:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 29us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835022.941262:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 130 00000100:00100000:3.0:1788835022.941273:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 131 00000100:00100000:3.0:1788835022.941280:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2385:x1875729242404736:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835022.941301:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa41880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2385:x1875729242404736:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 22us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835022.941307:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 131 00000100:00100000:3.0:1788835022.941336:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 132 00000100:00100000:3.0:1788835022.941343:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+6:2385:x1875729242404352:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835022.941365:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83dece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+6:2385:x1875729242404352:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835022.941370:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 132 00000100:00100000:3.0:1788835022.941381:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 133 00000100:00100000:3.0:1788835022.941386:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2385:x1875729242404608:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835022.941408:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83def480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2385:x1875729242404608:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 22us (467us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835022.941414:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 133 00000100:00100000:3.0:1788835022.941471:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242404992 00000100:00100000:3.0:1788835022.941475:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242404992 00000100:00100000:3.0:1788835022.941510:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242404864 00000100:00100000:3.0:1788835022.941514:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242404864 00000100:00100000:3.0:1788835022.941667:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:3.0:1788835022.941676:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2385:x1875729242404992:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835022.941706:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83dec380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2385:x1875729242404992:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 33us (807us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835022.941713:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:3.0:1788835022.941724:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:3.0:1788835022.941730:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2385:x1875729242404864:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835022.941753:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83dedc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2385:x1875729242404864:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 24us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835022.941759:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00080000:3.0:1788835022.942270:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788835022.942275:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788835022.942278:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788835022.942280:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:2.0:1788835023.340852:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788835023.657173:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e407b2f7-b5e2-4ec6-aa60-e6561b656d05 00000001:00100000:3.0:1788835023.662032:0:6467:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e407b2f7-b5e2-4ec6-aa60-e6561b656d05 00000001:00100000:1.0:1788835023.662230:0:7417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e407b2f7-b5e2-4ec6-aa60-e6561b656d05 00000001:00100000:1.0:1788835023.662614:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e407b2f7-b5e2-4ec6-aa60-e6561b656d05 00000100:00100000:2.0:1788835024.165517:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254011008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788835024.165594:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835024.165757:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254011136:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788835024.165791:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835024.165823:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788835024.165829:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254011264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788835024.165852:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835024.165896:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254011008 00000100:00100000:3.0:1788835024.165905:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254011008 00000100:00100000:3.0:1788835024.165943:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254011264 00000100:00100000:3.0:1788835024.165945:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254011264 00000100:00100000:3.0:1788835024.165960:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788835024.165964:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254011776:0@lo:400:kworker.0 00000100:00100000:3.0:1788835024.165968:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254011008:12345-0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788835024.165989:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00000024:3.0:1788835024.165995:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835024.166005:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875729254012288:0@lo:400:kworker.0 00000100:00100000:0.0:1788835024.166047:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835024.166065:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788835024.166070:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254011648:0@lo:400:kworker.0 00000100:00100000:0.0:1788835024.166090:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835024.166093:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254011008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835024.166100:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1788835024.166104:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254012160:0@lo:400:kworker.0 00000100:00100000:3.0:1788835024.166122:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788835024.166122:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835024.166129:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254011264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788835024.166138:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835024.166149:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254011776 00000100:00100000:0.0:1788835024.166153:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254011776 00000100:00100000:3.0:1788835024.166161:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254011264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 34us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835024.166167:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1788835024.166178:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254012288 00000100:00100000:0.0:1788835024.166181:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254012288 00000100:00080000:3.0:1788835024.166193:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788835024.166197:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788835024.166197:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254012160 00000100:00100000:0.0:1788835024.166200:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254012160 00000100:00100000:0.0:1788835024.166219:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1788835024.166223:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788835024.166225:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254011776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835024.166229:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875729254012288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835024.166257:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83740e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254011776:12345-0@lo:400:kworker.0 Request processed in 32us (267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835024.166263:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788835024.166276:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1788835024.166282:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729254012160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835024.166334:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254011392:0@lo:400:kworker.0 00000100:00100000:2.0:1788835024.166346:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254011136 00000100:00100000:2.0:1788835024.166352:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254011136 00000100:00100000:1.0:1788835024.166371:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835024.166385:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254011648 00000100:00100000:2.0:1788835024.166390:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254011648 00000100:00100000:1.0:1788835024.166411:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729254011904:0@lo:400:kworker.0 00000100:00100000:2.0:1788835024.166414:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788835024.166424:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254011136:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788835024.166440:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00000024:2.0:1788835024.166448:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788835024.166482:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254011136:12345-0@lo:41:osp-pre-1-0.0 Request processed in 59us (690us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835024.166488:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788835024.166499:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788835024.166504:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254011648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835024.166599:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254012416:0@lo:400:kworker.0 00000100:00100000:1.0:1788835024.166626:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835024.166649:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788835024.166656:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254011520:0@lo:400:kworker.0 00000100:00100000:1.0:1788835024.166676:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835024.166688:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729254012032:0@lo:400:kworker.0 00000100:00100000:1.0:1788835024.166708:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835024.166719:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254012544:0@lo:400:kworker.0 00000100:00100000:1.0:1788835024.166736:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835024.166761:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254011904 00000100:00100000:1.0:1788835024.166765:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254011904 00000100:00100000:1.0:1788835024.166785:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254011520 00000100:00100000:1.0:1788835024.166788:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254011520 00000100:00100000:1.0:1788835024.166797:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254012032 00000100:00100000:1.0:1788835024.166799:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254012032 00000100:00100000:1.0:1788835024.166812:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788835024.166818:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729254011904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835024.166855:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729254011904:12345-0@lo:400:kworker.0 Request processed in 36us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835024.166861:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788835024.167348:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788835024.167366:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254011520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835024.167403:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254011520:12345-0@lo:400:kworker.0 Request processed in 39us (726us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835024.167410:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788835024.167422:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788835024.167429:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729254012032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835024.167722:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729254012032:12345-0@lo:400:kworker.0 Request processed in 292us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835024.167728:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788835024.167773:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254011520:0@lo:400:kworker.0 00010000:00080000:1.0:1788835024.167787:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb9309180 x1875729254012032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835024.167797:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9309180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729254012032:0@lo:400:kworker.0 00000100:00100000:1.0:1788835024.167808:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729254011904:0@lo:400:kworker.0 00010000:00080000:1.0:1788835024.167863:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83cd0e00 x1875729254011264/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835024.169737:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254011264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835024.169779:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254011136:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835024.170219:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83740700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875729254012288:12345-0@lo:400:kworker.0 Request processed in 3987us (4167us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835024.170230:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788835024.170277:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254011392 00000100:00100000:3.0:1788835024.170284:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254011392 00000100:00100000:0.0:1788835024.170355:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729254012160:12345-0@lo:400:kworker.0 Request processed in 4071us (4229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835024.170363:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788835024.170555:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788835024.170565:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254011392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835024.171206:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254011392:12345-0@lo:400:kworker.0 Request processed in 642us (4834us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835024.171215:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:3.0:1788835024.171252:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254012416 00000100:00100000:3.0:1788835024.171257:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254012416 00000100:00100000:2.0:1788835024.171267:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254011648:12345-0@lo:400:kworker.0 Request processed in 4760us (5173us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835024.171274:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788835024.171289:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254012544 00000100:00100000:3.0:1788835024.171292:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254012544 00010000:00080000:2.0:1788835024.171331:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365f100 x1875729254011008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835024.171350:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254011008:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788835024.171669:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254011392:0@lo:400:kworker.0 00000100:00100000:3.0:1788835024.171781:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788835024.171788:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788835024.171793:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254012416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835024.171796:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254012544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835024.171848:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254012544:12345-0@lo:400:kworker.0 Request processed in 51us (5108us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835024.171854:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1788835024.171886:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788835024.171891:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788835024.171894:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788835024.171943:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254012416:12345-0@lo:400:kworker.0 Request processed in 152us (5315us total) trans 0 rc 0/0 00010000:00080000:0.0:1788835024.171951:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83741880 x1875729254012544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835024.171955:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788835024.171963:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254012544:0@lo:400:kworker.0 00010000:00080000:0.0:1788835024.171983:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb9309500 x1875729254012416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835024.171992:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254012416:0@lo:400:kworker.0 00000100:00100000:1.0:1788835024.172806:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254011648:0@lo:400:kworker.0 00000100:00100000:1.0:1788835024.172823:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254012160:0@lo:400:kworker.0 00000100:00100000:1.0:1788835024.172837:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254011776:0@lo:400:kworker.0 00010000:00080000:1.0:1788835024.172865:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb930b480 x1875729254012288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835024.172887:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875729254012288:0@lo:400:kworker.0 00010000:00010000:0.0:1788835024.363412:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835024.677513:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254012672:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788835024.677603:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835024.677683:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788835024.677694:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254012800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788835024.677719:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835024.677768:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254012672 00000100:00100000:1.0:1788835024.677775:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254012672 00000100:00100000:1.0:1788835024.677929:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254012800 00000100:00100000:1.0:1788835024.677933:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254012800 00000100:00100000:1.0:1788835024.677951:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788835024.677958:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254012672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788835024.678056:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835024.678138:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254012672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 176us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835024.678145:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788835024.678165:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1788835024.678172:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254012800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788835024.678182:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835024.678209:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254012800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 37us (489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835024.678215:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1788835024.678248:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83cd3480 x1875729254012800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835024.679480:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254012800:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1788835024.679508:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afd9e815c00 x1875729254012672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835024.679522:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254012672:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788835025.385586:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835025.701709:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788835025.701732:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254012928:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788835025.701799:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835025.706894:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254012928 00000100:00100000:0.0:1788835025.706905:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254012928 00000100:00100000:0.0:1788835025.706959:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788835025.706968:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254012928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788835025.707005:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788835025.707083:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254012928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 116us (5284us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835025.707091:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788835025.707175:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254012928:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788835026.407144:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835027.429460:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835028.063765:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835028.063810:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835028.063833:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835028.063861:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242405376 00000100:00100000:1.0:1788835028.063870:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242405376 00000100:00100000:1.0:1788835028.063930:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242405248 00000100:00100000:1.0:1788835028.063934:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242405248 00000100:00100000:1.0:1788835028.063981:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 140 00000100:00100000:1.0:1788835028.063991:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242405376:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835028.064068:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242405376:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 78us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835028.064075:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 140 00000100:00100000:1.0:1788835028.064094:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 141 00000100:00100000:1.0:1788835028.064102:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+6:2386:x1875729242405248:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835028.064128:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+6:2386:x1875729242405248:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835028.064134:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 141 00000100:00080000:1.0:1788835028.064154:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788835028.064158:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788835028.064398:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242405120 00000100:00100000:3.0:1788835028.064404:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242405120 00000100:00100000:3.0:1788835028.064433:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 305 00000100:00100000:3.0:1788835028.064439:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:2386:x1875729242405120:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835028.064489:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:2386:x1875729242405120:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 50us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835028.064495:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 305 00000100:00100000:1.0:1788835028.072718:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835028.072784:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835028.072785:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242405504 00000100:00100000:3.0:1788835028.072796:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242405504 00000100:00100000:1.0:1788835028.072814:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835028.072847:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835028.072859:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242405632 00000100:00100000:3.0:1788835028.072863:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242405632 00000100:00100000:1.0:1788835028.072876:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242405760 00000100:00100000:1.0:1788835028.072882:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242405760 00000100:00100000:3.0:1788835028.072908:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 142 00000100:00100000:3.0:1788835028.072920:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242405504:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835028.072921:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242405888 00000100:00100000:1.0:1788835028.072927:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242405888 00000100:00100000:1.0:1788835028.072958:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:1.0:1788835028.072967:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242405760:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835028.072997:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242405504:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 80us (287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835028.073006:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242405760:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 38us (221us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835028.073012:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 142 00000100:00100000:1.0:1788835028.073019:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:3.0:1788835028.073035:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 143 00000100:00100000:1.0:1788835028.073040:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:3.0:1788835028.073047:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242405632:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835028.073053:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb930b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242405888:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835028.073084:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242405632:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 39us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835028.073092:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb930b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242405888:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 43us (244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835028.073093:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 143 00000100:00100000:1.0:1788835028.073103:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00080000:1.0:1788835028.073146:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788835028.073149:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788835028.073151:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788835028.073153:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788835028.453499:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835029.285982:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788835029.286004:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254013056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788835029.286068:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835029.286129:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254013184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835029.286155:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835029.286188:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254013056 00000100:00100000:1.0:1788835029.286201:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254013056 00000100:00100000:1.0:1788835029.286245:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788835029.286257:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254013056:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788835029.286638:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788835029.286690:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254013056:12345-0@lo:41:osp-pre-1-0.0 Request processed in 435us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835029.286699:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1788835029.286726:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254013184 00000100:00100000:1.0:1788835029.286730:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254013184 00000100:00100000:1.0:1788835029.286767:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1788835029.286774:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8207b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254013184:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788835029.286793:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835029.286832:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8207b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254013184:12345-0@lo:13:osp-pre-0-1.0 Request processed in 58us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835029.286838:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:1.0:1788835029.286856:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788835029.287004:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb9309500 x1875729254013184/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835029.287021:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9309500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254013184:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835029.287053:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254013056:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788835029.287736:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254013312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788835029.287776:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835029.290595:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254013312 00000100:00100000:2.0:1788835029.290609:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254013312 00000100:00100000:2.0:1788835029.290679:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788835029.290690:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254013312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788835029.290717:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788835029.290792:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254013312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (3015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835029.290799:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:1.0:1788835029.290899:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788835029.291059:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8207a680 x1875729254013312/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835029.291083:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254013312:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788835029.296099:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254013696:0@lo:400:kworker.0 00000100:00100000:2.0:1788835029.296170:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835029.296216:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875729254014208:0@lo:400:kworker.0 00000100:00100000:2.0:1788835029.296242:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835029.296275:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1788835029.296282:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254013824:0@lo:400:kworker.0 00000100:00100000:2.0:1788835029.296304:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835029.296342:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729254014336:0@lo:400:kworker.0 00000100:00100000:2.0:1788835029.296362:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835029.296388:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254014208 00000100:00100000:2.0:1788835029.296399:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254014208 00000100:00100000:1.0:1788835029.296432:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254013568:0@lo:400:kworker.0 00000100:00100000:1.0:1788835029.296465:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835029.296568:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875729254014080:0@lo:400:kworker.0 00000100:00100000:1.0:1788835029.296593:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835029.296609:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254014592:0@lo:400:kworker.0 00000100:00100000:1.0:1788835029.296633:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835029.296653:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788835029.296659:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254013440:0@lo:400:kworker.0 00000100:00100000:1.0:1788835029.296684:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835029.296708:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254013952:0@lo:400:kworker.0 00000100:00100000:1.0:1788835029.296730:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835029.296740:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254014464:0@lo:400:kworker.0 00000100:00100000:1.0:1788835029.296758:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835029.296782:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254013824 00000100:00100000:1.0:1788835029.296787:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254013824 00000100:00100000:1.0:1788835029.296816:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254014336 00000100:00100000:1.0:1788835029.296818:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254014336 00000100:00100000:1.0:1788835029.296963:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254013568 00000100:00100000:1.0:1788835029.296968:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254013568 00000100:00100000:0.0:1788835029.296973:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254013696 00000100:00100000:0.0:1788835029.296979:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254013696 00000100:00100000:1.0:1788835029.296984:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254014080 00000100:00100000:1.0:1788835029.296988:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254014080 00000100:00100000:1.0:1788835029.297010:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254013952 00000100:00100000:1.0:1788835029.297013:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254013952 00000100:00100000:0.0:1788835029.297016:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1788835029.297028:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254013696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835029.297034:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788835029.297044:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254013824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835029.297096:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254013696:12345-0@lo:400:kworker.0 Request processed in 69us (924us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835029.297099:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254013824:12345-0@lo:400:kworker.0 Request processed in 56us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835029.297107:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788835029.297128:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788835029.297145:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788835029.297152:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729254014336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835029.297154:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254013824:0@lo:400:kworker.0 00000100:00100000:0.0:1788835029.297171:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254013696:0@lo:400:kworker.0 00000100:00100000:1.0:1788835029.297193:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729254014336:12345-0@lo:400:kworker.0 Request processed in 41us (828us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835029.297201:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00010000:00080000:0.0:1788835029.297211:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83cd1880 x1875729254014336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835029.297217:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788835029.297229:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729254014336:0@lo:400:kworker.0 00000100:00100000:1.0:1788835029.297230:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254013568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835029.297273:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9309500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254013568:12345-0@lo:400:kworker.0 Request processed in 46us (806us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835029.297278:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788835029.297290:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788835029.297297:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8207a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875729254014080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835029.297348:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8207a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875729254014080:12345-0@lo:400:kworker.0 Request processed in 51us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835029.297374:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254014592 00000100:00100000:0.0:1788835029.297378:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254014592 00000100:00100000:0.0:1788835029.297401:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254014464 00000100:00100000:0.0:1788835029.297404:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254014464 00000100:00100000:2.0:1788835029.297571:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788835029.297583:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaaf3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254013952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835029.297619:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaaf3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254013952:12345-0@lo:400:kworker.0 Request processed in 39us (889us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835029.297661:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788835029.297671:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaaf3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254014592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835029.297703:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaaf3f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254014592:12345-0@lo:400:kworker.0 Request processed in 35us (1069us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835029.297709:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1788835029.297722:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1788835029.297728:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254014464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835029.297753:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254014464:12345-0@lo:400:kworker.0 Request processed in 25us (994us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835029.297759:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788835029.298061:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788835029.298078:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788835029.298085:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875729254014208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835029.298128:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875729254014208:12345-0@lo:400:kworker.0 Request processed in 44us (1885us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835029.298134:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1788835029.298152:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254013440 00000100:00100000:1.0:1788835029.298156:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254013440 00000100:00100000:1.0:1788835029.298183:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788835029.298189:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729254013440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835029.298235:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729254013440:12345-0@lo:400:kworker.0 Request processed in 46us (1550us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835029.298241:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788835029.298298:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254013440:0@lo:400:kworker.0 00000100:00100000:1.0:1788835029.298312:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254013952:0@lo:400:kworker.0 00010000:00080000:1.0:1788835029.298344:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83cd0a80 x1875729254014464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835029.298355:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254014464:0@lo:400:kworker.0 00000100:00100000:1.0:1788835029.298366:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254013568:0@lo:400:kworker.0 00010000:00080000:1.0:1788835029.298376:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83cd3800 x1875729254014080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835029.298385:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875729254014080:0@lo:400:kworker.0 00010000:00080000:1.0:1788835029.298395:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83cd2d80 x1875729254014592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835029.298403:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254014592:0@lo:400:kworker.0 00000100:00100000:1.0:1788835029.298440:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875729254014208:0@lo:400:kworker.0 00000100:00100000:2.0:1788835029.298581:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:2.0:1788835029.298612:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788835029.298618:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788835029.298621:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788835029.478423:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788835029.713054:0:12475:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788835029.713282:0:12475:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788835029.797647:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788835029.797669:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254014720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788835029.797738:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835029.797807:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254014720 00000100:00100000:1.0:1788835029.797815:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254014720 00000100:00100000:1.0:1788835029.797863:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1788835029.797885:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254014720:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788835029.797916:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835029.797974:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254014720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835029.797981:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1788835029.798022:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb90f8700 x1875729254014720/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835029.798041:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254014720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788835029.798165:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788835029.798175:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254014848:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788835029.798202:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835029.798258:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254014848 00000100:00100000:0.0:1788835029.798262:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254014848 00000100:00100000:0.0:1788835029.798291:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788835029.798298:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254014848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788835029.798307:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835029.798361:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254014848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 63us (158us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835029.798367:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00080000:0.0:1788835029.798390:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afd9e815c00 x1875729254014848/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835029.798409:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254014848:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788835030.502760:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835030.821650:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788835030.821675:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254014976:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788835030.821751:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835030.821811:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254014976 00000100:00100000:0.0:1788835030.821829:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254014976 00000100:00100000:0.0:1788835030.821888:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788835030.821897:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd88621850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254014976:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788835030.821933:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788835030.821990:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd88621850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254014976:12345-0@lo:41:osp-pre-0-1.0 Request processed in 94us (239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835030.821998:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788835030.822038:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254014976:0@lo:41:osp-pre-0-1.0 00010000:00010000:2.0:1788835031.527889:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788835031.656122:0:12572:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788835031.656441:0:12572:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788835032.549575:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835033.182260:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835033.182310:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835033.182375:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835033.182402:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835033.182423:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835033.182449:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835033.182490:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835033.182533:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242406272 00000100:00100000:3.0:1788835033.182542:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242406272 00000100:00100000:3.0:1788835033.182596:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242406528 00000100:00100000:3.0:1788835033.182600:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242406528 00000100:00100000:1.0:1788835033.182728:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242406016 00000100:00100000:1.0:1788835033.182732:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242406016 00000100:00100000:1.0:1788835033.182765:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 307 00000100:00100000:1.0:1788835033.182774:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:2388:x1875729242406016:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835033.182852:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:2388:x1875729242406016:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 78us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835033.182860:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 307 00000100:00100000:3.0:1788835033.183384:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242406144 00000100:00100000:3.0:1788835033.183388:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242406144 00000100:00100000:3.0:1788835033.183402:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242406400 00000100:00100000:3.0:1788835033.183404:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242406400 00000100:00100000:3.0:1788835033.183423:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 150 00000100:00100000:3.0:1788835033.183432:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2388:x1875729242406272:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835033.183547:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83deea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2388:x1875729242406272:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 116us (1236us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835033.183555:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 150 00000100:00100000:3.0:1788835033.183571:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 151 00000100:00100000:3.0:1788835033.183578:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2388:x1875729242406528:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835033.183620:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ded180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2388:x1875729242406528:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 41us (1244us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835033.183627:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 151 00000100:00100000:3.0:1788835033.183644:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 152 00000100:00100000:3.0:1788835033.183651:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+6:2388:x1875729242406144:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835033.183678:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83dee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+6:2388:x1875729242406144:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 28us (1254us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835033.184089:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 152 00000100:00100000:2.0:1788835033.185196:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242406784 00000100:00100000:2.0:1788835033.185206:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242406784 00000100:00100000:2.0:1788835033.185268:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242406656 00000100:00100000:2.0:1788835033.185272:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242406656 00000100:00100000:2.0:1788835033.185299:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:2.0:1788835033.185308:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2388:x1875729242406784:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835033.185389:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83def800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2388:x1875729242406784:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 82us (2986us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835033.185397:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:2.0:1788835033.185414:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:2.0:1788835033.185421:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2388:x1875729242406656:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835033.185444:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83deca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2388:x1875729242406656:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 24us (2953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835033.185450:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:0.0:1788835033.185792:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 153 00000100:00100000:0.0:1788835033.185806:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2388:x1875729242406400:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835033.185839:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ded880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2388:x1875729242406400:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 38us (3389us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835033.185845:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 153 00000100:00080000:3.0:1788835033.188041:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788835033.188051:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788835033.188055:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788835033.188059:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788835033.578685:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788835033.579814:0:12670:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788835033.580129:0:12670:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:3.0:1788835034.408059:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875729254015360:0@lo:400:kworker.0 00000100:00100000:3.0:1788835034.408139:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835034.408176:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254015488:0@lo:400:kworker.0 00000100:00100000:3.0:1788835034.408204:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875729254015872:0@lo:400:kworker.0 00000100:00100000:3.0:1788835034.408232:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835034.408257:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254016384:0@lo:400:kworker.0 00000100:00100000:1.0:1788835034.408262:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835034.408293:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835034.408302:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729254016000:0@lo:400:kworker.0 00000100:00100000:3.0:1788835034.408352:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [0->1] 00000100:00100000:3.0:1788835034.408360:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254015232:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788835034.408366:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835034.408397:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254016512:0@lo:400:kworker.0 00000100:00100000:3.0:1788835034.408405:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835034.408428:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254015744:0@lo:400:kworker.0 00000100:00100000:1.0:1788835034.408429:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835034.408469:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835034.408484:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254016256:0@lo:400:kworker.0 00000100:00100000:0.0:1788835034.408602:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788835034.408611:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254016896:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835034.409061:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835034.409082:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254016768:0@lo:400:kworker.0 00000100:00100000:3.0:1788835034.409103:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835034.409136:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254015360 00000100:00100000:3.0:1788835034.409142:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254015360 00000100:00100000:3.0:1788835034.409174:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254015872 00000100:00100000:3.0:1788835034.409176:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254015872 00000100:00100000:3.0:1788835034.409199:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254016384 00000100:00100000:3.0:1788835034.409202:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254016384 00000100:00100000:3.0:1788835034.409215:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254016000 00000100:00100000:3.0:1788835034.409217:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254016000 00000100:00100000:3.0:1788835034.409230:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254016512 00000100:00100000:3.0:1788835034.409232:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254016512 00000100:00100000:3.0:1788835034.409247:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788835034.409256:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875729254015360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835034.409301:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ded500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875729254015360:12345-0@lo:400:kworker.0 Request processed in 46us (1163us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835034.409308:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788835034.409339:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788835034.409344:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875729254015872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835034.409367:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83defb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875729254015872:12345-0@lo:400:kworker.0 Request processed in 23us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835034.409373:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788835034.409382:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788835034.409387:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729254016384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835034.409408:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83def100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729254016384:12345-0@lo:400:kworker.0 Request processed in 20us (1117us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835034.409424:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788835034.409433:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788835034.409438:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729254016000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835034.411226:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729254016000:12345-0@lo:400:kworker.0 Request processed in 1780us (2856us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835034.411237:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788835034.411264:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788835034.411274:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254016512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835034.411303:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83683480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254016512:12345-0@lo:400:kworker.0 Request processed in 32us (2876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835034.411308:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1788835034.411358:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254016256 00000100:00100000:3.0:1788835034.411364:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254016256 00000100:00100000:3.0:1788835034.411401:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254016768 00000100:00100000:3.0:1788835034.411404:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254016768 00000100:00100000:3.0:1788835034.411423:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788835034.411429:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254016256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835034.412613:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254015104:0@lo:400:kworker.0 00000100:00100000:3.0:1788835034.412728:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83dec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254016256:12345-0@lo:400:kworker.0 Request processed in 1295us (3665us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835034.412739:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788835034.412768:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788835034.412780:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254016768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835034.412826:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83dec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254016768:12345-0@lo:400:kworker.0 Request processed in 51us (3721us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835034.412833:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:3.0:1788835034.412867:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788835034.412872:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788835034.412876:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788835034.412876:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83684e00 x1875729254016512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788835034.412880:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788835034.412909:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83684e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254016512:0@lo:400:kworker.0 00010000:00080000:3.0:1788835034.412926:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83685880 x1875729254016256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835034.412939:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254017024:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788835034.412940:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83685880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254016256:0@lo:400:kworker.0 00010000:00080000:3.0:1788835034.412956:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83687480 x1875729254016768/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835034.412966:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83687480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254016768:0@lo:400:kworker.0 00000100:00100000:3.0:1788835034.412981:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875729254015872:0@lo:400:kworker.0 00000100:00100000:1.0:1788835034.412987:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835034.412996:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83684380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254016384:0@lo:400:kworker.0 00000100:00100000:3.0:1788835034.413020:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875729254015360:0@lo:400:kworker.0 00010000:00080000:1.0:1788835034.413043:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb90fb800 x1875729254016000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835034.413054:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729254016000:0@lo:400:kworker.0 00000100:00100000:1.0:1788835034.413084:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254015232 00000100:00100000:1.0:1788835034.413089:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254015232 00000100:00100000:1.0:1788835034.413113:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254017024 00000100:00100000:1.0:1788835034.413116:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254017024 00000100:00100000:1.0:1788835034.413147:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788835034.413154:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdc1568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254015232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788835034.413177:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835034.413219:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdc1568c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254015232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (4814us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835034.413226:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788835034.413516:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788835034.413524:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254017024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788835034.413534:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835034.413567:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83682a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254017024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 44us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835034.413573:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00080000:1.0:1788835034.413712:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83cd1500 x1875729254017024/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835034.413741:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254017024:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788835034.413766:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83deed80 x1875729254015232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835034.413778:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254015232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788835034.413872:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835034.413898:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729254015616:0@lo:400:kworker.0 00000100:00100000:2.0:1788835034.413924:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835034.413939:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254016128:0@lo:400:kworker.0 00000100:00100000:2.0:1788835034.413959:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835034.413972:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254016640:0@lo:400:kworker.0 00000100:00100000:2.0:1788835034.413991:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835034.414091:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254015616 00000100:00100000:2.0:1788835034.414096:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254015616 00000100:00100000:2.0:1788835034.414125:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788835034.414132:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729254015616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835034.414169:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729254015616:12345-0@lo:400:kworker.0 Request processed in 38us (244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835034.414176:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788835034.414198:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254015488 00000100:00100000:2.0:1788835034.414201:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254015488 00000100:00100000:2.0:1788835034.414229:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254015744 00000100:00100000:2.0:1788835034.414232:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254015744 00000100:00100000:2.0:1788835034.414244:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788835034.414250:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254015488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835034.414283:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83684000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254015488:12345-0@lo:400:kworker.0 Request processed in 33us (6025us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835034.414289:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788835034.414299:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788835034.414305:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254015744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835034.414369:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83dee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254015744:12345-0@lo:400:kworker.0 Request processed in 63us (5899us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835034.414376:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1788835034.414392:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254016128 00000100:00100000:2.0:1788835034.414396:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254016128 00000100:00100000:2.0:1788835034.414410:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254016640 00000100:00100000:2.0:1788835034.414413:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254016640 00000100:00100000:2.0:1788835034.414428:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788835034.414433:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254016128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835034.414463:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254016128:12345-0@lo:400:kworker.0 Request processed in 29us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835034.414468:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1788835034.414478:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788835034.414483:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254016640:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835034.414521:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254016640:12345-0@lo:400:kworker.0 Request processed in 37us (530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835034.414528:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788835034.414557:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729254015616:0@lo:400:kworker.0 00010000:00080000:2.0:1788835034.414567:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83686300 x1875729254016128/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835034.414576:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254016128:0@lo:400:kworker.0 00010000:00080000:2.0:1788835034.414584:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83686a00 x1875729254016640/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835050 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835034.414593:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254016640:0@lo:400:kworker.0 00000100:00100000:1.0:1788835034.414674:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254015104 00000100:00100000:1.0:1788835034.414679:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254015104 00000100:00100000:1.0:1788835034.414715:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788835034.414721:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729254015104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835034.414761:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729254015104:12345-0@lo:400:kworker.0 Request processed in 39us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835034.414767:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:1.0:1788835034.414796:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254015104:0@lo:400:kworker.0 00000100:00100000:1.0:1788835034.414831:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254015488:0@lo:400:kworker.0 00000100:00100000:1.0:1788835034.414853:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254015744:0@lo:400:kworker.0 00000100:00100000:0.0:1788835034.414959:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835034.415024:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254016896 00000100:00100000:1.0:1788835034.415028:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254016896 00000100:00100000:1.0:1788835034.415086:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788835034.415094:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254016896:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788835034.415117:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788835034.415158:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254016896:12345-0@lo:41:osp-pre-1-0.0 Request processed in 64us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835034.415164:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1788835034.417792:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788835034.417801:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788835034.420588:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254016896:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788835034.597780:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835034.917545:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254017152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788835034.917637:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835034.917985:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254017152 00000100:00100000:0.0:1788835034.917993:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254017152 00000100:00100000:0.0:1788835034.918044:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788835034.918054:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254017152:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788835034.918082:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835034.918152:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83681500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254017152:12345-0@lo:13:osp-pre-1-1.0 Request processed in 98us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835034.918159:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00010000:00080000:2.0:1788835034.918306:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afd9e816680 x1875729254017152/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835034.918370:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254017152:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788835034.918394:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788835034.918406:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254017280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788835034.918439:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835034.919295:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254017280 00000100:00100000:2.0:1788835034.919303:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254017280 00000100:00100000:2.0:1788835034.919381:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788835034.919390:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254017280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788835034.919406:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788835034.919454:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83681c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254017280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 65us (1015us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835034.919461:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00080000:0.0:1788835034.919983:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83682d80 x1875729254017280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835050 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835034.920003:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254017280:0@lo:13:osp-pre-1-0.0 00000020:00000004:2.0:1788835035.506236:0:12768:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788835035.506671:0:12768:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788835035.621677:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835035.944637:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788835035.944656:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254017408:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788835035.944715:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835035.944774:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254017408 00000100:00100000:0.0:1788835035.944781:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254017408 00000100:00100000:0.0:1788835035.944818:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788835035.944825:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254017408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788835035.944858:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788835035.944898:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254017408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 73us (182us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835035.944906:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788835035.944946:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254017408:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788835036.645569:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788835037.295785:0:12865:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788835037.296018:0:12865:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:3.0:1788835037.669776:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835038.304923:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835038.304964:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835038.304999:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835038.305021:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835038.305091:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835038.313457:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835038.313718:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835038.319451:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242407040 00000100:00100000:3.0:1788835038.319468:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242407040 00000100:00100000:3.0:1788835038.319628:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242407296 00000100:00100000:3.0:1788835038.319632:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242407296 00000100:00100000:3.0:1788835038.319651:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242407168 00000100:00100000:3.0:1788835038.319654:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242407168 00000100:00100000:3.0:1788835038.319668:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242407424 00000100:00100000:3.0:1788835038.319670:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242407424 00000100:00100000:3.0:1788835038.319709:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 160 00000100:00100000:3.0:1788835038.319719:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+6:2386:x1875729242407040:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835038.319812:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e814a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+6:2386:x1875729242407040:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 94us (14897us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835038.319821:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 160 00000100:00100000:3.0:1788835038.319840:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 161 00000100:00100000:3.0:1788835038.319846:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242407296:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835038.319872:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242407296:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 26us (14908us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835038.319879:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 161 00000100:00100000:3.0:1788835038.319890:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 162 00000100:00100000:3.0:1788835038.319896:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242407168:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835038.319920:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e815f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242407168:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 24us (14900us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835038.319926:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 162 00000100:00100000:3.0:1788835038.319937:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 163 00000100:00100000:3.0:1788835038.319943:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242407424:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835038.319966:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242407424:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 22us (14875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835038.319972:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 163 00000100:00080000:3.0:1788835038.319995:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788835038.319999:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788835038.320528:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242406912 00000100:00100000:1.0:1788835038.320536:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242406912 00000100:00100000:1.0:1788835038.320572:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 309 00000100:00100000:1.0:1788835038.320580:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:2386:x1875729242406912:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835038.320622:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:2386:x1875729242406912:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 42us (15621us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835038.320680:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 309 00000100:00100000:1.0:1788835038.320795:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242407552 00000100:00100000:1.0:1788835038.320799:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242407552 00000100:00100000:1.0:1788835038.320829:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242407680 00000100:00100000:1.0:1788835038.320832:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242407680 00000100:00100000:1.0:1788835038.320853:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:1.0:1788835038.320860:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2384:x1875729242407552:12345-192.168.203.22@tcp:9:kworker.0 00000020:00000080:1.0:1788835038.321014:0:8405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1c46 00000100:00080000:1.0:1788835038.321023:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9afc837f7800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788835038.321071:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788835038.321543:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+2:2384:x1875729242407552:12345-192.168.203.22@tcp:9:kworker.0 Request processed in 681us (8095us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835038.321552:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:1.0:1788835038.321569:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:1.0:1788835038.321576:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2384:x1875729242407680:12345-192.168.203.22@tcp:9:kworker.0 00000020:00000080:1.0:1788835038.321591:0:8405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1c4d 00000100:00080000:1.0:1788835038.321606:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9afdbfa50000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788835038.321728:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967299 00000100:00100000:1.0:1788835038.321809:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+2:2384:x1875729242407680:12345-192.168.203.22@tcp:9:kworker.0 Request processed in 233us (8092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835038.321815:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00080000:1.0:1788835038.321830:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788835038.321833:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788835038.322377:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835038.329640:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835038.693558:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835039.525578:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254017536:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788835039.525654:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835039.525723:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254017536 00000100:00100000:3.0:1788835039.525731:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254017536 00000100:00100000:3.0:1788835039.525783:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788835039.525794:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254017536:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788835039.525824:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788835039.525881:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83dedf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254017536:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835039.525888:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00010000:00080000:3.0:1788835039.525925:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83deed80 x1875729254017536/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835039.525944:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83deed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254017536:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1788835039.530115:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788835039.531357:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729254017792:0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.531432:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835039.531545:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254018304:0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.531578:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835039.531598:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875729254018816:0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.531621:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835039.531657:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254019328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788835039.531678:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835039.531698:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788835039.531705:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729254017920:0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.531726:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835039.531743:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729254018432:0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.531760:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835039.531777:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729254018944:0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.531795:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835039.531825:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254018304 00000100:00100000:1.0:1788835039.531832:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254018304 00000100:00100000:1.0:1788835039.531868:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254019328 00000100:00100000:1.0:1788835039.531879:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254019328 00000100:00100000:1.0:1788835039.531897:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788835039.531903:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729254018304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.531955:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83685500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729254018304:12345-0@lo:400:kworker.0 Request processed in 51us (376us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835039.531962:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788835039.531977:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788835039.531983:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254019328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788835039.532006:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788835039.532036:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83684700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254019328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 54us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835039.532042:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788835039.532058:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254018816 00000100:00100000:1.0:1788835039.532061:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254018816 00000100:00100000:1.0:1788835039.532091:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254017920 00000100:00100000:1.0:1788835039.532094:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254017920 00000100:00100000:1.0:1788835039.532105:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254018432 00000100:00100000:1.0:1788835039.532108:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254018432 00000100:00100000:1.0:1788835039.532122:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254018944 00000100:00100000:1.0:1788835039.532125:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254018944 00000100:00100000:1.0:1788835039.532138:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788835039.532145:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875729254018816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.532190:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83685c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875729254018816:12345-0@lo:400:kworker.0 Request processed in 45us (567us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835039.532197:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788835039.532208:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788835039.532214:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729254017920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.532240:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83687100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729254017920:12345-0@lo:400:kworker.0 Request processed in 27us (513us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835039.532253:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1788835039.532265:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788835039.532271:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729254018432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.532300:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83684380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729254018432:12345-0@lo:400:kworker.0 Request processed in 30us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835039.532306:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788835039.532342:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788835039.532349:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729254018944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.532383:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83687480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729254018944:12345-0@lo:400:kworker.0 Request processed in 35us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835039.532389:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788835039.532430:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83681880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729254017920:0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.532440:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729254018432:0@lo:400:kworker.0 00010000:00080000:1.0:1788835039.532452:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365d500 x1875729254018944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835039.532463:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729254018944:0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.532488:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254019328:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788835039.532497:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254018304:0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.532505:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875729254018816:0@lo:400:kworker.0 00000100:00080000:1.0:1788835039.532548:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788835039.532551:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788835039.532563:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254017664:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835039.532596:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835039.532629:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729254018176:0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.532651:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835039.532670:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254018688:0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.532692:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835039.532711:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254019200:0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.532733:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835039.532762:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788835039.532763:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254018176 00000100:00100000:3.0:1788835039.532769:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254018176 00000100:00100000:1.0:1788835039.532771:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254018048:0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.532803:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835039.532807:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:3.0:1788835039.532816:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729254018176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.532827:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875729254018560:0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.532859:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835039.532881:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254019072:0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.532902:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835039.532926:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729254018176:0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.532945:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254018560 00000100:00100000:1.0:1788835039.532948:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254018560 00000100:00100000:1.0:1788835039.532971:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788835039.532977:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875729254018560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.533011:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83682d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875729254018560:12345-0@lo:400:kworker.0 Request processed in 34us (152us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835039.533017:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1788835039.533034:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254018688 00000100:00100000:1.0:1788835039.533038:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254018688 00000100:00100000:1.0:1788835039.533061:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254019200 00000100:00100000:1.0:1788835039.533070:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254019200 00000100:00100000:1.0:1788835039.533084:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254019072 00000100:00100000:1.0:1788835039.533086:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254019072 00000100:00100000:1.0:1788835039.533099:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788835039.533105:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254018688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.533139:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254018688:12345-0@lo:400:kworker.0 Request processed in 34us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835039.533145:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788835039.533157:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788835039.533163:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254019200:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835039.533188:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254019200:12345-0@lo:400:kworker.0 Request processed in 26us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835039.533194:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1788835039.533205:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1788835039.533211:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254019072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835039.533219:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254017664 00000100:00100000:2.0:1788835039.533225:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254017664 00000100:00100000:1.0:1788835039.533239:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83681880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254019072:12345-0@lo:400:kworker.0 Request processed in 28us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835039.533245:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1788835039.533261:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788835039.533267:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254018048 00000100:00100000:2.0:1788835039.533273:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254017664:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835039.533274:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254018048 00002000:00000024:2.0:1788835039.533291:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835039.533296:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788835039.533305:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254018048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835039.533356:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83685880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254017664:12345-0@lo:13:osp-pre-0-1.0 Request processed in 86us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835039.533364:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1788835039.533373:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254018048:12345-0@lo:400:kworker.0 Request processed in 67us (569us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835039.533380:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:1.0:1788835039.533402:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788835039.533406:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788835039.533414:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788835039.533421:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83684e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729254018176:12345-0@lo:400:kworker.0 Request processed in 50us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835039.533439:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83680a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254018048:0@lo:400:kworker.0 00010000:00080000:1.0:1788835039.533450:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365f800 x1875729254018560/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835039.533459:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875729254018560:0@lo:400:kworker.0 00010000:00080000:1.0:1788835039.533468:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83686a00 x1875729254019072/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835039.533489:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254019072:0@lo:400:kworker.0 00010000:00080000:1.0:1788835039.533500:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83680e00 x1875729254017664/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835055 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835039.533517:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1788835039.533522:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254017664:0@lo:13:osp-pre-0-1.0 00010000:00080000:1.0:1788835039.533535:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365ce00 x1875729254018688/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835039.533543:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254018688:0@lo:400:kworker.0 00010000:00080000:1.0:1788835039.533553:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83686300 x1875729254019200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835055 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835039.533561:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83686300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254019200:0@lo:400:kworker.0 00000100:00100000:0.0:1788835039.534626:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254017792 00000100:00100000:0.0:1788835039.534634:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254017792 00000100:00100000:0.0:1788835039.534731:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:0.0:1788835039.534740:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3614:x1875729254017792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835039.534815:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3614:x1875729254017792:12345-0@lo:400:kworker.0 Request processed in 76us (3382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835039.534823:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:3.0:1788835039.534854:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83680000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729254017792:0@lo:400:kworker.0 00010000:00010000:2.0:1788835039.719920:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835040.038514:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788835040.038538:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdaaf3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254019456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788835040.038604:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835040.038728:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254019456 00000100:00100000:1.0:1788835040.038736:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254019456 00000100:00100000:1.0:1788835040.038788:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1788835040.038798:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254019456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788835040.038825:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835040.038876:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83deed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254019456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (271us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835040.038897:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00010000:00080000:3.0:1788835040.038976:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdaaf3ca80 x1875729254019456/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835040.039010:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdaaf3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254019456:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788835040.039046:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788835040.039054:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254019584:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788835040.039081:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835040.040454:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254019584 00000100:00100000:1.0:1788835040.040479:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254019584 00000100:00100000:1.0:1788835040.040532:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788835040.040542:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254019584:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788835040.040563:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835040.040647:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254019584:12345-0@lo:13:osp-pre-1-1.0 Request processed in 106us (1563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835040.040654:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00080000:0.0:1788835040.041427:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83680e00 x1875729254019584/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835040.041447:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83680e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254019584:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788835040.743167:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1788835040.949801:0:13009:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1788835041.063308:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788835041.063360:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254019712:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788835041.063441:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835041.063622:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254019712 00000100:00100000:3.0:1788835041.063630:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254019712 00000100:00100000:3.0:1788835041.063672:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788835041.063681:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254019712:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788835041.063710:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788835041.063765:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83680a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254019712:12345-0@lo:41:osp-pre-0-1.0 Request processed in 85us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835041.063771:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788835041.063815:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254019712:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788835041.767609:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835042.797997:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835043.430153:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835043.430199:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835043.430221:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835043.430241:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835043.430268:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835043.430301:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242407808 00000100:00100000:0.0:1788835043.430335:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242407808 00000100:00100000:0.0:1788835043.430399:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 311 00000100:00100000:0.0:1788835043.430411:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:2386:x1875729242407808:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835043.430515:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:2386:x1875729242407808:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 106us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835043.430523:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 311 00000100:00100000:0.0:1788835043.430574:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242408064 00000100:00100000:0.0:1788835043.430581:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242408064 00000100:00100000:0.0:1788835043.430644:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242408320 00000100:00100000:0.0:1788835043.430648:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242408320 00000100:00100000:0.0:1788835043.430663:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242407936 00000100:00100000:0.0:1788835043.430666:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242407936 00000100:00100000:0.0:1788835043.430678:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242408192 00000100:00100000:0.0:1788835043.430681:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242408192 00000100:00100000:0.0:1788835043.430694:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 170 00000100:00100000:0.0:1788835043.430700:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaaf3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242408064:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835043.430735:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaaf3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242408064:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 34us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835043.430741:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 170 00000100:00100000:0.0:1788835043.430753:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 171 00000100:00100000:0.0:1788835043.430769:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaaf3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242408320:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835043.430806:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaaf3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242408320:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 46us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835043.430812:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 171 00000100:00100000:0.0:1788835043.430823:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 172 00000100:00100000:0.0:1788835043.430829:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaaf3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+6:2386:x1875729242407936:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835043.430852:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaaf3c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+6:2386:x1875729242407936:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 24us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835043.430858:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 172 00000100:00100000:0.0:1788835043.430869:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 173 00000100:00100000:0.0:1788835043.430875:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaaf3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242408192:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835043.430898:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaaf3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242408192:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835043.430915:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 173 00000100:00080000:0.0:1788835043.431083:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788835043.431088:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788835043.814353:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788835044.139871:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e407b2f7-b5e2-4ec6-aa60-e6561b656d05 00000020:00000080:0.0:1788835044.139883:0:8398:0:(genops.c:885:class_export_put()) final put ffff9afc837f7000/e407b2f7-b5e2-4ec6-aa60-e6561b656d05 00000020:00000080:1.0:1788835044.140582:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc837f7000/e407b2f7-b5e2-4ec6-aa60-e6561b656d05 for lustre-OST0000 00000020:00000080:1.0:1788835044.140644:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afc837f7800 for lustre-OST0000 00000001:00100000:2.0:1788835044.145107:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e407b2f7-b5e2-4ec6-aa60-e6561b656d05 00000020:00000080:2.0:1788835044.145117:0:9481:0:(genops.c:885:class_export_put()) final put ffff9afdbfa52000/e407b2f7-b5e2-4ec6-aa60-e6561b656d05 00000020:00000080:1.0:1788835044.145176:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdbfa52000/e407b2f7-b5e2-4ec6-aa60-e6561b656d05 for lustre-OST0001 00000020:00000080:1.0:1788835044.145233:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afdbfa50000 for lustre-OST0001 00000100:00100000:1.0:1788835044.645531:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254019840:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835044.645610:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835044.645695:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254019840 00000100:00100000:1.0:1788835044.645702:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254019840 00000100:00100000:1.0:1788835044.645757:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788835044.645766:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254019840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788835044.645797:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835044.645840:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83680e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254019840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 75us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835044.645859:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00010000:00080000:1.0:1788835044.645902:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83680380 x1875729254019840/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835044.645921:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83680380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254019840:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788835044.646351:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788835044.646364:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdaaf3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254020096:0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.646401:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835044.646424:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254020608:0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.646457:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835044.646473:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875729254021120:0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.646492:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835044.646512:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788835044.646517:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdaaf3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254020224:0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.646536:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835044.646551:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729254020736:0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.646571:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835044.646586:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254021248:0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.646606:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835044.646639:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254020096 00000100:00100000:0.0:1788835044.646644:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254020096 00000100:00100000:0.0:1788835044.646679:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788835044.646686:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254020096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.646726:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254020096:12345-0@lo:400:kworker.0 Request processed in 40us (324us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835044.646742:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788835044.646772:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254020608 00000100:00100000:0.0:1788835044.646775:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254020608 00000100:00100000:0.0:1788835044.646801:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788835044.646807:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254020608:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.646841:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83109880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254020608:12345-0@lo:400:kworker.0 Request processed in 34us (383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835044.646847:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1788835044.646865:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254021120 00000100:00100000:0.0:1788835044.646868:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254021120 00000100:00100000:0.0:1788835044.646897:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254020224 00000100:00100000:0.0:1788835044.646900:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254020224 00000100:00100000:0.0:1788835044.646911:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254020736 00000100:00100000:0.0:1788835044.646913:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254020736 00000100:00100000:0.0:1788835044.646926:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254021248 00000100:00100000:0.0:1788835044.646928:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254021248 00000100:00100000:0.0:1788835044.646944:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788835044.646950:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875729254021120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.646981:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875729254021120:12345-0@lo:400:kworker.0 Request processed in 31us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835044.646987:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1788835044.647000:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788835044.647006:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254020224:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.647031:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254020224:12345-0@lo:400:kworker.0 Request processed in 26us (494us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835044.647036:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1788835044.647047:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788835044.647060:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729254020736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.647089:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729254020736:12345-0@lo:400:kworker.0 Request processed in 30us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835044.647095:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1788835044.647108:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788835044.647113:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254021248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.647218:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254021248:12345-0@lo:400:kworker.0 Request processed in 104us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835044.647224:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00080000:0.0:1788835044.647258:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788835044.647261:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788835044.647271:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdaaf3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254020352:0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.647297:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835044.647337:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254020864:0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.647359:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835044.647375:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254021376:0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.647398:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835044.647417:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:0.0:1788835044.647423:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdaaf3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254019968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788835044.647454:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835044.647470:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdaaf3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254020480:0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.647493:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835044.647507:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254020992:0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.647525:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835044.647540:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254021504:0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.647570:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835044.647599:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254020352 00000100:00100000:0.0:1788835044.647604:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254020352 00000100:00100000:0.0:1788835044.647625:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254019968 00000100:00100000:0.0:1788835044.647627:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254019968 00000100:00100000:0.0:1788835044.647639:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788835044.647645:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254020352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.647679:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254020352:12345-0@lo:400:kworker.0 Request processed in 35us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835044.647685:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1788835044.647696:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788835044.647702:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254019968:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788835044.647724:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788835044.647750:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254019968:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835044.647756:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788835044.647773:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254021376 00000100:00100000:0.0:1788835044.647777:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254021376 00000100:00100000:0.0:1788835044.647802:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254020992 00000100:00100000:0.0:1788835044.647805:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254020992 00000100:00100000:0.0:1788835044.647816:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254021504 00000100:00100000:0.0:1788835044.647819:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254021504 00000100:00100000:0.0:1788835044.647830:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788835044.647835:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254021376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.647865:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254021376:12345-0@lo:400:kworker.0 Request processed in 29us (466us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835044.647871:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788835044.647882:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788835044.647895:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254020992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.647923:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254020992:12345-0@lo:400:kworker.0 Request processed in 30us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835044.647929:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788835044.647939:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788835044.647944:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254021504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.647964:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254021504:12345-0@lo:400:kworker.0 Request processed in 21us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835044.647969:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1788835044.647992:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254020864 00000100:00100000:0.0:1788835044.647995:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254020864 00000100:00100000:0.0:1788835044.648014:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254020480 00000100:00100000:0.0:1788835044.648017:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254020480 00000100:00100000:0.0:1788835044.648030:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788835044.648035:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254020864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.648059:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254020864:12345-0@lo:400:kworker.0 Request processed in 25us (700us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835044.648064:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1788835044.648073:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1788835044.648078:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254020480:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.648098:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254020480:12345-0@lo:400:kworker.0 Request processed in 20us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835044.648103:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:0.0:1788835044.649285:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788835044.649293:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788835044.649295:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788835044.649370:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdaaf3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254020224:0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.649404:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729254020736:0@lo:400:kworker.0 00010000:00080000:0.0:1788835044.649419:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8207bb80 x1875729254021248/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835044.649429:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254021248:0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.649451:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdaaf3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254020096:0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.649461:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254020608:0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.649472:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875729254021120:0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.649524:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdaaf3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254019968:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788835044.649535:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdaaf3ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254020480:0@lo:400:kworker.0 00010000:00080000:0.0:1788835044.649545:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc82079c00 x1875729254020992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835044.649554:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254020992:0@lo:400:kworker.0 00010000:00080000:0.0:1788835044.649564:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc82078700 x1875729254021504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835044.649572:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254021504:0@lo:400:kworker.0 00000100:00100000:0.0:1788835044.649581:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdaaf3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254020352:0@lo:400:kworker.0 00010000:00080000:0.0:1788835044.649591:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8207b100 x1875729254020864/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835044.649598:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254020864:0@lo:400:kworker.0 00010000:00080000:0.0:1788835044.649608:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc82079f80 x1875729254021376/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835060 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835044.649624:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254021376:0@lo:400:kworker.0 00000100:00100000:1.0:1788835044.654566:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788835044.654673:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254021632:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788835044.654745:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835044.654848:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254021632 00000100:00100000:0.0:1788835044.654857:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254021632 00000100:00100000:0.0:1788835044.654912:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788835044.654922:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254021632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788835044.654945:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835044.655000:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83680380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254021632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 79us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835044.655007:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00080000:3.0:1788835044.655262:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb90fb480 x1875729254021632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835060 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835044.655286:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254021632:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1788835044.697705:0:13157:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcb8103a50 20000000:00000080:3.0:1788835044.697724:0:13157:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9afc83d15000 uarg=0000000000000000 20000000:01000000:3.0:1788835044.697763:0:13157:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788835044.697770:0:13157:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788835044.697775:0:13157:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1788835044.699633:0:13158:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1788835044.699903:0:13157:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1788835044.706856:0:13157:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788835044.706912:0:13157:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afdb2e63400/0xdf60171e5a5d1c54 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.706949:0:13157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdb2e62200/0xdf60171e5a5d1b66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03f7 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.706960:0:13157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afc8374c000/0xdf60171e5a5d1b90 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1b89 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.706968:0:13157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afc8374da00/0xdf60171e5a5d1bba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1bb3 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.706974:0:13157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1be4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1bdd expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.706982:0:13157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdb2e60400/0xdf60171e5a5d1c0e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1c07 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.706989:0:13157:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd80030a00/0xdf60171e5a5d1c31 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0436 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.706996:0:13157:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afdb2e63400/0xdf60171e5a5d1c54 lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.707054:0:13157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd80030a00/0xdf60171e5a5d1c31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0436 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.707071:0:13157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afd80030a00/0xdf60171e5a5d1c31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0436 expref: 12 pid: 6483 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835044.707087:0:13157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13157:1875729254021760:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788835044.707241:0:13157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdb2e60400/0xdf60171e5a5d1c0e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1c07 expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.707257:0:13157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afdb2e60400/0xdf60171e5a5d1c0e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1c07 expref: 23 pid: 6481 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835044.707268:0:13157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13157:1875729254021888:0@lo:104: 00000100:00100000:2.0:1788835044.707308:0:13157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788835044.707393:0:13157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1be4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1bdd expref: 23 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.707402:0:13157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1be4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1bdd expref: 23 pid: 6481 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835044.707411:0:13157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13157:1875729254022016:0@lo:104: 00000100:00100000:2.0:1788835044.707433:0:13157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788835044.707472:0:13157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afc8374da00/0xdf60171e5a5d1bba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1bb3 expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.707480:0:13157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afc8374da00/0xdf60171e5a5d1bba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1bb3 expref: 23 pid: 6483 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835044.707487:0:13157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13157:1875729254022144:0@lo:104: 00000100:00100000:2.0:1788835044.707508:0:13157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788835044.707527:0:13157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afc8374c000/0xdf60171e5a5d1b90 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1b89 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.707535:0:13157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afc8374c000/0xdf60171e5a5d1b90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1b89 expref: 23 pid: 6482 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835044.707543:0:13157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13157:1875729254022272:0@lo:104: 00000100:00100000:2.0:1788835044.707569:0:13157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788835044.707585:0:13157:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdb2e62200/0xdf60171e5a5d1b66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03f7 expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.707594:0:13157:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afdb2e62200/0xdf60171e5a5d1b66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03f7 expref: 12 pid: 6483 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835044.707602:0:13157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13157:1875729254022400:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788835044.707624:0:13157:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc836ebcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788835044.707880:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254021888 00000100:00100000:3.0:1788835044.707888:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254021888 00000100:00100000:3.0:1788835044.707924:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254022016 00000100:00100000:3.0:1788835044.707932:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254022016 00000100:00100000:3.0:1788835044.707942:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254022144 00000100:00100000:3.0:1788835044.707944:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254022144 00000100:00100000:3.0:1788835044.707952:0:6471:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254022272 00000100:00100000:3.0:1788835044.707954:0:6471:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254022272 00000100:00100000:3.0:1788835044.707965:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788835044.707973:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+6:13157:x1875729254021888:12345-0@lo:104: 00010000:00010000:3.0:1788835044.707985:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d1c07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1c0e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708037:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1788835044.708043:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+6:13157:x1875729254021888:12345-0@lo:104: Request processed in 71us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835044.708050:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788835044.708066:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788835044.708072:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+5:13157:x1875729254022016:12345-0@lo:104: 00010000:00010000:3.0:1788835044.708081:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1bdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1be4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708110:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1788835044.708115:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+5:13157:x1875729254022016:12345-0@lo:104: Request processed in 44us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835044.708120:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788835044.708131:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788835044.708136:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:13157:x1875729254022144:12345-0@lo:104: 00010000:00010000:3.0:1788835044.708143:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1bb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1bba expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708175:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1788835044.708189:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd0000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:13157:x1875729254022144:12345-0@lo:104: Request processed in 52us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835044.708194:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788835044.708206:0:6471:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788835044.708212:0:6471:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:13157:x1875729254022272:12345-0@lo:104: 00010000:00010000:3.0:1788835044.708219:0:6471:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62e00/0xdf60171e5a5d1b89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1b90 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708247:0:6471:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1788835044.708252:0:6471:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:13157:x1875729254022272:12345-0@lo:104: Request processed in 41us (683us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835044.708258:0:6471:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:3.0:1788835044.708273:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1788835044.708278:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d1c07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1c0e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708286:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61c00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:3.0:1788835044.708289:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d1c07 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1c0e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708298:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d1c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1c0e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788835044.708306:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d1c07 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1c0e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788835044.708332:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788835044.708360:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d1c07 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1c0e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708376:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788835044.708399:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d1c07 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1c0e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708406:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d1c07 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1c0e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708419:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1788835044.708422:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1bdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1be4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708427:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60200 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:3.0:1788835044.708430:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1bdd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1be4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708450:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1be4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788835044.708457:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1bdd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1be4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788835044.708462:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788835044.708476:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1bdd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1be4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708482:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788835044.708495:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1bdd lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1be4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708501:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1bdd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1be4 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708517:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788835044.708520:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1bb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1bba expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708526:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e62000 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:3.0:1788835044.708528:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1bb3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1bba expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708534:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1bb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1bba expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788835044.708540:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1bb3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1bba expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788835044.708556:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788835044.708571:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1bb3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1bba expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708576:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788835044.708583:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1bb3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1bba expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708589:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62000/0xdf60171e5a5d1bb3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1bba expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708598:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788835044.708600:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62e00/0xdf60171e5a5d1b89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1b90 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708617:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e62e00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:3.0:1788835044.708620:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62e00/0xdf60171e5a5d1b89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1b90 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708628:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62e00/0xdf60171e5a5d1b89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1b90 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788835044.708634:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62e00/0xdf60171e5a5d1b89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1b90 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788835044.708639:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1788835044.708651:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62e00/0xdf60171e5a5d1b89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1b90 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708657:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1788835044.708662:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62e00/0xdf60171e5a5d1b89 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1b90 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708667:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62e00/0xdf60171e5a5d1b89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1b90 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708679:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835044.708681:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835044.708683:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835044.708696:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254022528:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788835044.708727:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835044.708760:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788835044.708766:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254022912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788835044.708797:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835044.708826:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254022528 00000100:00100000:3.0:1788835044.708830:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254022528 00010000:00010000:3.0:1788835044.708851:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdb2e60400/0xdf60171e5a5d1c0e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1c07 expref: 24 pid: 6481 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835044.708874:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254022912 00000100:00100000:3.0:1788835044.708877:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254022912 00010000:00010000:3.0:1788835044.708889:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afc8374c000/0xdf60171e5a5d1b90 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1b89 expref: 25 pid: 6482 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835044.708908:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788835044.708915:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+25:3617:x1875729254022528:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788835044.708926:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835044.708931:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdb2e60400/0xdf60171e5a5d1c0e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1c07 expref: 25 pid: 6481 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708940:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdb2e60400/0xdf60171e5a5d1c0e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1c07 expref: 25 pid: 6481 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.708955:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835044.708980:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90fb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+25:3617:x1875729254022528:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835044.708986:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788835044.708998:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788835044.709004:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729254022912:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788835044.709010:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835044.709013:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afc8374c000/0xdf60171e5a5d1b90 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1b89 expref: 24 pid: 6482 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.709030:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afc8374c000/0xdf60171e5a5d1b90 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1b89 expref: 24 pid: 6482 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835044.709040:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835044.709061:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729254022912:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835044.709067:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788835044.709101:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254022912:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788835044.709108:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254022528:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788835044.709524:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835044.709535:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729254022784:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788835044.709566:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835044.709606:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788835044.709612:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729254022656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788835044.709635:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835044.709664:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254022784 00000100:00100000:1.0:1788835044.709668:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254022784 00010000:00010000:1.0:1788835044.709686:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afc8374da00/0xdf60171e5a5d1bba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1bb3 expref: 24 pid: 6483 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835044.709704:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254022656 00000100:00100000:1.0:1788835044.709707:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254022656 00010000:00010000:1.0:1788835044.709719:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1be4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1bdd expref: 25 pid: 6481 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835044.709732:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788835044.709738:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83680000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+25:3615:x1875729254022784:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788835044.709746:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835044.709759:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afc8374da00/0xdf60171e5a5d1bba lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1bb3 expref: 25 pid: 6483 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835044.709766:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afc8374da00/0xdf60171e5a5d1bba lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1bb3 expref: 25 pid: 6483 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835044.709777:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788835044.709809:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83680000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+25:3615:x1875729254022784:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835044.709815:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788835044.709830:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788835044.709836:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83686300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3615:x1875729254022656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788835044.709843:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835044.709847:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1be4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1bdd expref: 24 pid: 6481 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835044.709855:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1be4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1bdd expref: 24 pid: 6481 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835044.709864:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788835044.709886:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83686300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3615:x1875729254022656:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835044.709892:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788835044.709921:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729254022656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788835044.709930:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729254022784:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788835044.710177:0:13157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e60400/0xdf60171e5a5d1c0e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1c07 expref: 23 pid: 6481 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835044.710189:0:13157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd1180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13157:1875729254021888:0@lo:104: 00010000:00010000:2.0:1788835044.710200:0:13157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1be4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1bdd expref: 22 pid: 6481 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835044.710208:0:13157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13157:1875729254022016:0@lo:104: 00010000:00010000:2.0:1788835044.710217:0:13157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afc8374da00/0xdf60171e5a5d1bba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1bb3 expref: 21 pid: 6483 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835044.710224:0:13157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd2a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13157:1875729254022144:0@lo:104: 00010000:00010000:2.0:1788835044.710234:0:13157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afc8374c000/0xdf60171e5a5d1b90 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1b89 expref: 20 pid: 6482 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835044.710242:0:13157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd1500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13157:1875729254022272:0@lo:104: 00010000:00010000:1.0:1788835044.710793:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835044.718134:0:13157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd0a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13157:1875729254021760:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788835044.718149:0:13157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13157:1875729254022400:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788835044.718182:0:13157:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afdb2e63400/0xdf60171e5a5d1c54 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835044.727597:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835044.727708:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242408448 00000100:00100000:1.0:1788835044.727718:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242408448 00010000:00010000:1.0:1788835044.727772:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd80030a00/0xdf60171e5a5d1c31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0436 expref: 13 pid: 6483 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835044.727812:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:1.0:1788835044.727823:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82079f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8f7875b-4951-482c-9de0-d3888250010c+13:2385:x1875729242408448:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788835044.727838:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835044.727845:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd80030a00/0xdf60171e5a5d1c31 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0436 expref: 13 pid: 6483 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835044.727859:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd80030a00/0xdf60171e5a5d1c31 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0436 expref: 13 pid: 6483 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835044.727879:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd80030a00/0xdf60171e5a5d1c31 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0436 expref: 13 pid: 6483 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835044.727894:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788835044.727958:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82079f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8f7875b-4951-482c-9de0-d3888250010c+12:2385:x1875729242408448:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 137us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835044.727965:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:3.0:1788835044.734718:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835044.734901:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242408576 00000100:00100000:2.0:1788835044.734912:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242408576 00010000:00010000:2.0:1788835044.734949:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdb2e62200/0xdf60171e5a5d1b66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03f7 expref: 12 pid: 6483 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835044.734989:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:2.0:1788835044.734998:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaae6f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e8f7875b-4951-482c-9de0-d3888250010c+12:2385:x1875729242408576:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835044.735011:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835044.735016:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdb2e62200/0xdf60171e5a5d1b66 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03f7 expref: 12 pid: 6483 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.735029:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdb2e62200/0xdf60171e5a5d1b66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03f7 expref: 12 pid: 6483 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.735047:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e62200/0xdf60171e5a5d1b66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03f7 expref: 12 pid: 6483 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.735064:0:9491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afdb2e63400/0xdf60171e5a5d1c54 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.735072:0:9491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e63400/0xdf60171e5a5d1c54 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.735089:0:9491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afdb2e63400/0xdf60171e5a5d1c54 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.735096:0:9491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afdb2e63400/0xdf60171e5a5d1c54 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.735118:0:9491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afdb2e63400/0xdf60171e5a5d1c54 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.735244:0:9491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afdb2e63400/0xdf60171e5a5d1c54 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.735254:0:9491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e63400 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835044.735258:0:9491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afdb2e63400/0xdf60171e5a5d1c54 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.735265:0:9491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afdb2e63400/0xdf60171e5a5d1c54 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.735288:0:9491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afdb2e63400/0xdf60171e5a5d1c54 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835044.735305:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835044.735375:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaae6f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:e8f7875b-4951-482c-9de0-d3888250010c+11:2385:x1875729242408576:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 378us (666us total) trans 0 rc 0/0 00010000:00010000:0.0:1788835044.735471:0:13157:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afdb2e63400/0xdf60171e5a5d1c54 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835044.735480:0:13157:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afdb2e63400/0xdf60171e5a5d1c54 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835044.735486:0:13157:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e63400/0xdf60171e5a5d1c54 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13157 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835044.737448:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00010000:00010000:2.0:1788835044.837580:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835045.158466:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788835045.158490:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254023040:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788835045.158568:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835045.158889:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254023040 00000100:00100000:1.0:1788835045.158898:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254023040 00000100:00100000:1.0:1788835045.158958:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788835045.158969:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8207b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254023040:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788835045.158998:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835045.159057:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8207b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254023040:12345-0@lo:13:osp-pre-1-1.0 Request processed in 89us (488us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835045.159064:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00010000:00080000:0.0:1788835045.159206:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83686a00 x1875729254023040/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835045.159226:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83686a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254023040:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788835045.160672:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788835045.160699:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254023168:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788835045.160751:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835045.161186:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254023168 00000100:00100000:0.0:1788835045.161193:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254023168 00000100:00100000:0.0:1788835045.161246:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788835045.161255:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254023168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788835045.161277:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835045.161354:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83686a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254023168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (601us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835045.161362:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00010000:00080000:1.0:1788835045.161507:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc82078700 x1875729254023168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835045.161526:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254023168:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788835045.862539:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835045.920035:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835045.927621:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242408704 00000100:00100000:2.0:1788835045.927644:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242408704 00000100:00100000:2.0:1788835045.927735:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 313 00000100:00100000:2.0:1788835045.927749:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+11:6160:x1875729242408704:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788835045.927771:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835045.927799:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e63000/0xdf60171e5a5d1c5b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0467 expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835045.927850:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e63000/0xdf60171e5a5d1c5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0467 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835045.927865:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e63000/0xdf60171e5a5d1c5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0467 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835045.927876:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e63000, rc 0) 00000100:00100000:2.0:1788835045.927967:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+12:6160:x1875729242408704:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 220us (7945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835045.927976:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 313 00000100:00100000:0.0:1788835045.931164:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835045.933604:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242408832 00000100:00100000:2.0:1788835045.933626:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242408832 00000100:00100000:2.0:1788835045.933714:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 314 00000100:00100000:2.0:1788835045.933727:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+12:6160:x1875729242408832:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788835045.934060:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+12:6160:x1875729242408832:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 335us (2912us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835045.934070:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 314 00000100:00100000:3.0:1788835045.946090:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835045.946170:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242408960 00000100:00100000:0.0:1788835045.946184:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242408960 00000100:00100000:0.0:1788835045.946253:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 315 00000100:00100000:0.0:1788835045.946265:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+12:6160:x1875729242408960:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788835045.947963:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+12:6160:x1875729242408960:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 1690us (1880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835045.947976:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 315 00000100:00100000:2.0:1788835045.954798:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835045.955690:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242409088 00000100:00100000:3.0:1788835045.955704:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242409088 00000100:00100000:2.0:1788835045.955954:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 316 00000100:00100000:2.0:1788835045.955968:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+12:6160:x1875729242409088:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788835045.955992:0:6481:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835045.956015:0:6481:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e62c00/0xdf60171e5a5d1c62 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae046e expref: -99 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835045.956052:0:6481:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e62c00/0xdf60171e5a5d1c62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae046e expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835045.956076:0:6481:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e62c00/0xdf60171e5a5d1c62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae046e expref: 13 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835045.956089:0:6481:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e62c00, rc 0) 00000100:00100000:2.0:1788835045.956171:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:6160:x1875729242409088:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 206us (1389us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835045.956179:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 316 00000100:00100000:0.0:1788835045.963534:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835045.963738:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242409216 00000100:00100000:3.0:1788835045.963751:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242409216 00000100:00100000:3.0:1788835045.963819:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 317 00000100:00100000:3.0:1788835045.963830:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:6160:x1875729242409216:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788835045.964027:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:6160:x1875729242409216:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 197us (509us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835045.964036:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 317 00000100:00100000:1.0:1788835045.968406:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835045.968559:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242409344 00000100:00100000:2.0:1788835045.968571:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242409344 00000100:00100000:2.0:1788835045.968639:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 318 00000100:00100000:2.0:1788835045.968650:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:6160:x1875729242409344:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788835045.968852:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:6160:x1875729242409344:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 203us (467us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835045.968860:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 318 00000100:00100000:2.0:1788835046.181502:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788835046.181606:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254023296:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788835046.181704:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835046.181754:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254023296 00000100:00100000:3.0:1788835046.181763:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254023296 00000100:00100000:3.0:1788835046.181835:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788835046.181846:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254023296:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788835046.181888:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788835046.181965:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254023296:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835046.181973:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788835046.182026:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254023296:0@lo:41:osp-pre-0-1.0 10000000:01000000:0.0:1788835046.503309:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1788835046.503333:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afc82611000 from 7 10000000:01000000:0.0:1788835046.503339:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788835046.503414:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1c69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835046.503437:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1c69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835046.503450:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1c69 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835046.503502:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254023424:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788835046.503595:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835046.503673:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdab6c0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788835046.503762:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254023424 00000100:00100000:3.0:1788835046.503773:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254023424 00000100:00100000:3.0:1788835046.503853:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 319 00000100:00100000:3.0:1788835046.503864:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:6485:x1875729254023424:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788835046.503882:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835046.503898:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afc8374dc00/0xdf60171e5a5d1c70 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1c69 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835046.503927:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afc8374dc00/0xdf60171e5a5d1c70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1c69 expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835046.503939:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afc8374dc00/0xdf60171e5a5d1c70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1c69 expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835046.503951:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374dc00, rc 0) 00000100:00100000:3.0:1788835046.503999:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729254023424:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 137us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835046.504007:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 319 00000100:00100000:0.0:1788835046.504965:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254023424:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788835046.504988:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1c69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c70 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835046.505000:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1c69 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1c70 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835046.505097:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254023552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788835046.505142:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835046.505174:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdab6c0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1788835046.505484:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254023552 00000100:00100000:3.0:1788835046.505491:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254023552 00000100:00100000:3.0:1788835046.505539:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 320 00000100:00100000:3.0:1788835046.505548:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729254023552:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788835046.505719:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729254023552:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 171us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835046.505744:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 320 00000100:00100000:0.0:1788835046.506079:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254023552:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788835046.506116:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82079c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254023680:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788835046.506163:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835046.506200:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdab6c0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788835046.506481:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254023680 00000100:00100000:2.0:1788835046.506488:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254023680 00000100:00100000:2.0:1788835046.506522:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 321 00000100:00100000:2.0:1788835046.506530:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729254023680:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788835046.506637:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729254023680:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835046.506643:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 321 00000100:00100000:0.0:1788835046.507172:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82079c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254023680:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788835046.509948:0:13213:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788835046.519431:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788835046.519501:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788835046.519518:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1c69 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c70 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835046.519533:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1c69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c70 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835046.519549:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788835046.519552:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afdba102000 from 7 10000000:01000000:2.0:1788835046.519555:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788835046.519625:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1c77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835046.519634:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1c77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835046.519648:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1c77 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835046.519683:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254023808:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788835046.519776:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835046.519903:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc836eb0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788835046.526162:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254023808 00000100:00100000:3.0:1788835046.526181:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254023808 00000100:00100000:3.0:1788835046.526265:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:3.0:1788835046.526278:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729254023808:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788835046.526301:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835046.526346:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afc8374d000/0xdf60171e5a5d1c7e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1c77 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835046.526383:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afc8374d000/0xdf60171e5a5d1c7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1c77 expref: 22 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835046.526396:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afc8374d000/0xdf60171e5a5d1c7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1c77 expref: 22 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835046.526408:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374d000, rc 0) 00000100:00100000:3.0:1788835046.526518:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729254023808:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 243us (6741us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835046.526526:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:2.0:1788835046.526807:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254023808:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788835046.526840:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1c77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c7e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835046.526852:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1c77 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1c7e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835046.526950:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254023936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788835046.527007:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835046.527054:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc836eb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788835046.527173:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254023936 00000100:00100000:0.0:1788835046.527179:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254023936 00000100:00100000:0.0:1788835046.527216:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788835046.527224:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729254023936:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788835046.527392:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729254023936:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 167us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835046.527408:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:2.0:1788835046.527499:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254023936:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788835046.527532:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254024064:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788835046.527890:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835046.529565:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc836eb0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788835046.533209:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254024064 00000100:00100000:0.0:1788835046.533232:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254024064 00000100:00100000:0.0:1788835046.533340:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788835046.533355:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729254024064:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788835046.533771:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729254024064:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 419us (5880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835046.533781:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:2.0:1788835046.535971:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254024064:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788835046.544092:0:13214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1788835046.544245:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1788835046.544283:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788835046.544298:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1c77 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c7e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835046.544331:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1c77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c7e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788835046.544373:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788835046.544377:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afdb279f000 from 7 10000000:01000000:3.0:1788835046.544380:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788835046.544440:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d1c85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835046.544450:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d1c85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835046.544465:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d1c85 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835046.544499:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254024192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788835046.544608:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835046.544665:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc83085180 going to sleep for 11 seconds 00000100:00100000:2.0:1788835046.546399:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254024192 00000100:00100000:2.0:1788835046.546420:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254024192 00000100:00100000:2.0:1788835046.546510:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:2.0:1788835046.546522:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729254024192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788835046.546542:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835046.546564:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1c8c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1c85 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835046.546596:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1c8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1c85 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835046.546608:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1c8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1c85 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835046.546618:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e63800, rc 0) 00000100:00100000:2.0:1788835046.546714:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729254024192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 194us (2107us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835046.546721:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:3.0:1788835046.546894:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254024192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788835046.546920:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d1c85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c8c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835046.546933:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d1c85 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1c8c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835046.547538:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254024320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788835046.547676:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835046.547718:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc83085180 going to sleep for 11 seconds 00000100:00100000:0.0:1788835046.550065:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254024320 00000100:00100000:0.0:1788835046.550086:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254024320 00000100:00100000:0.0:1788835046.550179:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:0.0:1788835046.550191:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729254024320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788835046.550445:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729254024320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 255us (2768us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835046.550455:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:3.0:1788835046.550671:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254024320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788835046.550739:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254024448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788835046.551075:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835046.551120:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc83085180 going to sleep for 11 seconds 00000100:00100000:0.0:1788835046.551399:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254024448 00000100:00100000:0.0:1788835046.551407:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254024448 00000100:00100000:0.0:1788835046.551463:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:0.0:1788835046.551472:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729254024448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788835046.552567:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729254024448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1088us (1486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835046.552591:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:2.0:1788835046.560503:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254024448:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788835046.562046:0:13215:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788835046.562795:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788835046.562845:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788835046.562860:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d1c85 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c8c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835046.562875:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d1c85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c8c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835046.562890:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788835046.562893:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afd85554000 from 7 10000000:01000000:2.0:1788835046.562897:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788835046.562950:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1c93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835046.562960:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1c93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835046.562973:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1c93 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835046.563005:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254024576:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788835046.563103:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835046.563167:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc836eb300 going to sleep for 11 seconds 00000100:00100000:3.0:1788835046.565654:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254024576 00000100:00100000:3.0:1788835046.565672:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254024576 00000100:00100000:3.0:1788835046.565758:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 328 00000100:00100000:3.0:1788835046.565770:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729254024576:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788835046.565791:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835046.565813:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afc8374ce00/0xdf60171e5a5d1c9a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1c93 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835046.565846:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afc8374ce00/0xdf60171e5a5d1c9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1c93 expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835046.565860:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afc8374ce00/0xdf60171e5a5d1c9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1c93 expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835046.565870:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374ce00, rc 0) 00000100:00100000:3.0:1788835046.565964:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:6485:x1875729254024576:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 195us (2861us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835046.565972:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 328 00000100:00100000:2.0:1788835046.566399:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254024576:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788835046.566441:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1c93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c9a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835046.566452:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1c93 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1c9a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835046.566550:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254024704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788835046.566626:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835046.566665:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc836eb300 going to sleep for 11 seconds 00000100:00100000:0.0:1788835046.577498:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254024704 00000100:00100000:0.0:1788835046.577518:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254024704 00000100:00100000:0.0:1788835046.577596:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 329 00000100:00100000:0.0:1788835046.577622:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:6485:x1875729254024704:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788835046.577840:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:6485:x1875729254024704:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 220us (11213us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835046.577848:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 329 00000100:00100000:2.0:1788835046.578058:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254024704:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788835046.578126:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254024832:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788835046.578192:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835046.578233:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc836eb300 going to sleep for 11 seconds 00000100:00100000:0.0:1788835046.578627:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254024832 00000100:00100000:0.0:1788835046.578634:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254024832 00000100:00100000:0.0:1788835046.578710:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 330 00000100:00100000:0.0:1788835046.578719:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:6485:x1875729254024832:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788835046.578825:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:6485:x1875729254024832:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 107us (633us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835046.578832:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 330 00000100:00100000:2.0:1788835046.579035:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254024832:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788835046.579849:0:13216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1788835046.579926:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1788835046.579948:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788835046.579960:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1c93 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c9a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835046.579973:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1c93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c9a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835046.886661:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835047.909663:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835048.541819:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835048.541873:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835048.541900:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835048.541919:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835048.541941:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835048.542024:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242409472 00000100:00100000:1.0:1788835048.542037:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242409472 00000100:00100000:1.0:1788835048.542109:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 331 00000100:00100000:1.0:1788835048.542121:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:2387:x1875729242409472:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835048.542222:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:2387:x1875729242409472:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 103us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835048.542231:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 331 00000100:00100000:2.0:1788835048.545579:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242409728 00000100:00100000:2.0:1788835048.545599:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242409728 00000100:00100000:2.0:1788835048.545700:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242409984 00000100:00100000:2.0:1788835048.545704:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242409984 00000100:00100000:2.0:1788835048.545727:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242409600 00000100:00100000:2.0:1788835048.545730:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242409600 00000100:00100000:2.0:1788835048.545743:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242409856 00000100:00100000:2.0:1788835048.545746:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242409856 00000100:00100000:2.0:1788835048.545770:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 180 00000100:00100000:2.0:1788835048.545781:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2387:x1875729242409728:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835048.545892:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2387:x1875729242409728:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 112us (4017us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835048.545921:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 180 00000100:00100000:2.0:1788835048.545942:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 181 00000100:00100000:2.0:1788835048.545949:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2387:x1875729242409984:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835048.545976:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2387:x1875729242409984:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 28us (4076us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835048.545982:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 181 00000100:00100000:2.0:1788835048.545992:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 182 00000100:00100000:2.0:1788835048.545998:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+6:2387:x1875729242409600:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835048.546020:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+6:2387:x1875729242409600:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (4100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835048.546026:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 182 00000100:00100000:2.0:1788835048.546036:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 183 00000100:00100000:2.0:1788835048.546042:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2387:x1875729242409856:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835048.546068:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2387:x1875729242409856:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (4126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835048.546074:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 183 00000100:00080000:1.0:1788835048.546581:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788835048.546587:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:1.0:1788835048.933600:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788835049.010066:0:13356:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788835049.766152:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788835049.766184:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254024960:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788835049.766285:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835049.768348:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788835049.768384:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254025088:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788835049.768563:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788835049.768575:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254025216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788835049.768659:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835049.768748:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254024960 00000100:00100000:2.0:1788835049.768758:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254024960 00000100:00100000:2.0:1788835049.768825:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788835049.768852:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254024960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788835049.768894:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00080000:1.0:1788835049.769252:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788835049.769295:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254025216 00000100:00100000:1.0:1788835049.769299:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254025216 00000100:00100000:1.0:1788835049.769359:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788835049.769367:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254025216:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788835049.769413:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788835049.769591:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788835049.769603:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729254025344:0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.773985:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788835049.774196:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb90f9880 x1875729254024960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835049.774224:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254024960:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788835049.774285:0:8406:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:0.0:1788835049.774296:0:8406:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:0.0:1788835049.774579:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254025088 00000100:00100000:0.0:1788835049.774588:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254025088 00000100:00100000:0.0:1788835049.774760:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788835049.774771:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254025088:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788835049.774799:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835049.774871:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82079c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254025088:12345-0@lo:13:osp-pre-0-1.0 Request processed in 102us (898us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835049.774886:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00010000:00080000:0.0:1788835049.774923:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83cd0a80 x1875729254025088/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835065 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835049.774940:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254025088:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788835049.774977:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788835049.775040:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254025472:0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.775080:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835049.775138:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8207bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254025600:0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.775168:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835049.775228:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788835049.775237:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254025728:0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.775264:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835049.775305:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdaaf3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875729254025856:0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.775376:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835049.775446:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdaaf3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729254025984:0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.775471:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835049.775523:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdaaf3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729254026112:0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.775549:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835049.775597:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788835049.775603:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875729254026240:0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.775625:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835049.775650:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254026368:0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.775675:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835049.775718:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254026368 00000100:00100000:0.0:1788835049.775724:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254026368 00000100:00100000:0.0:1788835049.775771:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788835049.775781:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254026368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.775828:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254026368:12345-0@lo:400:kworker.0 Request processed in 49us (151us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835049.775836:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1788835049.775858:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788835049.775878:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36ca80 x1875729254026368/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835049.775890:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254026368:0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.775927:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254026496:0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.775952:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835049.775981:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254026496 00000100:00100000:0.0:1788835049.775986:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254026496 00000100:00100000:0.0:1788835049.776015:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1788835049.776021:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254026496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.776056:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254026496:12345-0@lo:400:kworker.0 Request processed in 34us (103us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835049.776063:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1788835049.776076:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788835049.776095:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36ca80 x1875729254026496/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835049.776103:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254026496:0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.776151:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254025472 00000100:00100000:0.0:1788835049.776155:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254025472 00000100:00100000:0.0:1788835049.776186:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254025728 00000100:00100000:0.0:1788835049.776190:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254025728 00000100:00100000:0.0:1788835049.776201:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254025856 00000100:00100000:0.0:1788835049.776204:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254025856 00000100:00100000:0.0:1788835049.776222:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254025984 00000100:00100000:0.0:1788835049.776225:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254025984 00000100:00100000:0.0:1788835049.776239:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254026112 00000100:00100000:0.0:1788835049.776241:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254026112 00000100:00100000:0.0:1788835049.776254:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254026240 00000100:00100000:0.0:1788835049.776257:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254026240 00000100:00100000:0.0:1788835049.776274:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788835049.776280:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8207aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254025472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.776356:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8207aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254025472:12345-0@lo:400:kworker.0 Request processed in 76us (1275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835049.776363:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1788835049.776376:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788835049.776383:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254025728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.776428:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82079f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254025728:12345-0@lo:400:kworker.0 Request processed in 46us (1163us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835049.776435:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788835049.776447:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788835049.776454:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaaf3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875729254025856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.776483:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaaf3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875729254025856:12345-0@lo:400:kworker.0 Request processed in 31us (1107us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835049.776489:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788835049.776502:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788835049.776509:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaaf3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729254025984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.776536:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaaf3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729254025984:12345-0@lo:400:kworker.0 Request processed in 28us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835049.776549:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788835049.776563:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788835049.776569:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729254026112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.776603:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729254026112:12345-0@lo:400:kworker.0 Request processed in 34us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835049.776609:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:0.0:1788835049.776621:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:0.0:1788835049.776627:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875729254026240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.776654:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875729254026240:12345-0@lo:400:kworker.0 Request processed in 27us (1028us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835049.776660:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00080000:0.0:1788835049.776680:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788835049.776691:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788835049.776713:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdaaf3d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729254026112:0@lo:400:kworker.0 00010000:00080000:0.0:1788835049.776739:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36fb80 x1875729254026240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835049.776749:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875729254026240:0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.776761:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdaaf3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875729254025856:0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.776771:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82078700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254025728:0@lo:400:kworker.0 00010000:00080000:0.0:1788835049.776801:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdaaf3e680 x1875729254025984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835049.776810:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdaaf3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729254025984:0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.776821:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254025472:0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.776898:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254025600 00000100:00100000:0.0:1788835049.776903:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254025600 00000100:00100000:0.0:1788835049.776933:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788835049.776941:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8207b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254025600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.776983:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8207b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254025600:12345-0@lo:400:kworker.0 Request processed in 43us (1814us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835049.776990:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1788835049.777022:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8207bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254025600:0@lo:400:kworker.0 00000100:00100000:1.0:1788835049.781303:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254025216:12345-0@lo:41:osp-pre-1-0.0 Request processed in 11919us (12627us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835049.784296:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254025216:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788835049.784535:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83686300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254024960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 15681us (18246us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835049.784548:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1788835049.784558:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835049.784665:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254025344 00000100:00100000:0.0:1788835049.784673:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254025344 00000100:00100000:0.0:1788835049.784767:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:0.0:1788835049.784777:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3614:x1875729254025344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835049.784845:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3614:x1875729254025344:12345-0@lo:400:kworker.0 Request processed in 70us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835049.784852:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:3.0:1788835049.784910:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729254025344:0@lo:400:kworker.0 00000100:00100000:1.0:1788835049.785858:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00010000:00010000:0.0:1788835049.957906:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835050.277512:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788835050.277553:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254026624:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788835050.277651:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835050.277815:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254026752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788835050.277853:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835050.282639:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254026624 00000100:00100000:0.0:1788835050.282660:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254026624 00000100:00100000:3.0:1788835050.282933:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254026752 00000100:00100000:3.0:1788835050.282938:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254026752 00000100:00100000:3.0:1788835050.282973:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788835050.282985:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254026624:12345-0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788835050.283576:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788835050.283590:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254026752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788835050.283615:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:3.0:1788835050.283794:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835050.283838:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254026752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 252us (5983us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835050.283860:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00010000:00080000:0.0:1788835050.285691:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36f800 x1875729254026752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835050.285740:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254026752:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788835050.287994:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254026624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 4996us (10328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835050.288024:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00010000:00080000:0.0:1788835050.288189:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36fb80 x1875729254026624/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835050.288217:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254026624:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788835050.985415:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835051.301686:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788835051.301711:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254026880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788835051.301780:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835051.301928:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254026880 00000100:00100000:2.0:1788835051.301936:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254026880 00000100:00100000:2.0:1788835051.301992:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788835051.302003:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254026880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788835051.302035:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788835051.302088:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254026880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 87us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835051.302095:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1788835051.302528:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254026880:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788835052.005743:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835053.049688:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835053.669722:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835053.669762:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835053.669793:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835053.669815:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835053.669837:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835053.670058:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242410112 00000100:00100000:0.0:1788835053.670069:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242410112 00000100:00100000:0.0:1788835053.670121:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 333 00000100:00100000:0.0:1788835053.670130:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:2388:x1875729242410112:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835053.670199:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:2388:x1875729242410112:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 69us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835053.670207:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 333 00000100:00100000:0.0:1788835053.670240:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242410368 00000100:00100000:0.0:1788835053.670245:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242410368 00000100:00100000:0.0:1788835053.670276:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242410624 00000100:00100000:0.0:1788835053.670279:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242410624 00000100:00100000:0.0:1788835053.670293:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242410240 00000100:00100000:0.0:1788835053.670296:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242410240 00000100:00100000:0.0:1788835053.670306:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242410496 00000100:00100000:0.0:1788835053.670307:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242410496 00000100:00100000:0.0:1788835053.670383:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 190 00000100:00100000:0.0:1788835053.670391:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2388:x1875729242410368:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835053.670438:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2388:x1875729242410368:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 48us (675us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835053.670445:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 190 00000100:00100000:0.0:1788835053.670458:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 191 00000100:00100000:0.0:1788835053.670465:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2388:x1875729242410624:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835053.670488:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2388:x1875729242410624:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 24us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835053.670494:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 191 00000100:00100000:0.0:1788835053.670504:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 192 00000100:00100000:0.0:1788835053.670510:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+6:2388:x1875729242410240:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835053.670532:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa42300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+6:2388:x1875729242410240:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 22us (716us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835053.670537:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 192 00000100:00100000:0.0:1788835053.670548:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 193 00000100:00100000:0.0:1788835053.670554:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2388:x1875729242410496:12345-192.168.203.22@tcp:400:kworker.0 00000100:00080000:3.0:1788835053.670876:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788835053.670881:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788835053.671256:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa40a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2388:x1875729242410496:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 699us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835053.671265:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 193 00010000:00010000:3.0:1788835054.062245:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1788835054.487260:0:13505:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:37:34 (1788835054) === 00000100:00100000:2.0:1788835054.699450:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835054.699499:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835054.699583:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242410752 00000100:00100000:3.0:1788835054.699594:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242410752 00000100:00100000:3.0:1788835054.699727:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:3.0:1788835054.699737:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+6:2387:x1875729242410752:12345-192.168.203.22@tcp:41:mkdir.0 00000004:00000024:3.0:1788835054.699784:0:9806:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788835054.700535:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+6:2387:x1875729242410752:12345-192.168.203.22@tcp:41:mkdir.0 Request processed in 742us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835054.700546:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:0.0:1788835054.700986:0:6497:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242410880 00000100:00100000:0.0:1788835054.700994:0:6497:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242410880 00000100:00100000:0.0:1788835054.701038:0:6497:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:0.0:1788835054.701046:0:6497:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:b8987b33-76f7-43a0-9448-1013c4af787f+6:10464:x1875729242410880:12345-192.168.203.22@tcp:700:mkdir.0 00000100:00100000:0.0:1788835054.701099:0:6497:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:b8987b33-76f7-43a0-9448-1013c4af787f+6:10464:x1875729242410880:12345-192.168.203.22@tcp:700:mkdir.0 Request processed in 54us (1599us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835054.701118:0:6497:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:3.0:1788835054.702809:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835054.702887:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242411136 00000100:00100000:0.0:1788835054.702895:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242411136 00000100:00100000:0.0:1788835054.702976:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:0.0:1788835054.702984:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+6:10464:x1875729242411136:12345-192.168.203.22@tcp:36:mkdir.0 00010000:00010000:0.0:1788835054.703030:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835054.705485:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1b43 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03e2 expref: 6 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.705509:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc835c9c00) 00010000:00010000:0.0:1788835054.705537:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788835054.705642:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d1ca1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.705655:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d1ca1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.705665:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d1ca1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.705678:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ca8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.705685:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.705691:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.706180:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1caf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.706197:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1caf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.706204:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1caf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788835054.706222:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000063a656d reply state 00000000810eee66 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1caf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.706233:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1caf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.706251:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9afc835ce300) 00010000:00010000:0.0:1788835054.706254:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788835054.706258:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1788835054.706263:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788835054.706270:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d1ca1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.706277:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d1ca1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.706284:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d1ca1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.706290:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835054.706295:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d1ca1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.706303:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d1ca1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.706497:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc835ced00) 00010000:00010000:0.0:1788835054.706500:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835054.706504:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d1ca1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.706510:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d1ca1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788835054.706524:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000063a656d reply state 00000000810eee66 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ca8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.706532:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ca8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.706538:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9afc835cec00) 00010000:00010000:0.0:1788835054.706541:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788835054.706543:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:0.0:1788835054.706635:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa43100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+7:10464:x1875729242411136:12345-192.168.203.22@tcp:36:mkdir.0 Request processed in 3650us (3830us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788835054.706645:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:0.0:1788835054.718620:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835054.719236:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242411264 00000100:00100000:2.0:1788835054.719755:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242411264 00000100:00100000:2.0:1788835054.719822:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:2.0:1788835054.719832:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+7:10465:x1875729242411264:12345-192.168.203.22@tcp:101:chmod.0 00010000:00010000:2.0:1788835054.719854:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835054.719878:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62000/0xdf60171e5a5d1cb6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0475 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.719948:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1cbd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.719979:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1cbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.719991:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1cbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835054.720037:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788835054.720041:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788835054.720077:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1cbd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.720104:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62000/0xdf60171e5a5d1cb6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0475 expref: 9 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.720119:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1cbd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0475 expref: 8 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.720128:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc835c9600) 00010000:00010000:2.0:1788835054.720131:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788835054.720134:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e63a00, rc 0) 00000100:00100000:2.0:1788835054.720205:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+8:10465:x1875729242411264:12345-192.168.203.22@tcp:101:chmod.0 Request processed in 375us (1594us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835054.720212:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:3.0:1788835054.726651:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835054.726689:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242411520 00000100:00100000:3.0:1788835054.726698:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242411520 00000100:00100000:3.0:1788835054.726746:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:3.0:1788835054.726757:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+8:10465:x1875729242411520:12345-192.168.203.22@tcp:36:chmod.0 00010000:00010000:3.0:1788835054.726807:0:9806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835054.726835:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1cbd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0475 expref: 8 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835054.726852:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc835c9600) 00010000:00010000:3.0:1788835054.726863:0:9806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788835054.726887:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1cc4 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835054.726901:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1cc4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835054.726911:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1cc4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788835054.727117:0:9806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000086a5813f reply state 00000000036324dc transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1cc4 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835054.727131:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1cc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835054.727145:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc810b8300) 00010000:00010000:3.0:1788835054.727148:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788835054.727151:0:9806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1788835054.727160:0:9806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788835054.727238:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba369880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+9:10465:x1875729242411520:12345-192.168.203.22@tcp:36:chmod.0 Request processed in 482us (710us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1788835054.727247:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:0.0:1788835054.765753:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835054.765848:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242411648 00000100:00100000:3.0:1788835054.765857:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242411648 00000100:00100000:3.0:1788835054.765905:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:3.0:1788835054.765912:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+9:10466:x1875729242411648:12345-192.168.203.22@tcp:101:chown.0 00010000:00010000:3.0:1788835054.765931:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835054.765947:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1ccb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae047c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835054.765997:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d1cd2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835054.766017:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d1cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835054.766026:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d1cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835054.766060:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788835054.766062:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788835054.766088:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d1cd2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835054.766126:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1ccb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae047c expref: 11 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835054.766143:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d1cd2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae047c expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835054.766151:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc810b8300) 00010000:00010000:3.0:1788835054.766153:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788835054.766156:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374da00, rc 0) 00000100:00100000:3.0:1788835054.766224:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+10:10466:x1875729242411648:12345-192.168.203.22@tcp:101:chown.0 Request processed in 311us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835054.766232:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:0.0:1788835054.768259:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835054.768363:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242411776 00000100:00100000:2.0:1788835054.768381:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242411776 00000100:00100000:2.0:1788835054.768432:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:2.0:1788835054.768441:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+10:10466:x1875729242411776:12345-192.168.203.22@tcp:101:chown.0 00010000:00010000:2.0:1788835054.768459:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835054.768489:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62000/0xdf60171e5a5d1cd9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0483 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768549:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1ce0 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768562:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1ce0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768573:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1ce0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768583:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62e00/0xdf60171e5a5d1ce7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768590:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62e00/0xdf60171e5a5d1ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768597:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62e00/0xdf60171e5a5d1ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768668:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1cee lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768676:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1cee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768682:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1cee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835054.768719:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788835054.768722:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788835054.768745:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1cee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768764:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1ce0 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768770:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1ce0 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768777:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1ce0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768782:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e63a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835054.768786:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1ce0 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768793:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1ce0 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768804:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc810b8300) 00010000:00010000:2.0:1788835054.768807:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835054.768811:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1ce0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768817:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1ce0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768828:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62e00/0xdf60171e5a5d1ce7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768834:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62e00/0xdf60171e5a5d1ce7 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768839:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62e00/0xdf60171e5a5d1ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768849:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e62e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835054.768852:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62e00/0xdf60171e5a5d1ce7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768857:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62e00/0xdf60171e5a5d1ce7 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768864:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9afc835cec00) 00010000:00010000:2.0:1788835054.768866:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835054.768869:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62e00/0xdf60171e5a5d1ce7 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768874:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62e00/0xdf60171e5a5d1ce7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768901:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62000/0xdf60171e5a5d1cd9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0483 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768913:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1cee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0483 expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.768920:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9afc835ce300) 00010000:00010000:2.0:1788835054.768922:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788835054.768924:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e62a00, rc 0) 00000100:00100000:2.0:1788835054.768988:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+11:10466:x1875729242411776:12345-192.168.203.22@tcp:101:chown.0 Request processed in 547us (745us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835054.768995:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:1.0:1788835054.773763:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835054.773832:0:6499:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242411904 00000100:00100000:3.0:1788835054.773840:0:6499:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242411904 00000100:00100000:3.0:1788835054.773881:0:6499:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:3.0:1788835054.773889:0:6499:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b8987b33-76f7-43a0-9448-1013c4af787f+11:10466:x1875729242411904:12345-192.168.203.22@tcp:900:chown.0 00000100:00100000:3.0:1788835054.773969:0:6499:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:b8987b33-76f7-43a0-9448-1013c4af787f+11:10466:x1875729242411904:12345-192.168.203.22@tcp:900:chown.0 Request processed in 80us (214us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835054.773976:0:6499:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:1.0:1788835054.778769:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835054.778864:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242412160 00000100:00100000:2.0:1788835054.778888:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242412160 00000100:00100000:2.0:1788835054.779006:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:2.0:1788835054.779017:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+11:10466:x1875729242412160:12345-192.168.203.22@tcp:36:chown.0 00010000:00010000:2.0:1788835054.779069:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835054.779096:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1cee lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0483 expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.779177:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9afc835ce300) 00010000:00010000:2.0:1788835054.779184:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788835054.779208:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1cf5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.779221:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1cf5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.779231:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1cf5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788835054.792025:0:6467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967301 is committed 00010000:00010000:0.0:1788835054.792420:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ca8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.792436:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ca8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.792446:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ca8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.792471:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835054.792477:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ca8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.792487:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ca8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.792508:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9afc835cec00) 00010000:00010000:0.0:1788835054.792511:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835054.792516:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ca8 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.792522:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ca8 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.792547:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1caf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.792553:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1caf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.792558:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1caf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.792562:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835054.792565:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1caf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.792570:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1caf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.792589:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9afc835ce300) 00010000:00010000:0.0:1788835054.792591:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835054.792594:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1caf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.792600:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1caf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.792743:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1cc4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.792750:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1cc4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.792755:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1cc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.792760:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374cc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835054.792764:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1cc4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.792770:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1cc4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.792778:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc810b8300) 00010000:00010000:0.0:1788835054.792781:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788835054.792784:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1cc4 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.792789:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1cc4 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788835054.794414:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ea159186 reply state 00000000db6b9134 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1cf5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.794450:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1cf5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.794460:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9afc835ce300) 00010000:00010000:2.0:1788835054.794463:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788835054.794469:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788835054.794485:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00080000:2.0:1788835054.794627:0:6487:0:(ldlm_lib.c:3482:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1788835054.794650:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+7:10466:x1875729242412160:12345-192.168.203.22@tcp:36:chown.0 Request processed in 15629us (15885us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788835054.794680:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 28 00010000:00010000:0.0:1788835054.795448:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1cf5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.795462:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1cf5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.795470:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1cf5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.795477:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e63400 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835054.795483:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1cf5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.795492:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1cf5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.795508:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9afc835ce300) 00010000:00010000:0.0:1788835054.795511:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788835054.795516:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1cf5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.795523:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1cf5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835054.818846:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835054.818953:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242412288 00000100:00100000:0.0:1788835054.818963:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242412288 00000100:00100000:0.0:1788835054.819027:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:0.0:1788835054.819037:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+6:10467:x1875729242412288:12345-192.168.203.22@tcp:101:touch.500 00010000:00010000:0.0:1788835054.819070:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835054.819092:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1cfc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae048a expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788835054.824159:0:9047:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5003us 00010000:00010000:0.0:1788835054.835654:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d03 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.835678:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.835691:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.835707:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1d0a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.835714:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1d0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.835721:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1d0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.835829:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d1d11 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.835837:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d1d11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.835843:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d1d11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788835054.835870:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788835054.835873:0:9047:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788835054.835907:0:9047:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d1d11 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.835929:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d03 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.835936:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d03 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.835944:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.835950:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835054.835954:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d03 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.835961:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d03 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.835975:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc810b8300) 00010000:00010000:0.0:1788835054.835978:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835054.835983:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d03 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.835988:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d03 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.836000:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1d0a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.836006:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1d0a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.836012:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1d0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.836023:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835054.836026:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1d0a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.836032:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1d0a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.836040:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9afc835ce300) 00010000:00010000:0.0:1788835054.836043:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835054.836045:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1d0a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.836051:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1d0a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.836090:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1cfc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae048a expref: 8 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.836105:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d1d11 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae048a expref: 7 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.836113:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9afc835cec00) 00010000:00010000:0.0:1788835054.836115:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788835054.836117:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f4400, rc 0) 00000100:00100000:0.0:1788835054.836195:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+7:10467:x1875729242412288:12345-192.168.203.22@tcp:101:touch.500 Request processed in 17158us (17359us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835054.836203:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:3.0:1788835054.842422:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835054.842615:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242412544 00000100:00100000:0.0:1788835054.842641:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242412544 00000100:00100000:0.0:1788835054.842698:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:0.0:1788835054.842707:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+7:10467:x1875729242412544:12345-192.168.203.22@tcp:101:touch.500 00010000:00010000:0.0:1788835054.842726:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835054.842746:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1d18 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0491 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.842856:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1d1f lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.842871:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1d1f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.842883:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1d1f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.842898:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d26 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x942c7790 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.842905:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.842912:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788835054.843289:0:9806:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x2:0x0], index 1: 0 00010000:00010000:0.0:1788835054.843634:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1d2d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.843645:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1d2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.843665:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1d2d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.843701:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1d1f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.843709:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1d1f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.843716:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1d1f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.843722:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835054.843726:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1d1f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.843735:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1d1f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.843748:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9afc835cec00) 00010000:00010000:0.0:1788835054.843751:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835054.843756:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1d1f lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.843763:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1d1f lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788835054.843775:0:9806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a848bfaa reply state 000000005a3acd37 transno 4294967302 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d26 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.843785:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.843800:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x942c7790 (ffff9afc835ce300) 00010000:00010000:0.0:1788835054.843802:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788835054.843805:0:9806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1788835054.843839:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1d18 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0491 expref: 10 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.843855:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1d2d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0491 expref: 9 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.843862:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9afc835ced00) 00010000:00010000:0.0:1788835054.843865:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788835054.843867:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5a00, rc 0) 00000100:00100000:0.0:1788835054.843937:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+10:10467:x1875729242412544:12345-192.168.203.22@tcp:101:touch.500 Request processed in 1230us (1525us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1788835054.843944:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:3.0:1788835054.847229:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835054.847577:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242412800 00000100:00100000:2.0:1788835054.847589:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242412800 00000100:00100000:2.0:1788835054.847655:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:2.0:1788835054.847665:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+10:10467:x1875729242412800:12345-192.168.203.22@tcp:36:touch.500 00010000:00010000:2.0:1788835054.847722:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835054.847753:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1d2d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0491 expref: 10 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.847774:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9afc835ced00) 00010000:00010000:2.0:1788835054.847784:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788835054.847840:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1d3b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.847856:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1d3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.847867:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1d3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788835054.847967:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c1ede887 reply state 00000000c45ddc92 transno 4294967303 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1d3b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.847980:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1d3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.847987:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9afc835c9e00) 00010000:00010000:2.0:1788835054.847990:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788835054.847992:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788835054.848098:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba368380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+11:10467:x1875729242412800:12345-192.168.203.22@tcp:36:touch.500 Request processed in 433us (877us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1788835054.848105:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:1.0:1788835054.853797:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835054.853869:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242412928 00000100:00100000:0.0:1788835054.853879:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242412928 00000100:00100000:0.0:1788835054.853933:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:0.0:1788835054.853941:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+11:10467:x1875729242412928:12345-192.168.203.22@tcp:101:touch.500 00010000:00010000:0.0:1788835054.853963:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835054.853983:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1d42 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0498 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.854033:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1d42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0498 expref: 12 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.854046:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1d42 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0498 expref: 12 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835054.854079:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9afc835c9e00) 00010000:00010000:0.0:1788835054.854082:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788835054.854086:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f4e00, rc 0) 00000100:00100000:0.0:1788835054.854146:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+12:10467:x1875729242412928:12345-192.168.203.22@tcp:101:touch.500 Request processed in 204us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835054.854152:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:1.0:1788835054.857826:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835054.858021:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242413056 00000100:00100000:0.0:1788835054.858031:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242413056 00000100:00100000:0.0:1788835054.858105:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:0.0:1788835054.858113:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2384:x1875729242413056:12345-192.168.203.22@tcp:8:touch.500 00010000:00080000:0.0:1788835054.858150:0:8405:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp t0 exp 0000000000000000 cur 296 last 0 00000020:00000080:0.0:1788835054.858198:0:8405:0:(genops.c:1385:class_connect()) connect: client b8987b33-76f7-43a0-9448-1013c4af787f, cookie 0xdf60171e5a5d1d49 00002000:00100000:0.0:1788835054.858210:0:8405:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b8987b33-76f7-43a0-9448-1013c4af787f/ffff9afdbfa5b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1788835054.858228:0:8405:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1788835054.858586:0:8405:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1788835054.858614:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9afdbfa5a800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788835054.858680:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+6:2384:x1875729242413056:12345-192.168.203.22@tcp:8:touch.500 Request processed in 566us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835054.858687:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:1.0:1788835054.860751:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835054.860964:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242413184 00000100:00100000:2.0:1788835054.860973:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242413184 00000100:00100000:2.0:1788835054.861038:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:2.0:1788835054.861048:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+6:0:x1875729242413184:12345-192.168.203.22@tcp:2:touch.500 00000100:00080000:1.0:1788835054.861234:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:1.0:1788835054.873274:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00100000:1.0:1788835054.873289:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b8987b33-76f7-43a0-9448-1013c4af787f 00000100:00100000:2.0:1788835054.873514:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c21c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+5:0:x1875729242413184:12345-192.168.203.22@tcp:2:touch.500 Request processed in 12462us (12766us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788835054.873525:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:1.0:1788835054.876537:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835054.876639:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242413440 00000100:00100000:2.0:1788835054.876649:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242413440 00000100:00100000:2.0:1788835054.876713:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:2.0:1788835054.876723:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+12:10467:x1875729242413440:12345-192.168.203.22@tcp:35:touch.500 00000100:00100000:2.0:1788835054.877204:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+13:10467:x1875729242413440:12345-192.168.203.22@tcp:35:touch.500 Request processed in 481us (677us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788835054.877213:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:0.0:1788835054.885690:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254027008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788835054.885779:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835054.885861:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254027008 00000100:00100000:0.0:1788835054.885875:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254027008 00000100:00100000:0.0:1788835054.885928:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788835054.885955:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254027008:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788835054.885986:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835054.886032:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254027008:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (253us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835054.886039:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1788835054.886063:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788835054.886089:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36ed80 x1875729254027008/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835054.886107:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254027008:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788835054.890710:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254027136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788835054.890786:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835054.891016:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788835054.891026:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254027264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788835054.891054:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835054.896234:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254027264 00000100:00100000:2.0:1788835054.896253:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254027264 00000100:00100000:2.0:1788835054.896333:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788835054.896345:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8207bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254027264:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788835054.896391:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788835054.896465:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8207bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254027264:12345-0@lo:41:osp-pre-1-0.0 Request processed in 123us (5409us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835054.896471:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1788835054.898662:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729254027392:0@lo:400:kworker.0 00000100:00100000:0.0:1788835054.898737:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835054.898779:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875729254027904:0@lo:400:kworker.0 00000100:00100000:0.0:1788835054.898809:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835054.898840:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254028416:0@lo:400:kworker.0 00000100:00100000:0.0:1788835054.898870:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835054.898915:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254027264:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788835054.898940:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1788835054.898946:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254027776:0@lo:400:kworker.0 00000100:00100000:0.0:1788835054.898970:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835054.899007:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875729254028288:0@lo:400:kworker.0 00000100:00100000:0.0:1788835054.899029:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835054.899056:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254027520:0@lo:400:kworker.0 00000100:00100000:0.0:1788835054.899078:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835054.899095:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729254028032:0@lo:400:kworker.0 00000100:00100000:0.0:1788835054.899116:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835054.899138:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254028544:0@lo:400:kworker.0 00000100:00100000:0.0:1788835054.899159:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835054.899176:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788835054.899182:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254027648:0@lo:400:kworker.0 00000100:00100000:0.0:1788835054.899202:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835054.899220:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875729254028160:0@lo:400:kworker.0 00000100:00100000:0.0:1788835054.899238:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835054.899529:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254028416 00000100:00100000:0.0:1788835054.899536:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254028416 00000100:00100000:0.0:1788835054.899592:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254028544 00000100:00100000:0.0:1788835054.899595:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254028544 00000100:00100000:1.0:1788835054.899602:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254027392 00000100:00100000:1.0:1788835054.899609:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254027392 00000100:00100000:1.0:1788835054.899645:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788835054.899654:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3615:x1875729254027392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835054.899680:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788835054.899689:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254028416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835054.899726:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3615:x1875729254027392:12345-0@lo:400:kworker.0 Request processed in 72us (987us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835054.899734:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:2.0:1788835054.899782:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254027904 00000100:00100000:2.0:1788835054.899796:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254027904 00000100:00100000:2.0:1788835054.899819:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254027776 00000100:00100000:2.0:1788835054.899822:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254027776 00000100:00100000:2.0:1788835054.899831:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254028288 00000100:00100000:2.0:1788835054.899833:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254028288 00000100:00100000:2.0:1788835054.899842:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254027520 00000100:00100000:2.0:1788835054.899844:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254027520 00000100:00100000:2.0:1788835054.899854:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254028032 00000100:00100000:2.0:1788835054.899856:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254028032 00000100:00100000:2.0:1788835054.899866:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254028160 00000100:00100000:2.0:1788835054.899869:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254028160 00000100:00100000:2.0:1788835054.899881:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788835054.899888:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8207b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875729254027904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835054.900085:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254027136 00000100:00100000:3.0:1788835054.900089:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254027136 00000100:00100000:3.0:1788835054.900102:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1788835054.900109:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaaf3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254027776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835054.903219:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254028416:12345-0@lo:400:kworker.0 Request processed in 3522us (4338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835054.903234:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788835054.904844:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788835054.904865:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254028544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835054.904952:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83741500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254028544:12345-0@lo:400:kworker.0 Request processed in 97us (5791us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835054.904973:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788835054.905011:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254027648 00000100:00100000:0.0:1788835054.905017:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254027648 00000100:00100000:0.0:1788835054.905058:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1788835054.905064:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254027648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835054.905099:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83740380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254027648:12345-0@lo:400:kworker.0 Request processed in 35us (5896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835054.905104:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00080000:0.0:1788835054.905123:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788835054.905129:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788835054.905131:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788835054.905187:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254027648:0@lo:400:kworker.0 00010000:00080000:0.0:1788835054.905203:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb9308380 x1875729254028544/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835054.905213:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254028544:0@lo:400:kworker.0 00000100:00100000:0.0:1788835054.905244:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83c23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729254027392:0@lo:400:kworker.0 00010000:00080000:0.0:1788835054.905267:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb930aa00 x1875729254028416/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835054.905282:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254028416:0@lo:400:kworker.0 00000100:00100000:2.0:1788835054.907986:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8207b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875729254027904:12345-0@lo:400:kworker.0 Request processed in 8089us (9166us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835054.908000:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1788835054.908036:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788835054.908048:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaaf3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875729254028288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835054.908110:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaaf3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875729254028288:12345-0@lo:400:kworker.0 Request processed in 67us (9080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835054.908116:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1788835054.908128:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788835054.908135:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaaf3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254027520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835054.908179:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaaf3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254027520:12345-0@lo:400:kworker.0 Request processed in 45us (9100us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835054.908185:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 197 00000100:00100000:2.0:1788835054.908196:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788835054.908202:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729254028032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835054.908569:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254027520:0@lo:400:kworker.0 00000100:00100000:0.0:1788835054.908600:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1788835054.909171:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83743480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729254028032:12345-0@lo:400:kworker.0 Request processed in 967us (10051us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835054.909207:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875729254028160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835054.909253:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83742a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875729254028160:12345-0@lo:400:kworker.0 Request processed in 54us (10013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835054.910164:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1788835054.910223:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875729254028160:0@lo:400:kworker.0 00010000:00080000:2.0:1788835054.910333:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb930a300 x1875729254028032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835054.910348:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729254028032:0@lo:400:kworker.0 00000100:00100000:2.0:1788835054.912774:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1788835054.912785:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254027136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788835054.912810:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788835054.912882:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254027136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (22096us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835054.912889:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788835054.913305:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00080000:0.0:1788835054.913432:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788835054.913535:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36aa00 x1875729254027136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835070 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835054.913556:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254027136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788835054.914880:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaaf3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254027776:12345-0@lo:400:kworker.0 Request processed in 14766us (15903us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835054.914998:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:1.0:1788835054.916249:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835054.916501:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242413568 00000100:00100000:2.0:1788835054.916510:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242413568 00000100:00100000:2.0:1788835054.916558:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:2.0:1788835054.916567:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb930b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+13:10468:x1875729242413568:12345-192.168.203.22@tcp:101:rm.0 00010000:00010000:2.0:1788835054.916600:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835054.916623:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62000/0xdf60171e5a5d1d50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae049f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.916690:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62e00/0xdf60171e5a5d1d57 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.916704:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62e00/0xdf60171e5a5d1d57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.916729:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62e00/0xdf60171e5a5d1d57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835054.916775:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788835054.916779:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788835054.916818:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62e00/0xdf60171e5a5d1d57 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.916844:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62000/0xdf60171e5a5d1d50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae049f expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.916862:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62e00/0xdf60171e5a5d1d57 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae049f expref: 14 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.916871:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9afc835cec00) 00010000:00010000:2.0:1788835054.916874:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788835054.916878:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e62e00, rc 0) 00000100:00100000:2.0:1788835054.916931:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb930b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+14:10468:x1875729242413568:12345-192.168.203.22@tcp:101:rm.0 Request processed in 364us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835054.916938:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:0.0:1788835054.921074:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254027776:0@lo:400:kworker.0 00010000:00080000:0.0:1788835054.921095:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb9308000 x1875729254028288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835070 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835054.921106:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9308000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875729254028288:0@lo:400:kworker.0 00000100:00100000:0.0:1788835054.921118:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875729254027904:0@lo:400:kworker.0 00000100:00100000:1.0:1788835054.921907:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835054.921982:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242413824 00000100:00100000:2.0:1788835054.921989:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242413824 00000100:00100000:2.0:1788835054.922121:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:2.0:1788835054.922131:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb930a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+14:10468:x1875729242413824:12345-192.168.203.22@tcp:101:rm.0 00010000:00010000:2.0:1788835054.922150:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835054.922170:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1d5e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae04a6 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835054.922636:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788835054.922746:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1d5e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04a6 expref: 16 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.922761:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc810b8300) 00010000:00010000:2.0:1788835054.922764:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788835054.922768:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1d5e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04a6 expref: 16 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835054.922780:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e63a00, rc 0) 00000100:00100000:2.0:1788835054.922838:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb930a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+15:10468:x1875729242413824:12345-192.168.203.22@tcp:101:rm.0 Request processed in 709us (935us total) trans 4294967305 rc 301/301 00000100:00100000:2.0:1788835054.922854:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:1.0:1788835054.932265:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835054.932444:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242413952 00000100:00100000:0.0:1788835054.932454:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242413952 00000100:00100000:0.0:1788835054.932520:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:0.0:1788835054.932531:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb930bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+15:10468:x1875729242413952:12345-192.168.203.22@tcp:37:rm.0 00000100:00100000:0.0:1788835054.946717:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb930bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+15:10468:x1875729242413952:12345-192.168.203.22@tcp:37:rm.0 Request processed in 14179us (14452us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835054.946729:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:1.0:1788835054.961254:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835054.961363:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242414208 00000100:00100000:2.0:1788835054.961383:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242414208 00000100:00100000:2.0:1788835054.961507:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:2.0:1788835054.961518:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84e65c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+15:10468:x1875729242414208:12345-192.168.203.22@tcp:35:rm.0 00000100:00100000:2.0:1788835054.962605:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84e65c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+16:10468:x1875729242414208:12345-192.168.203.22@tcp:35:rm.0 Request processed in 1083us (1354us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1788835054.962615:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:1.0:1788835054.984285:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835054.984586:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242414464 00000100:00100000:3.0:1788835054.984599:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242414464 00000100:00100000:3.0:1788835054.984672:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:3.0:1788835054.984684:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+16:10468:x1875729242414464:12345-192.168.203.22@tcp:101:rm.0 00010000:00010000:3.0:1788835054.984715:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835054.984743:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1d6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae04ad expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835054.984901:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d1d73 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835054.984919:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d1d73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835054.984936:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d1d73 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835054.984950:0:9806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:3.0:1788835054.985240:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1d6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04ad expref: 19 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835054.985263:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d1d73 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04ad expref: 18 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835054.985274:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9afc835cec00) 00010000:00010000:3.0:1788835054.985277:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788835054.985298:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374d200, rc 0) 00000100:00100000:3.0:1788835054.985956:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9308700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+18:10468:x1875729242414464:12345-192.168.203.22@tcp:101:rm.0 Request processed in 1269us (1681us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1788835054.985968:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:0.0:1788835054.992050:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835054.992521:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242414592 00000100:00100000:1.0:1788835054.992532:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242414592 00000100:00100000:1.0:1788835054.992599:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:1.0:1788835054.992609:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+18:10468:x1875729242414592:12345-192.168.203.22@tcp:41:rm.0 00000004:00000024:1.0:1788835054.992666:0:6488:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 7847059456 avail 7384014848 00000100:00100000:1.0:1788835054.992751:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83741c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+18:10468:x1875729242414592:12345-192.168.203.22@tcp:41:rm.0 Request processed in 139us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835054.992759:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:1.0:1788835055.004646:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835055.004754:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242414720 00000100:00100000:2.0:1788835055.004763:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242414720 00000100:00100000:2.0:1788835055.004838:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:2.0:1788835055.004849:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+18:10468:x1875729242414720:12345-192.168.203.22@tcp:101:rm.0 00010000:00010000:2.0:1788835055.004868:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835055.004905:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62000/0xdf60171e5a5d1d81 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae04b4 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.004966:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1d88 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.004981:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1d88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.004992:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1d88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005003:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63e00/0xdf60171e5a5d1d8f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x1:0x0].0x942c7790 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005010:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63e00/0xdf60171e5a5d1d8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005016:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63e00/0xdf60171e5a5d1d8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005098:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1d96 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005107:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1d96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005114:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1d96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835055.005159:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788835055.005164:0:9047:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788835055.005181:0:9047:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1d96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005199:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1d96 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005207:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1d88 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005213:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1d88 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005219:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1d88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005225:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e63200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835055.005229:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1d88 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005237:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1d88 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005248:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9afc835cec00) 00010000:00010000:2.0:1788835055.005251:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835055.005255:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1d88 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005261:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1d88 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005274:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63e00/0xdf60171e5a5d1d8f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005280:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63e00/0xdf60171e5a5d1d8f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005291:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63e00/0xdf60171e5a5d1d8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005295:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e63e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835055.005298:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63e00/0xdf60171e5a5d1d8f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005303:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63e00/0xdf60171e5a5d1d8f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005311:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x942c7790 (ffff9afc835ce300) 00010000:00010000:2.0:1788835055.005387:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835055.005392:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63e00/0xdf60171e5a5d1d8f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005398:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63e00/0xdf60171e5a5d1d8f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005425:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62000/0xdf60171e5a5d1d81 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04b4 expref: 20 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005438:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1d96 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04b4 expref: 19 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.005449:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9afc835c9e00) 00010000:00010000:2.0:1788835055.005451:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788835055.005453:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e63a00, rc 0) 00000100:00100000:2.0:1788835055.005520:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9309c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+19:10468:x1875729242414720:12345-192.168.203.22@tcp:101:rm.0 Request processed in 673us (883us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835055.005536:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00080000:0.0:1788835055.005682:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788835055.008183:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835055.009186:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242414976 00000100:00100000:3.0:1788835055.009202:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242414976 00000100:00100000:3.0:1788835055.009288:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:3.0:1788835055.009299:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+19:10468:x1875729242414976:12345-192.168.203.22@tcp:36:rm.0 00010000:00010000:3.0:1788835055.009404:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788835055.009439:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1d96 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04b4 expref: 19 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835055.009878:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1d42 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0498 expref: 18 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835055.009896:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9afc835c9e00) 00010000:00010000:3.0:1788835055.009908:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62e00/0xdf60171e5a5d1d57 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae049f expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835055.009917:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9afc835cec00) 00010000:00010000:3.0:1788835055.009920:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788835055.009947:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1d9d lrc: 3/0,1 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835055.009962:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1d9d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835055.009974:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1d9d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835055.010011:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1da4 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x1:0x0].0x942c7790 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835055.010020:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1da4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835055.010026:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1da4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835055.010267:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d1dab lrc: 3/0,1 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835055.010277:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d1dab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835055.010285:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d1dab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788835055.013217:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1788835055.022724:0:6489:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 297064404245ns, next at 298064393860ns, rc = 0 00010000:00010000:2.0:1788835055.022875:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1db2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.022900:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1db2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.022914:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1db2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.022925:0:6489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1db2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.022932:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1db2 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.022939:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1db2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.022966:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788835055.022995:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d1dab lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.023002:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d1dab lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.023009:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d1dab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.023016:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80030a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835055.023178:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d1dab lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.023188:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d1dab lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.023203:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9afc835c9e00) 00010000:00010000:2.0:1788835055.023206:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788835055.023211:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d1dab lrc: 2/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.023218:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d1dab lrc: 0/0,0 mode: --/EX res: [0x200000402:0x2:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.023243:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1d9d lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.023249:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1d9d lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.023256:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1d9d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.023262:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374c000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835055.023264:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1d9d lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.023271:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1d9d lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.023279:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9afc835cec00) 00010000:00010000:2.0:1788835055.023282:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835055.023292:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1d9d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.023299:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1d9d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788835055.023310:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000021268541 reply state 0000000092ea0bee transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1da4 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.023354:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1da4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835055.023361:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x942c7790 (ffff9afc835ce300) 00010000:00010000:2.0:1788835055.023374:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788835055.023377:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788835055.023700:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788835055.023709:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1db2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835055.023716:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e63200 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:3.0:1788835055.023720:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1db2 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835055.023727:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1db2 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835055.023738:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9afc835c9e00) 00010000:00010000:3.0:1788835055.023757:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788835055.023762:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1db2 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835055.023768:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1db2 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835055.023782:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835055.023784:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835055.023786:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835055.023922:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+18:10468:x1875729242414976:12345-192.168.203.22@tcp:36:rm.0 Request processed in 14617us (15742us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1788835055.023932:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:3.0:1788835055.031891:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835055.032044:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242415232 00000100:00100000:0.0:1788835055.032056:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242415232 00000100:00100000:0.0:1788835055.032121:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:0.0:1788835055.032131:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+18:10468:x1875729242415232:12345-192.168.203.22@tcp:35:rm.0 00000100:00100000:0.0:1788835055.032681:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba368a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+19:10468:x1875729242415232:12345-192.168.203.22@tcp:35:rm.0 Request processed in 548us (802us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1788835055.032691:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:3.0:1788835055.036600:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835055.037120:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242415488 00000100:00100000:0.0:1788835055.037135:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242415488 00000100:00100000:0.0:1788835055.037221:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:0.0:1788835055.037235:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+19:10468:x1875729242415488:12345-192.168.203.22@tcp:36:rm.0 00010000:00010000:0.0:1788835055.037349:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1788835055.037400:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d1d73 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04ad expref: 19 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.037431:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d1d11 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae048a expref: 18 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.037446:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9afc835cec00) 00010000:00010000:0.0:1788835055.037481:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d1cd2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae047c expref: 17 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.037491:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc810b8300) 00010000:00010000:0.0:1788835055.037499:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788835055.037539:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d1db9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.037556:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d1db9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.037569:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d1db9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.037605:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1dc0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.037614:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1dc0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.037621:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1dc0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.037726:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1dc7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.037735:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1dc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.037741:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1dc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788835055.038065:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x1:0x0]: returning size 4096 00010000:00010000:0.0:1788835055.038085:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1dc7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.038093:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1dc7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.038100:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1dc7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.038107:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835055.038112:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1dc7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.038133:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1dc7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.038145:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x0 (ffff9afc835ce200) 00010000:00010000:0.0:1788835055.038148:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1788835055.038152:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1dc7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.038158:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1dc7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.038180:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d1db9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.038187:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d1db9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.038192:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d1db9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.038197:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5400 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835055.038200:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d1db9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.038206:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d1db9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.038213:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc835cee00) 00010000:00010000:0.0:1788835055.038215:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835055.038218:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d1db9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.038235:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d1db9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788835055.038251:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c304efe2 reply state 00000000f7ebeba4 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1dc0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.038263:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1dc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835055.038269:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9afc835ce000) 00010000:00010000:0.0:1788835055.038271:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788835055.038274:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788835055.038422:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba368000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+18:10468:x1875729242415488:12345-192.168.203.22@tcp:36:rm.0 Request processed in 1189us (1835us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1788835055.038430:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00010000:00010000:0.0:1788835055.078355:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835055.397931:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254028672:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788835055.397966:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788835055.397985:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254028800:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788835055.398032:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835055.398122:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254028672 00000100:00100000:0.0:1788835055.398132:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254028672 00000100:00100000:0.0:1788835055.398451:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788835055.398462:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254028672:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788835055.398491:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788835055.404417:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835055.406358:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254028800 00000100:00100000:1.0:1788835055.406386:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254028800 00000100:00100000:1.0:1788835055.406480:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1788835055.406493:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254028800:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788835055.406529:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835055.406641:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254028800:12345-0@lo:13:osp-pre-1-0.0 Request processed in 150us (2234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835055.406648:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00080000:2.0:1788835055.407166:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83cd1500 x1875729254028800/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835055.407194:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83cd1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254028800:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788835055.407791:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9309f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254028672:12345-0@lo:13:osp-pre-1-1.0 Request processed in 9327us (9755us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835055.407802:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00010000:00080000:1.0:1788835055.407918:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83741880 x1875729254028672/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835055.407937:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83741880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254028672:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788835056.103804:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835056.421845:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788835056.421868:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254028928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788835056.421935:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835056.425080:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254028928 00000100:00100000:2.0:1788835056.425093:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254028928 00000100:00100000:2.0:1788835056.425153:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788835056.425163:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254028928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788835056.425210:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788835056.425290:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83741880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254028928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 128us (3353us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835056.425297:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788835056.425390:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254028928:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788835057.133538:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835058.152692:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835058.788999:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835058.789060:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835058.789119:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835058.789142:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242415616 00000100:00100000:1.0:1788835058.789150:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835058.789159:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242415616 00000100:00100000:1.0:1788835058.789180:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835058.789231:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 335 00000100:00100000:2.0:1788835058.789242:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:2387:x1875729242415616:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835058.789284:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835058.789334:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242415872 00000100:00100000:1.0:1788835058.789349:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242415872 00000100:00100000:0.0:1788835058.789389:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242416128 00000100:00100000:0.0:1788835058.789396:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242416128 00000100:00100000:1.0:1788835058.789406:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242415744 00000100:00100000:1.0:1788835058.789411:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242415744 00000100:00100000:0.0:1788835058.789432:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242416256 00000100:00100000:0.0:1788835058.789437:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242416256 00000100:00100000:1.0:1788835058.789441:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 200 00000100:00100000:1.0:1788835058.789452:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2387:x1875729242415872:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835058.789464:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 201 00000100:00100000:0.0:1788835058.789474:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb930bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2387:x1875729242416128:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835058.789532:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9309180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2387:x1875729242415872:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 80us (470us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835058.789541:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 200 00000100:00100000:1.0:1788835058.789940:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 202 00000100:00100000:1.0:1788835058.789951:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb930b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+18:2387:x1875729242415744:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835058.791009:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb930bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2387:x1875729242416128:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 1527us (1880us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835058.791080:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 201 00000100:00100000:0.0:1788835058.791119:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 203 00000100:00100000:0.0:1788835058.791131:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb930ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2387:x1875729242416256:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835058.791175:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb930ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2387:x1875729242416256:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 48us (1892us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835058.791182:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 203 00000100:00100000:2.0:1788835058.791275:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:2387:x1875729242415616:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 2033us (2292us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835058.791629:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242416000 00000100:00100000:0.0:1788835058.791638:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242416000 00000100:00100000:0.0:1788835058.791689:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:0.0:1788835058.791697:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2387:x1875729242416000:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835058.791731:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2387:x1875729242416000:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 36us (2551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835058.791738:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:2.0:1788835058.791897:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 335 00000100:00080000:2.0:1788835058.792576:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788835058.792584:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788835058.792588:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788835058.795424:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb930b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+18:2387:x1875729242415744:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 5457us (6256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835058.795445:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 202 00000001:02000400:0.0:1788835059.084592:0:13653:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1788835059.177765:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835060.005961:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254029056:0@lo:400:kworker.0 00000100:00100000:3.0:1788835060.006037:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835060.006085:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254029568:0@lo:400:kworker.0 00000100:00100000:3.0:1788835060.006113:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835060.006133:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e810000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254030080:0@lo:400:kworker.0 00000100:00100000:3.0:1788835060.006156:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835060.006174:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254030592:0@lo:400:kworker.0 00000100:00100000:3.0:1788835060.006195:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835060.006217:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788835060.006223:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254029184:0@lo:400:kworker.0 00000100:00100000:3.0:1788835060.006246:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835060.006261:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729254029696:0@lo:400:kworker.0 00000100:00100000:3.0:1788835060.006291:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835060.006306:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875729254030208:0@lo:400:kworker.0 00000100:00100000:3.0:1788835060.006372:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835060.006405:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254029568 00000100:00100000:3.0:1788835060.006412:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254029568 00000100:00100000:3.0:1788835060.006457:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788835060.006466:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254029568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835060.006519:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254029568:12345-0@lo:400:kworker.0 Request processed in 55us (405us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835060.006527:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788835060.006549:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254029184 00000100:00100000:3.0:1788835060.006553:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254029184 00000100:00100000:3.0:1788835060.006673:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254029696 00000100:00100000:3.0:1788835060.006677:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254029696 00000100:00100000:3.0:1788835060.006709:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254030208 00000100:00100000:3.0:1788835060.006711:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254030208 00000100:00100000:3.0:1788835060.006726:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788835060.006792:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254029184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835060.006828:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254029184:12345-0@lo:400:kworker.0 Request processed in 96us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835060.006834:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:3.0:1788835060.006846:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 205 00000100:00100000:1.0:1788835060.007070:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254029312:0@lo:400:kworker.0 00000100:00100000:1.0:1788835060.007102:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835060.007125:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254029824:0@lo:400:kworker.0 00000100:00100000:1.0:1788835060.007145:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835060.007157:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729254030336:0@lo:400:kworker.0 00000100:00100000:1.0:1788835060.007176:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835060.007191:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788835060.007206:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254029440:0@lo:400:kworker.0 00000100:00100000:1.0:1788835060.007232:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835060.007244:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254029952:0@lo:400:kworker.0 00000100:00100000:1.0:1788835060.007264:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835060.007278:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254030464:0@lo:400:kworker.0 00000100:00100000:1.0:1788835060.007298:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835060.007355:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254029824 00000100:00100000:1.0:1788835060.007359:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254029824 00000100:00100000:1.0:1788835060.007381:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254030336 00000100:00100000:1.0:1788835060.007384:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254030336 00000100:00100000:1.0:1788835060.007395:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254029440 00000100:00100000:1.0:1788835060.007397:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254029440 00000100:00100000:1.0:1788835060.007408:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788835060.007414:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875729254030208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835060.007449:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875729254030208:12345-0@lo:400:kworker.0 Request processed in 35us (1077us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835060.007455:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1788835060.007468:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788835060.007474:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254029824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835060.007506:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e813480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254029824:12345-0@lo:400:kworker.0 Request processed in 31us (359us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835060.007511:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 207 00000100:00100000:1.0:1788835060.007537:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:1.0:1788835060.007544:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729254030336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835060.007569:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e813800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729254030336:12345-0@lo:400:kworker.0 Request processed in 27us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835060.007684:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729254029696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835060.007715:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729254029696:12345-0@lo:400:kworker.0 Request processed in 864us (1423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835060.007721:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 205 00000100:00100000:3.0:1788835060.007917:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788835060.007925:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254029440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835060.007953:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254029440:12345-0@lo:400:kworker.0 Request processed in 30us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835060.007967:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 209 00000100:00100000:3.0:1788835060.007999:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254029312 00000100:00100000:3.0:1788835060.008003:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254029312 00000100:00100000:3.0:1788835060.008026:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788835060.008031:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254029312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835060.008060:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e811880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254029312:12345-0@lo:400:kworker.0 Request processed in 29us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835060.008065:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1788835060.008079:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788835060.008083:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788835060.008113:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254029184:0@lo:400:kworker.0 00000100:00100000:3.0:1788835060.008124:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e810700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729254029696:0@lo:400:kworker.0 00000100:00100000:3.0:1788835060.008132:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e812a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875729254030208:0@lo:400:kworker.0 00000100:00100000:3.0:1788835060.008143:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254029568:0@lo:400:kworker.0 00000100:00100000:0.0:1788835060.008474:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254029056 00000100:00100000:0.0:1788835060.008479:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254029056 00000100:00100000:0.0:1788835060.008510:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788835060.008517:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254029056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835060.008587:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254029056:12345-0@lo:400:kworker.0 Request processed in 52us (2531us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835060.008594:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00100000:0.0:1788835060.008624:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254030080 00000100:00100000:0.0:1788835060.008628:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254030080 00000100:00100000:0.0:1788835060.008655:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254030592 00000100:00100000:0.0:1788835060.008659:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254030592 00000100:00100000:0.0:1788835060.008671:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254029952 00000100:00100000:0.0:1788835060.008673:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254029952 00000100:00100000:0.0:1788835060.008684:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254030464 00000100:00100000:0.0:1788835060.008686:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254030464 00000100:00100000:0.0:1788835060.008700:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788835060.008706:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254030080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835060.008746:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba369f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254030080:12345-0@lo:400:kworker.0 Request processed in 40us (2589us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835060.008752:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1788835060.008763:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788835060.008769:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254030592:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835060.008793:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254030592:12345-0@lo:400:kworker.0 Request processed in 25us (2598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835060.008799:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788835060.008810:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788835060.008816:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254029952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835060.008841:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254029952:12345-0@lo:400:kworker.0 Request processed in 25us (1576us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835060.008847:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788835060.009083:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788835060.009097:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254030464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835060.009130:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254030464:12345-0@lo:400:kworker.0 Request processed in 35us (1831us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835060.009135:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788835060.009232:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254030720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788835060.009263:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1788835060.009295:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788835060.009298:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788835060.009307:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254030720 00000100:00100000:0.0:1788835060.009310:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254030720 00000100:00100000:0.0:1788835060.009362:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788835060.009369:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254030720:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788835060.009391:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788835060.009426:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254030720:12345-0@lo:41:osp-pre-1-0.0 Request processed in 57us (162us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835060.009432:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1788835060.009461:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83c20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254030720:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788835060.009492:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254029056:0@lo:400:kworker.0 00010000:00080000:0.0:1788835060.009507:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afd9e810000 x1875729254030080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835060.009518:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e810000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254030080:0@lo:400:kworker.0 00010000:00080000:0.0:1788835060.009529:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afd9e811180 x1875729254030592/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835060.009537:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e811180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254030592:0@lo:400:kworker.0 00000100:00100000:2.0:1788835060.010534:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254030848:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788835060.010921:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835060.010973:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254029440:0@lo:400:kworker.0 00010000:00080000:2.0:1788835060.010986:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afd9e811f80 x1875729254029952/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835060.010994:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e811f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254029952:0@lo:400:kworker.0 00010000:00080000:2.0:1788835060.011005:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afd9e813100 x1875729254030464/t0(0) o400->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835060.011013:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e813100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254030464:0@lo:400:kworker.0 00000100:00100000:2.0:1788835060.011040:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254029312:0@lo:400:kworker.0 00010000:00080000:2.0:1788835060.011051:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afd9e811c00 x1875729254029824/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835060.011059:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e811c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254029824:0@lo:400:kworker.0 00010000:00080000:2.0:1788835060.011069:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afd9e810a80 x1875729254030336/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835060.011077:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729254030336:0@lo:400:kworker.0 00000100:00100000:2.0:1788835060.011125:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788835060.011132:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254030976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788835060.011160:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835060.011239:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:3.0:1788835060.011377:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254030848 00000100:00100000:3.0:1788835060.011383:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254030848 00000100:00100000:3.0:1788835060.011425:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254030976 00000100:00100000:3.0:1788835060.011428:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254030976 00000100:00100000:3.0:1788835060.011444:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788835060.011451:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254030848:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788835060.011478:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788835060.011524:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254030848:12345-0@lo:13:osp-pre-0-1.0 Request processed in 72us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835060.011530:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1788835060.011543:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788835060.011556:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254030976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788835060.011567:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00010000:00080000:1.0:1788835060.011931:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83c22d80 x1875729254030848/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835060.011946:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83c22d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254030848:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835060.016241:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa42680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254030976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4676us (5070us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835060.016255:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00010000:00080000:2.0:1788835060.016507:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc82075f80 x1875729254030976/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835060.016533:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254030976:0@lo:13:osp-pre-0-0.0 00000020:00000080:3.0:1788835060.193897:0:13701:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde4c9cdf0 20000000:00000080:3.0:1788835060.193915:0:13701:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9afc835a2800 uarg=0000000000000000 20000000:01000000:3.0:1788835060.193957:0:13701:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788835060.193964:0:13701:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1788835060.193969:0:13701:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:1.0:1788835060.194828:0:13702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:3.0:1788835060.195132:0:13701:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1788835060.204199:0:13701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1788835060.205581:0:13701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1788835060.205622:0:13701:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1788835060.205966:0:13701:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1788835060.205987:0:13701:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1dce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835060.206006:0:13701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdb2e63000/0xdf60171e5a5d1c5b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0467 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835060.206014:0:13701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdb2e62c00/0xdf60171e5a5d1c62 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae046e expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835060.206022:0:13701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afc8374dc00/0xdf60171e5a5d1c70 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1c69 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835060.206029:0:13701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afc8374d000/0xdf60171e5a5d1c7e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1c77 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835060.206036:0:13701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1c8c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1c85 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835060.206059:0:13701:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afc8374ce00/0xdf60171e5a5d1c9a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1c93 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835060.206067:0:13701:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1dce lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835060.206105:0:13701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afc8374ce00/0xdf60171e5a5d1c9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1c93 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835060.206121:0:13701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afc8374ce00/0xdf60171e5a5d1c9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1c93 expref: 23 pid: 6482 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835060.206134:0:13701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82077480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13701:1875729254031104:0@lo:104: 00000100:00100000:3.0:1788835060.206202:0:13701:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788835060.206260:0:13701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1c8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1c85 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835060.206269:0:13701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1c8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1c85 expref: 23 pid: 6482 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835060.206278:0:13701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82077800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13701:1875729254031232:0@lo:104: 00010000:00010000:3.0:1788835060.206412:0:13701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afc8374d000/0xdf60171e5a5d1c7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1c77 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835060.206421:0:13701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afc8374d000/0xdf60171e5a5d1c7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1c77 expref: 23 pid: 6482 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835060.206430:0:13701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82076680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13701:1875729254031360:0@lo:104: 00010000:00010000:3.0:1788835060.206453:0:13701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afc8374dc00/0xdf60171e5a5d1c70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d1c69 expref: 23 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835060.206468:0:13701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9afc8374dc00/0xdf60171e5a5d1c70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d1c69 expref: 23 pid: 6482 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835060.206478:0:13701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82075c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13701:1875729254031488:0@lo:104: 00010000:00010000:3.0:1788835060.206521:0:13701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdb2e62c00/0xdf60171e5a5d1c62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae046e expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835060.206532:0:13701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afdb2e62c00/0xdf60171e5a5d1c62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae046e expref: 12 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835060.206541:0:13701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82075f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13701:1875729254031616:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788835060.206596:0:13701:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdb2e63000/0xdf60171e5a5d1c5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0467 expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835060.206604:0:13701:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afdb2e63000/0xdf60171e5a5d1c5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0467 expref: 12 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835060.206612:0:13701:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e810a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13701:1875729254031744:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788835060.206770:0:13701:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eac240 going to sleep for 11 seconds 00010000:00010000:0.0:1788835060.206863:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835060.207285:0:6472:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1788835060.207310:0:6472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835060.207396:0:6472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835060.207413:0:6472:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835060.207423:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254031104 00000100:00100000:0.0:1788835060.207429:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254031104 00000100:00100000:0.0:1788835060.207465:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254031232 00000100:00100000:0.0:1788835060.207468:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254031232 00000100:00100000:0.0:1788835060.207477:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254031360 00000100:00100000:0.0:1788835060.207479:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254031360 00000100:00100000:0.0:1788835060.207486:0:6472:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254031488 00000100:00100000:0.0:1788835060.207488:0:6472:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254031488 00000100:00100000:0.0:1788835060.207500:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788835060.207509:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba2fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+6:13701:x1875729254031104:12345-0@lo:104: 00010000:00010000:0.0:1788835060.207521:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1c93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1c9a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.207578:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788835060.207584:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba2fdc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+6:13701:x1875729254031104:12345-0@lo:104: Request processed in 77us (1383us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835060.207590:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788835060.207771:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788835060.207780:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+5:13701:x1875729254031232:12345-0@lo:104: 00010000:00010000:0.0:1788835060.207788:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d1c85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1c8c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.207828:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1788835060.207834:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c20e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+5:13701:x1875729254031232:12345-0@lo:104: Request processed in 56us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835060.207847:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1788835060.207860:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788835060.207866:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:13701:x1875729254031360:12345-0@lo:104: 00010000:00010000:0.0:1788835060.207874:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1c77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1c7e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.207907:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1788835060.207913:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c22d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+4:13701:x1875729254031360:12345-0@lo:104: Request processed in 47us (517us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835060.207919:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1788835060.207929:0:6472:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788835060.207934:0:6472:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:13701:x1875729254031488:12345-0@lo:104: 00010000:00010000:0.0:1788835060.207941:0:6472:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1c69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1c70 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.207967:0:6472:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1788835060.207973:0:6472:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9bb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+3:13701:x1875729254031488:12345-0@lo:104: Request processed in 39us (559us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835060.207978:0:6472:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00010000:0.0:1788835060.208198:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788835060.208204:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1c93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1c9a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.208213:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e62200 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:0.0:1788835060.208217:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1c93 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1c9a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.208237:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1c93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1c9a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788835060.208245:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1c93 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1c9a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788835060.208251:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788835060.208839:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1c93 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1c9a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.208851:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788835060.208873:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1c93 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1c9a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.208881:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1c93 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1c9a expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.208894:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788835060.208898:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d1c85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1c8c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.208903:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d600 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:0.0:1788835060.208906:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d1c85 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1c8c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.208912:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d1c85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1c8c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788835060.208918:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d1c85 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1c8c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788835060.208933:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788835060.208957:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d1c85 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1c8c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.208964:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788835060.208970:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d1c85 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1c8c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.208977:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d1c85 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1c8c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.208986:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788835060.208989:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1c77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1c7e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.208994:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e62400 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:0.0:1788835060.208997:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1c77 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1c7e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.209003:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1c77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1c7e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788835060.209009:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1c77 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1c7e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788835060.209014:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788835060.209026:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1c77 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1c7e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.209032:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788835060.209055:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1c77 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1c7e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.209061:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1c77 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1c7e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.209070:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835060.209073:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1c69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d1c70 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.209079:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5600 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:0.0:1788835060.209082:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1c69 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d1c70 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.209088:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1c69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d1c70 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788835060.209094:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1c69 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d1c70 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788835060.209099:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1788835060.209111:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1c69 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1c70 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.209116:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788835060.209122:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1c69 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1c70 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.209128:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd866f5600/0xdf60171e5a5d1c69 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d1c70 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.209142:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835060.209149:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835060.209151:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835060.209159:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835060.209174:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254031872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788835060.209225:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835060.209265:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788835060.209270:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254032000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788835060.209452:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835060.209563:0:13701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82077480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13701:1875729254031104:0@lo:104: 00000100:00100000:3.0:1788835060.209574:0:13701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82077800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13701:1875729254031232:0@lo:104: 00000100:00100000:3.0:1788835060.209582:0:13701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82076680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13701:1875729254031360:0@lo:104: 00000100:00100000:3.0:1788835060.209590:0:13701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82075c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13701:1875729254031488:0@lo:104: 00000100:00100000:2.0:1788835060.210543:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729254032128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788835060.210590:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835060.210956:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729254032256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788835060.210989:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835060.211030:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254031872 00000100:00100000:0.0:1788835060.211037:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254031872 00010000:00010000:0.0:1788835060.211067:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afc8374ce00/0xdf60171e5a5d1c9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1c93 expref: 24 pid: 6482 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835060.211092:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254032000 00000100:00100000:0.0:1788835060.211096:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254032000 00010000:00010000:0.0:1788835060.211107:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1c8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1c85 expref: 25 pid: 6482 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835060.211118:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254032128 00000100:00100000:0.0:1788835060.211120:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254032128 00010000:00010000:0.0:1788835060.211131:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afc8374d000/0xdf60171e5a5d1c7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1c77 expref: 26 pid: 6482 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835060.211141:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254032256 00000100:00100000:0.0:1788835060.211144:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254032256 00010000:00010000:0.0:1788835060.211177:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afc8374dc00/0xdf60171e5a5d1c70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1c69 expref: 27 pid: 6482 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835060.211192:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788835060.211208:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+27:3616:x1875729254031872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788835060.211223:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835060.211229:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afc8374ce00/0xdf60171e5a5d1c9a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1c93 expref: 27 pid: 6482 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.211242:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afc8374ce00/0xdf60171e5a5d1c9a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1c93 expref: 27 pid: 6482 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.211260:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afc8374ce00/0xdf60171e5a5d1c9a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1c93 expref: 27 pid: 6482 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.211275:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835060.211346:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+26:3616:x1875729254031872:12345-0@lo:103:ldlm_bl.0 Request processed in 139us (2121us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835060.211354:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1788835060.211372:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788835060.211378:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+25:3616:x1875729254032000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788835060.211386:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835060.211391:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1c8c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1c85 expref: 25 pid: 6482 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.211399:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1c8c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1c85 expref: 25 pid: 6482 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.211409:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1c8c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1c85 expref: 25 pid: 6482 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.211418:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835060.211440:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254032000:12345-0@lo:103:ldlm_bl.0 Request processed in 63us (1989us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835060.211452:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788835060.211466:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788835060.211472:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83680000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:3614:x1875729254032128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788835060.211481:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835060.211486:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afc8374d000/0xdf60171e5a5d1c7e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1c77 expref: 23 pid: 6482 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.211495:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afc8374d000/0xdf60171e5a5d1c7e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1c77 expref: 23 pid: 6482 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.211504:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afc8374d000/0xdf60171e5a5d1c7e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1c77 expref: 23 pid: 6482 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.211513:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835060.211542:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83680000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:3614:x1875729254032128:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (952us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835060.211548:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788835060.211560:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788835060.211566:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:3615:x1875729254032256:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788835060.211573:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835060.211577:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afc8374dc00/0xdf60171e5a5d1c70 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d1c69 expref: 21 pid: 6482 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.211586:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afc8374dc00/0xdf60171e5a5d1c70 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d1c69 expref: 21 pid: 6482 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.211595:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afc8374dc00/0xdf60171e5a5d1c70 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d1c69 expref: 21 pid: 6482 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.211615:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835060.211829:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9bb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:3615:x1875729254032256:12345-0@lo:103:ldlm_bl.0 Request processed in 263us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835060.211837:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1788835060.211884:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254032000:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788835060.211894:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254031872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788835060.211920:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729254032256:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788835060.211939:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729254032128:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788835060.211953:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788835060.212790:0:6467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967310 is committed 00000004:00080000:2.0:1788835060.212806:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00010000:00010000:0.0:1788835060.212867:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d26 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.212878:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d26 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.212886:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.212892:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835060.212896:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d26 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.212904:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d26 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.212918:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x942c7790 (ffff9afc835ce300) 00010000:00010000:0.0:1788835060.212932:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835060.212937:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d26 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.212944:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1d26 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.212963:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1d3b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.212970:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1d3b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.212976:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1d3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.212981:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e62a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835060.212984:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1d3b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.212990:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1d3b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.212998:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x2:0x0].0x0 (ffff9afc835c9e00) 00010000:00010000:0.0:1788835060.213001:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835060.213003:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1d3b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.213009:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62a00/0xdf60171e5a5d1d3b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.213023:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1da4 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.213039:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1da4 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.213046:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1da4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.213051:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374cc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835060.213054:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1da4 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.213060:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1da4 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.213068:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x1:0x0].0x942c7790 (ffff9afc835ce300) 00010000:00010000:0.0:1788835060.213070:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835060.213073:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1da4 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.213079:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1da4 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x1:0x0].0x942c7790 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.213093:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1dc0 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.213099:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1dc0 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.213105:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1dc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.213110:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835060.213117:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1dc0 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.213123:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1dc0 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.213131:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9afc835ce000) 00010000:00010000:0.0:1788835060.213134:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835060.213137:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1dc0 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.213142:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d1dc0 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835060.213242:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788835060.213254:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254032384:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788835060.213301:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835060.213371:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254032384 00000100:00100000:0.0:1788835060.213377:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254032384 00000100:00100000:0.0:1788835060.213415:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788835060.213422:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254032384:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788835060.213445:0:9814:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:2 count 1 00002000:00010000:0.0:1788835060.213476:0:9814:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x2:0x0] initial LVB size: 0, mtime: 0x6a9f74ef, atime: 0x6a9f74ef, ctime: 0x6a9f74ef, blocks: 0x0 00010000:00010000:0.0:1788835060.213483:0:9814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d1dd5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.213498:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=302s v=(0 0) 00010000:00010000:0.0:1788835060.213503:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835060.213510:0:9814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d1dd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.213538:0:9814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d1dd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.213547:0:9814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d1dd5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.213555:0:9814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d1dd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.213571:0:9814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788835060.214489:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3617:x1875729254032384:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1063us (1183us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1788835060.214498:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1788835060.214529:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835060.214535:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d1dd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.214545:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5e00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835060.214549:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d1dd5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.214558:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d1dd5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.214576:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d1dd5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.214594:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d1dd5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835060.214615:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835060.214617:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835060.214618:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835060.214784:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835060.214851:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835060.214895:0:13701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82075f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13701:1875729254031616:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788835060.214918:0:13701:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e810a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:13701:1875729254031744:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788835060.214950:0:13701:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1dce lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788835060.215031:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afdbf9b8700/2, rc 0, transno 4294967301 00000100:00100000:2.0:1788835060.215038:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254032384:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788835060.215091:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242416384 00000100:00100000:0.0:1788835060.215097:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242416384 00010000:00010000:0.0:1788835060.215122:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdb2e62c00/0xdf60171e5a5d1c62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae046e expref: 13 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835060.215187:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242416512 00000100:00100000:0.0:1788835060.215191:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242416512 00010000:00010000:0.0:1788835060.215203:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdb2e63000/0xdf60171e5a5d1c5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0467 expref: 14 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835060.215510:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:2.0:1788835060.215521:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e811c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e8f7875b-4951-482c-9de0-d3888250010c+14:2385:x1875729242416384:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835060.215536:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835060.215550:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdb2e62c00/0xdf60171e5a5d1c62 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae046e expref: 14 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835060.215562:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdb2e62c00/0xdf60171e5a5d1c62 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae046e expref: 14 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835060.215576:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e62c00/0xdf60171e5a5d1c62 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae046e expref: 14 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835060.215589:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835060.215647:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e811c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e8f7875b-4951-482c-9de0-d3888250010c+13:2385:x1875729242416384:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 128us (864us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835060.215654:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:2.0:1788835060.215671:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:2.0:1788835060.215677:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e8f7875b-4951-482c-9de0-d3888250010c+12:2385:x1875729242416512:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835060.215685:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835060.215689:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdb2e63000/0xdf60171e5a5d1c5b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0467 expref: 12 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835060.215698:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdb2e63000/0xdf60171e5a5d1c5b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0467 expref: 12 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835060.215708:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e63000/0xdf60171e5a5d1c5b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0467 expref: 12 pid: 6481 timeout: 402 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835060.215719:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1dce lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835060.215727:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1dce lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 13701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835060.215747:0:6475:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1dce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835060.215754:0:6475:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1dce lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835060.215760:0:6475:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1dce lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835060.215766:0:6475:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1dce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835060.215772:0:6475:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80030800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835060.215776:0:6475:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1dce lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835060.215782:0:6475:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1dce lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835060.215804:0:6475:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1dce lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835060.215813:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835060.215835:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e813100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:e8f7875b-4951-482c-9de0-d3888250010c+11:2385:x1875729242416512:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 157us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835060.215842:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00010000:00010000:1.0:1788835060.215894:0:13701:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1dce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835060.215902:0:13701:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1dce lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835060.215908:0:13701:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1dce lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13701 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835060.517544:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788835060.517577:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254032512:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788835060.517648:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835060.517880:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254032512 00000100:00100000:0.0:1788835060.517887:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254032512 00000100:00100000:0.0:1788835060.517946:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788835060.517955:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254032512:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788835060.517986:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835060.518035:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254032512:12345-0@lo:13:osp-pre-1-1.0 Request processed in 81us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835060.518042:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1788835060.518098:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254032512:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788835060.518379:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788835060.518388:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254032640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788835060.518428:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835060.518456:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254032640 00000100:00100000:0.0:1788835060.518460:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254032640 00000100:00100000:0.0:1788835060.518484:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788835060.518491:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1875729254032640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788835060.518503:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835060.518534:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1875729254032640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 43us (106us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835060.518540:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1788835060.518581:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254032640:0@lo:13:osp-pre-1-0.0 00000020:00000080:0.0:1788835061.205238:0:13750:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc632ae590 20000000:00000080:0.0:1788835061.205255:0:13750:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9afd916b4800 uarg=0000000000000000 20000000:01000000:0.0:1788835061.205295:0:13750:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788835061.205301:0:13750:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0001.hsm_control=enabled' 20000000:01000000:0.0:1788835061.205306:0:13750:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0001.hsm_control=enabled del=0 00000040:00080000:1.0:1788835061.205879:0:13751:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 20000000:02000000:0.0:1788835061.206059:0:13750:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0001.hsm_control=enabled in log params 00000040:00080000:0.0:1788835061.206127:0:13750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].10, 224 off10112 00000040:00080000:0.0:1788835061.206158:0:13750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].11, 128 off10240 00000040:00080000:0.0:1788835061.206173:0:13750:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].12, 224 off10464 10000000:01000000:0.0:1788835061.206183:0:13750:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1788835061.206203:0:13750:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d1ddc lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835061.206217:0:13750:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d1ddc lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835061.206227:0:13750:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d1ddc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835061.206247:0:13750:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d1ddc lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835061.206254:0:13750:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d1ddc lrc: 3/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835061.206260:0:13750:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d1ddc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835061.206267:0:13750:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5a00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835061.206983:0:13750:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d1ddc lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835061.206993:0:13750:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d1ddc lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835061.207006:0:13750:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d1ddc lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835061.207015:0:13750:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d1ddc lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835061.207022:0:13750:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d1ddc lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 13750 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835061.222958:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835061.541845:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788835061.541868:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254032768:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788835061.541935:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835061.542191:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254032768 00000100:00100000:0.0:1788835061.542199:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254032768 00000100:00100000:0.0:1788835061.542259:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788835061.542269:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254032768:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788835061.542301:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788835061.542491:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254032768:12345-0@lo:41:osp-pre-0-1.0 Request processed in 223us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835061.542498:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1788835061.542604:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254032768:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788835061.920616:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835061.920842:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242416640 00000100:00100000:2.0:1788835061.920852:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242416640 00000100:00100000:2.0:1788835061.920909:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 337 00000100:00100000:2.0:1788835061.920919:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+11:6160:x1875729242416640:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788835061.920935:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835061.920954:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e62a00/0xdf60171e5a5d1de3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae04bb expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835061.920982:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e62a00/0xdf60171e5a5d1de3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04bb expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835061.920994:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e62a00/0xdf60171e5a5d1de3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04bb expref: 12 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835061.921003:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e62a00, rc 0) 00000100:00100000:2.0:1788835061.921062:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e46c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+12:6160:x1875729242416640:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 144us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835061.921069:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 337 00000100:00100000:3.0:1788835061.926140:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835061.926493:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242416768 00000100:00100000:0.0:1788835061.926503:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242416768 00000100:00100000:0.0:1788835061.926578:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 338 00000100:00100000:0.0:1788835061.926590:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+12:6160:x1875729242416768:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788835061.926757:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+12:6160:x1875729242416768:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 168us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835061.926765:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 338 00000100:00100000:3.0:1788835061.935139:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835061.935378:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242416896 00000100:00100000:0.0:1788835061.935388:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242416896 00000100:00100000:0.0:1788835061.935499:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 339 00000100:00100000:0.0:1788835061.935521:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+12:6160:x1875729242416896:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788835061.935668:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e46050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+12:6160:x1875729242416896:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 158us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835061.935676:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 339 00000100:00100000:1.0:1788835061.943298:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835061.944515:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242417024 00000100:00100000:2.0:1788835061.944527:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242417024 00000100:00100000:2.0:1788835061.944592:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 340 00000100:00100000:2.0:1788835061.944602:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+12:10752:x1875729242417024:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788835061.945311:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e46850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+12:10752:x1875729242417024:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 707us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835061.945357:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 340 00000100:00100000:3.0:1788835061.956627:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835061.956741:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242417152 00000100:00100000:0.0:1788835061.956751:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242417152 00000100:00100000:0.0:1788835061.956809:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 341 00000100:00100000:0.0:1788835061.956819:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+12:10752:x1875729242417152:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788835061.956973:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e45450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+12:10752:x1875729242417152:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 154us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835061.956982:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 341 00000100:00100000:1.0:1788835061.965669:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835061.965923:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242417280 00000100:00100000:2.0:1788835061.965944:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242417280 00000100:00100000:2.0:1788835061.966001:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 342 00000100:00100000:2.0:1788835061.966010:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+12:6160:x1875729242417280:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788835061.966027:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835061.966042:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1dea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae04c2 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835061.966069:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1dea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04c2 expref: 13 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835061.966079:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1dea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04c2 expref: 13 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835061.966087:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e63800, rc 0) 00000100:00100000:2.0:1788835061.966140:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:6160:x1875729242417280:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 131us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835061.966146:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 342 00000100:00100000:1.0:1788835061.968818:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835061.968906:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242417408 00000100:00100000:2.0:1788835061.968914:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242417408 00000100:00100000:2.0:1788835061.968966:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 343 00000100:00100000:2.0:1788835061.968976:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:6160:x1875729242417408:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788835061.969132:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e45050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:6160:x1875729242417408:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 157us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835061.969140:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 343 00000100:00100000:2.0:1788835061.975024:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835061.975111:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242417536 00000100:00100000:0.0:1788835061.975135:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242417536 00000100:00100000:0.0:1788835061.975200:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 344 00000100:00100000:0.0:1788835061.975211:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:6160:x1875729242417536:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788835061.976286:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e45c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:6160:x1875729242417536:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 1070us (1267us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835061.976297:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 344 00000100:00100000:1.0:1788835061.985941:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835061.986247:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242417664 00000100:00100000:3.0:1788835061.986257:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242417664 00000100:00100000:3.0:1788835061.986365:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 345 00000100:00100000:3.0:1788835061.986377:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:10755:x1875729242417664:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788835061.986970:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e46450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:10755:x1875729242417664:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 591us (1035us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835061.986987:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 345 00000100:00100000:1.0:1788835061.993817:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835061.997384:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242417792 00000100:00100000:0.0:1788835061.997398:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242417792 00000100:00100000:0.0:1788835061.997471:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 346 00000100:00100000:0.0:1788835061.997482:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:10755:x1875729242417792:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:0.0:1788835061.998453:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e45850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:10755:x1875729242417792:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 968us (4640us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835061.998464:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 346 10000000:01000000:2.0:1788835062.245850:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788835062.245859:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afc82611000 from 7 10000000:01000000:2.0:1788835062.245864:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788835062.245912:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1df1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835062.245926:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1df1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835062.245938:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1df1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835062.245967:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254032896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788835062.246038:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835062.246100:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd84ce0000 going to sleep for 11 seconds 00000100:00100000:3.0:1788835062.246175:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254032896 00000100:00100000:3.0:1788835062.246184:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254032896 00000100:00100000:3.0:1788835062.246251:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788835062.246261:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd829d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:6485:x1875729254032896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788835062.246275:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835062.246288:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1df8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1df1 expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835062.246311:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1df8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1df1 expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835062.246357:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1df8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1df1 expref: 21 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835062.246366:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd80030800, rc 0) 00000100:00100000:3.0:1788835062.246420:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd829d2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729254032896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 160us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835062.246446:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:3.0:1788835062.246495:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254032896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788835062.246521:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1df1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1df8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835062.246529:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1df1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1df8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835062.246591:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e810a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254033024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788835062.246618:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835062.246637:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eac0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1788835062.247013:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835062.247025:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254033024 00000100:00100000:0.0:1788835062.247029:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254033024 00000100:00100000:0.0:1788835062.247063:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 348 00000100:00100000:0.0:1788835062.247071:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd878e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729254033024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788835062.247175:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd878e4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729254033024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 105us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835062.247182:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 348 00000100:00100000:3.0:1788835062.247697:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e810a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254033024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788835062.247807:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e810a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254033152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788835062.247859:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835062.247893:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eac0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788835062.247907:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254033152 00000100:00100000:3.0:1788835062.247911:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254033152 00000100:00100000:3.0:1788835062.247981:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 349 00000100:00100000:3.0:1788835062.247989:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd878e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729254033152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788835062.248079:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd878e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729254033152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 91us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835062.248087:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 349 00000100:00100000:1.0:1788835062.248952:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e810a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254033152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788835062.249210:0:13763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:13763:1875729254033280:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788835062.249273:0:13763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835062.250109:0:13763:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc83085b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788835062.250150:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254033280 00000100:00100000:2.0:1788835062.250157:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254033280 00000100:00100000:2.0:1788835062.250697:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 350 00000100:00100000:2.0:1788835062.250710:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd878e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:13763:x1875729254033280:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788835062.250987:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd878e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:13763:x1875729254033280:12345-0@lo:502:llog_process_th.0 Request processed in 279us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835062.250996:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 350 00000100:00100000:1.0:1788835062.251180:0:13763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:13763:1875729254033280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788835062.251663:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788835062.251684:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835062.251687:0:13763:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788835062.251694:0:13763:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afc82611000 00000020:00000080:1.0:1788835062.251697:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788835062.251940:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788835062.251945:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835062.251946:0:13763:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788835062.251949:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788835062.251952:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835062.251954:0:13763:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788835062.251958:0:13763:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afc82611000 00000020:00000080:1.0:1788835062.251960:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788835062.258743:0:13763:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:13763:1875729254033408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788835062.258833:0:13763:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835062.258873:0:13763:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc83085b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788835062.259087:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254033408 00000100:00100000:2.0:1788835062.259094:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254033408 00000100:00100000:2.0:1788835062.259148:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 351 00000100:00100000:2.0:1788835062.259158:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd878d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:13763:x1875729254033408:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788835062.259292:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd878d9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:13763:x1875729254033408:12345-0@lo:502:llog_process_th.0 Request processed in 135us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835062.259307:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 351 00000100:00100000:1.0:1788835062.261274:0:13763:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345d880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:13763:1875729254033408:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788835062.261499:0:13763:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788835062.261565:0:13763:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835062.261567:0:13763:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788835062.261572:0:13763:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:2.0:1788835062.261864:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:2.0:1788835062.261887:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788835062.261897:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1df1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1df8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835062.261908:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1df1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1df8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835062.261918:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788835062.261920:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afdba102000 from 7 10000000:01000000:2.0:1788835062.261922:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788835062.261951:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1dff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835062.261958:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1dff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835062.261967:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1dff lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835062.261985:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254033536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788835062.262038:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835062.262069:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd84ce0240 going to sleep for 11 seconds 00000100:00100000:1.0:1788835062.262619:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254033536 00000100:00100000:1.0:1788835062.262628:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254033536 00000100:00100000:1.0:1788835062.262678:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:1.0:1788835062.262687:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:6485:x1875729254033536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788835062.262710:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835062.263815:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e61c00/0xdf60171e5a5d1e06 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1dff expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835062.263848:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e61c00/0xdf60171e5a5d1e06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1dff expref: 22 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835062.263860:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e61c00/0xdf60171e5a5d1e06 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1dff expref: 22 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835062.263869:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61c00, rc 0) 00000100:00100000:1.0:1788835062.263944:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7272850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729254033536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1257us (1905us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835062.263951:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:2.0:1788835062.264086:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254033536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788835062.264102:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1dff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1e06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835062.264110:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1dff lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1e06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835062.264185:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254033664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788835062.264301:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835062.264362:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd84ce0240 going to sleep for 11 seconds 00000100:00100000:2.0:1788835062.264646:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254033664 00000100:00100000:2.0:1788835062.264652:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254033664 00000100:00100000:2.0:1788835062.264696:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:2.0:1788835062.264705:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729254033664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788835062.266594:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b9c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254033664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788835062.266651:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e811f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254033792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788835062.268499:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7271450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729254033664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 3788us (4263us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835062.268522:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788835062.276603:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835062.276663:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eac0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788835062.276927:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254033792 00000100:00100000:1.0:1788835062.276936:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254033792 00000100:00100000:1.0:1788835062.276994:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:1.0:1788835062.277004:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729254033792:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788835062.277177:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7273050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729254033792:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 175us (1453us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835062.277432:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e811f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254033792:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788835062.277947:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:2.0:1788835062.278480:0:13766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:13766:1875729254033920:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788835062.278934:0:13766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835062.278972:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254033920 00000100:00100000:2.0:1788835062.278978:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254033920 00000100:00100000:2.0:1788835062.279015:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788835062.279024:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:13766:x1875729254033920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788835062.279125:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7271050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:13766:x1875729254033920:12345-0@lo:502:llog_process_th.0 Request processed in 102us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835062.279133:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:2.0:1788835062.279428:0:13766:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd84ce0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788835062.279449:0:13766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836baa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:13766:1875729254033920:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788835062.279479:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788835062.279494:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835062.279496:0:13766:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788835062.279614:0:13766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afdba102000 00000020:00000080:2.0:1788835062.279618:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788835062.279674:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788835062.279846:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835062.279849:0:13766:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788835062.279854:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788835062.279858:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835062.279860:0:13766:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788835062.279864:0:13766:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afdba102000 00000020:00000080:3.0:1788835062.279866:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788835062.279917:0:13766:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e811180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:13766:1875729254034048:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788835062.279963:0:13766:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835062.279987:0:13766:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eac240 going to sleep for 11 seconds 00000100:00100000:1.0:1788835062.280520:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254034048 00000100:00100000:1.0:1788835062.280526:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254034048 00000100:00100000:1.0:1788835062.280562:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:1.0:1788835062.280571:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:13766:x1875729254034048:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788835062.280694:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7271c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:13766:x1875729254034048:12345-0@lo:502:llog_process_th.0 Request processed in 123us (729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835062.280710:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788835062.281389:0:13766:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e811180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:13766:1875729254034048:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788835062.281420:0:13766:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788835062.281427:0:13766:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835062.281429:0:13766:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788835062.281433:0:13766:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788835062.282103:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788835062.282125:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788835062.282137:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1dff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1e06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835062.282149:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1dff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1e06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788835062.282159:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788835062.282161:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afdb279f000 from 7 10000000:01000000:1.0:1788835062.282164:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788835062.282212:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1e0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835062.282221:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1e0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835062.282395:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1e0d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835062.282417:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254034176:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788835062.282474:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835062.282634:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc83085300 going to sleep for 11 seconds 00000100:00100000:2.0:1788835062.282837:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254034176 00000100:00100000:2.0:1788835062.282845:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254034176 00000100:00100000:2.0:1788835062.282897:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:2.0:1788835062.282907:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:6485:x1875729254034176:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788835062.282920:0:6483:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835062.282934:0:6483:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e62e00/0xdf60171e5a5d1e14 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1e0d expref: -99 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835062.282957:0:6483:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e62e00/0xdf60171e5a5d1e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1e0d expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835062.282969:0:6483:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e62e00/0xdf60171e5a5d1e14 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1e0d expref: 23 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835062.282979:0:6483:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e62e00, rc 0) 00000100:00100000:2.0:1788835062.283034:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7272450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729254034176:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835062.283040:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788835062.283204:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254034176:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788835062.283218:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1e0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1e14 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835062.283440:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1e0d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1e14 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835062.283630:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e811180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254034304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788835062.283664:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835062.283690:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eac240 going to sleep for 11 seconds 00000100:00100000:1.0:1788835062.283826:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254034304 00000100:00100000:1.0:1788835062.283830:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254034304 00000100:00100000:1.0:1788835062.283866:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:1.0:1788835062.283875:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729254034304:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788835062.283993:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7271850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729254034304:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 119us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835062.284012:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788835062.284090:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e811180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254034304:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788835062.284123:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e811180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254034432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788835062.284161:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835062.284469:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254034432 00000100:00100000:2.0:1788835062.284474:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254034432 00000100:00100000:2.0:1788835062.284497:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:2.0:1788835062.284849:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729254034432:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788835062.284946:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7270050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729254034432:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 440us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835062.284962:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788835062.285080:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eac240 going to sleep for 11 seconds 00000100:00100000:3.0:1788835062.285096:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e811180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254034432:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788835062.286840:0:13767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e811180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:13767:1875729254034560:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788835062.286906:0:13767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835062.286949:0:13767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eace40 going to sleep for 11 seconds 00000100:00100000:1.0:1788835062.287359:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254034560 00000100:00100000:1.0:1788835062.287366:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254034560 00000100:00100000:1.0:1788835062.287478:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:1.0:1788835062.287488:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:13767:x1875729254034560:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788835062.290415:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7273850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:13767:x1875729254034560:12345-0@lo:502:llog_process_th.0 Request processed in 2920us (3500us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835062.290430:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00000100:00100000:3.0:1788835062.292600:0:13767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e811180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:13767:1875729254034560:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788835062.292643:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788835062.292653:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835062.292656:0:13767:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788835062.292664:0:13767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afdb279f000 00000020:00000080:3.0:1788835062.292667:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788835062.292841:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788835062.292845:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835062.292847:0:13767:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788835062.292850:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788835062.292853:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835062.292854:0:13767:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788835062.292858:0:13767:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afdb279f000 00000020:00000080:3.0:1788835062.292860:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000040:00080000:2.0:1788835062.298108:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788835062.304472:0:13767:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e811180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:13767:1875729254034688:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788835062.304572:0:13767:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835062.304610:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254034688 00000100:00100000:3.0:1788835062.304617:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254034688 00000100:00100000:3.0:1788835062.304663:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788835062.304672:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:13767:x1875729254034688:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788835062.304803:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7273450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:13767:x1875729254034688:12345-0@lo:502:llog_process_th.0 Request processed in 132us (232us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835062.304811:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00000100:00100000:3.0:1788835062.304897:0:13767:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eace40 going to sleep for 11 seconds 00000100:00100000:3.0:1788835062.304918:0:13767:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e811180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:13767:1875729254034688:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788835062.304945:0:13767:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788835062.304952:0:13767:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835062.304955:0:13767:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788835062.304959:0:13767:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:1.0:1788835062.306553:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:1.0:1788835062.306584:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788835062.306595:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1e0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1e14 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835062.306609:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1e0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1e14 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788835062.306620:0:6485:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1788835062.306622:0:6485:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afd85554000 from 7 10000000:01000000:1.0:1788835062.306625:0:6485:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788835062.306660:0:6485:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d1e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835062.306669:0:6485:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d1e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835062.306680:0:6485:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d1e1b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835062.306700:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254034816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788835062.306774:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835062.306822:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc83085f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788835062.306985:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254034816 00000100:00100000:3.0:1788835062.306992:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254034816 00000100:00100000:3.0:1788835062.307041:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 362 00000100:00100000:3.0:1788835062.307050:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:6485:x1875729254034816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788835062.307062:0:6482:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835062.307075:0:6482:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd80030a00/0xdf60171e5a5d1e22 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d1e1b expref: -99 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835062.307097:0:6482:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd80030a00/0xdf60171e5a5d1e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d1e1b expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835062.307109:0:6482:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd80030a00/0xdf60171e5a5d1e22 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d1e1b expref: 24 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835062.307118:0:6482:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd80030a00, rc 0) 00000100:00100000:3.0:1788835062.307156:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7273c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:6485:x1875729254034816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 107us (381us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835062.307162:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 362 00000100:00100000:1.0:1788835062.307887:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254034816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788835062.307903:0:6485:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d1e1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1e22 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835062.307939:0:6485:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d1e1b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1e22 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835062.308028:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254034944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788835062.308061:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835062.308093:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc83085f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788835062.308139:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254034944 00000100:00100000:3.0:1788835062.308154:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254034944 00000100:00100000:3.0:1788835062.308195:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 363 00000100:00100000:3.0:1788835062.308203:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:6485:x1875729254034944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788835062.308350:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7270850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:6485:x1875729254034944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 146us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835062.308358:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 363 00000100:00100000:1.0:1788835062.308839:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254034944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788835062.308889:0:6485:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254035072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788835062.308936:0:6485:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835062.309005:0:6485:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc83085f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788835062.315590:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254035072 00000100:00100000:3.0:1788835062.315604:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254035072 00000100:00100000:3.0:1788835062.315675:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 364 00000100:00100000:3.0:1788835062.315685:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:6485:x1875729254035072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788835062.316221:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7270450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:6485:x1875729254035072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 338us (7085us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835062.316232:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 364 00000100:00100000:1.0:1788835062.318564:0:6485:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345c380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:5f0122c5-c616-4176-9ca1-6fdce4068f64:6485:1875729254035072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788835062.321019:0:13769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:13769:1875729254035200:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788835062.321099:0:13769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835062.321149:0:13769:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc83085840 going to sleep for 11 seconds 00000100:00100000:2.0:1788835062.321210:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254035200 00000100:00100000:2.0:1788835062.321217:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254035200 00000100:00100000:2.0:1788835062.321276:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 365 00000100:00100000:2.0:1788835062.321286:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:13769:x1875729254035200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788835062.322013:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7272c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:13769:x1875729254035200:12345-0@lo:502:llog_process_th.0 Request processed in 725us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835062.322022:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 365 00000100:00100000:1.0:1788835062.322145:0:13769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:13769:1875729254035200:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1788835062.322174:0:13769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788835062.322184:0:13769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835062.322197:0:13769:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788835062.322205:0:13769:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afd85554000 00000020:00000080:1.0:1788835062.322215:0:13769:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788835062.322286:0:13769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788835062.322290:0:13769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835062.322292:0:13769:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788835062.322294:0:13769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788835062.322297:0:13769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835062.322298:0:13769:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788835062.322302:0:13769:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afd85554000 00000020:00000080:1.0:1788835062.322304:0:13769:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1788835062.323049:0:13769:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8345c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:13769:1875729254035328:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788835062.323105:0:13769:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835062.323146:0:13769:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc83085840 going to sleep for 11 seconds 00000100:00100000:0.0:1788835062.323249:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254035328 00000100:00100000:0.0:1788835062.323256:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254035328 00000100:00100000:0.0:1788835062.323299:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 366 00000100:00100000:0.0:1788835062.323308:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:13769:x1875729254035328:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788835062.323448:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7270c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:13769:x1875729254035328:12345-0@lo:502:llog_process_th.0 Request processed in 140us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835062.323461:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 366 00000100:00100000:2.0:1788835062.331653:0:13769:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8345c380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:5f0122c5-c616-4176-9ca1-6fdce4068f64:13769:1875729254035328:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1788835062.331699:0:13769:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788835062.331710:0:13769:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835062.331712:0:13769:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788835062.331717:0:13769:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:3.0:1788835062.334786:0:6485:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-12 (rc=0) 10000000:01000000:3.0:1788835062.334849:0:6485:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788835062.334861:0:6485:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d1e1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1e22 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835062.334874:0:6485:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d1e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1e22 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788835062.349145:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788835063.269816:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788835063.334189:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788835063.401899:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788835063.900908:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835063.900959:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835063.900988:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242418048 00000100:00100000:2.0:1788835063.900999:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242418048 00000100:00100000:2.0:1788835063.901076:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 210 00000100:00100000:2.0:1788835063.901087:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242418048:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835063.901158:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e811180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242418048:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 73us (264us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835063.901167:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 210 00000100:00100000:0.0:1788835063.901261:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242418304 00000100:00100000:0.0:1788835063.901266:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242418304 00000100:00100000:0.0:1788835063.901381:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 75 00000100:00100000:0.0:1788835063.901395:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242418304:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835063.901398:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00080000:1.0:1788835063.901469:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788835063.901476:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788835063.901508:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242418560 00000100:00100000:1.0:1788835063.901512:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242418560 00000100:00100000:1.0:1788835063.901550:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 211 00000100:00100000:1.0:1788835063.901558:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242418560:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835063.902597:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e810000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242418304:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 1201us (1630us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835063.902609:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 75 00000100:00080000:0.0:1788835063.902701:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788835063.910598:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835063.910671:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835063.910714:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835063.910846:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242418176 00000100:00100000:0.0:1788835063.910857:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242418176 00000100:00100000:0.0:1788835063.910925:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242418432 00000100:00100000:0.0:1788835063.910929:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242418432 00000100:00100000:0.0:1788835063.910951:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 212 00000100:00100000:0.0:1788835063.910961:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242418176:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835063.911039:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e810700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242418176:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 78us (366us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835063.911041:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242417920 00000100:00100000:2.0:1788835063.911048:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242417920 00000100:00100000:0.0:1788835063.911050:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 212 00000100:00100000:0.0:1788835063.911072:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 213 00000100:00100000:0.0:1788835063.911080:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242418432:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835063.911088:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 367 00000100:00100000:2.0:1788835063.911098:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:2386:x1875729242417920:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835063.911110:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e811f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242418432:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 31us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835063.911124:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 213 00000100:00100000:2.0:1788835063.911154:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7272050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:2386:x1875729242417920:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 56us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835063.911174:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 367 00000100:00100000:1.0:1788835063.913360:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e812a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242418560:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 11786us (11951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835063.913377:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 211 00000100:00080000:3.0:1788835063.913381:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788835063.913406:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:0.0:1788835064.300623:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835065.125816:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788835065.125843:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254035456:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788835065.125932:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835065.126008:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254035456 00000100:00100000:2.0:1788835065.126015:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254035456 00000100:00100000:2.0:1788835065.126064:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788835065.126073:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254035456:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788835065.126112:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788835065.126166:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254035456:12345-0@lo:41:osp-pre-1-0.0 Request processed in 94us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835065.126173:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1788835065.126236:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254035456:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788835065.126553:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788835065.126569:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254035584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788835065.126616:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835065.126771:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254035584 00000100:00100000:2.0:1788835065.126778:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254035584 00000100:00100000:2.0:1788835065.126849:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788835065.126861:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254035584:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1788835065.126880:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788835065.126896:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729254036096:0@lo:400:kworker.0 00002000:00000024:2.0:1788835065.126906:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788835065.126941:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835065.126955:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254035584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835065.126963:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788835065.126970:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729254036608:0@lo:400:kworker.0 00000100:00100000:3.0:1788835065.126997:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835065.127033:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788835065.127037:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254036096 00000100:00100000:3.0:1788835065.127041:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254035968:0@lo:400:kworker.0 00000100:00100000:2.0:1788835065.127044:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254036096 00000100:00100000:3.0:1788835065.127074:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835065.127079:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254036608 00000100:00100000:3.0:1788835065.127095:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254036480:0@lo:400:kworker.0 00000100:00100000:2.0:1788835065.127098:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254036608 00000100:00100000:3.0:1788835065.127125:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835065.127136:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 214 00000100:00100000:2.0:1788835065.127145:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729254036096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835065.127148:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254036992:0@lo:400:kworker.0 00000100:00100000:3.0:1788835065.127179:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835065.127216:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254035968 00000100:00100000:3.0:1788835065.127221:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254035968 00000100:00100000:3.0:1788835065.127247:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1788835065.127254:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254035968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835065.127272:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729254035712:0@lo:400:kworker.0 00000100:00100000:3.0:1788835065.127306:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254035968:12345-0@lo:400:kworker.0 Request processed in 41us (220us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835065.127347:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788835065.127353:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835065.127377:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215 00000100:00100000:1.0:1788835065.127385:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729254036224:0@lo:400:kworker.0 00000100:00100000:3.0:1788835065.127400:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729254036608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835065.127423:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835065.127449:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729254036608:12345-0@lo:400:kworker.0 Request processed in 63us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835065.127449:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729254036736:0@lo:400:kworker.0 00000100:00100000:3.0:1788835065.127459:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215 00000100:00100000:3.0:1788835065.127476:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254036224 00000100:00100000:3.0:1788835065.127486:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254036224 00000100:00100000:1.0:1788835065.127490:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835065.127513:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788835065.127514:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254036736 00000100:00100000:3.0:1788835065.127519:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254036736 00000100:00100000:1.0:1788835065.127522:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729254035840:0@lo:400:kworker.0 00000100:00100000:3.0:1788835065.127539:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788835065.127551:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729254036224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835065.127551:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835065.127569:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254036352:0@lo:400:kworker.0 00000100:00100000:3.0:1788835065.127596:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729254036224:12345-0@lo:400:kworker.0 Request processed in 49us (174us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835065.127603:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216 00000100:00100000:3.0:1788835065.127615:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254035840 00000100:00100000:1.0:1788835065.127619:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835065.127621:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254035840 00000100:00100000:1.0:1788835065.127637:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb9308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254036864:0@lo:400:kworker.0 00000100:00100000:3.0:1788835065.127640:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254036352 00000100:00100000:3.0:1788835065.127645:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254036352 00000100:00100000:3.0:1788835065.127668:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217 00000100:00100000:1.0:1788835065.127670:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835065.127678:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729254036736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835065.127711:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82077800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729254036224:0@lo:400:kworker.0 00000100:00100000:3.0:1788835065.127718:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729254036736:12345-0@lo:400:kworker.0 Request processed in 41us (228us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835065.127726:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217 00010000:00080000:1.0:1788835065.127733:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb930a300 x1875729254036736/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835065.127743:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218 00000100:00100000:1.0:1788835065.127749:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729254036736:0@lo:400:kworker.0 00000100:00100000:3.0:1788835065.127755:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729254035840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835065.127793:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254035712 00000100:00100000:1.0:1788835065.127797:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254035712 00000100:00100000:3.0:1788835065.127799:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729254035840:12345-0@lo:400:kworker.0 Request processed in 46us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835065.127807:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218 00000100:00100000:3.0:1788835065.127824:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1788835065.127832:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254036352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835065.127840:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 368 00000100:00100000:1.0:1788835065.127850:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3614:x1875729254035712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835065.127866:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254036352:12345-0@lo:400:kworker.0 Request processed in 35us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835065.127873:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:1.0:1788835065.127894:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3614:x1875729254035712:12345-0@lo:400:kworker.0 Request processed in 45us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835065.127902:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 368 00000100:00100000:3.0:1788835065.127935:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82075c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254035968:0@lo:400:kworker.0 00000100:00100000:1.0:1788835065.127941:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254036480 00000100:00100000:1.0:1788835065.127947:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254036480 00000100:00100000:3.0:1788835065.127951:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9308380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729254036608:0@lo:400:kworker.0 00000100:00100000:1.0:1788835065.127981:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254036992 00000100:00100000:1.0:1788835065.127986:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254036992 00000100:00080000:3.0:1788835065.127992:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788835065.127998:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788835065.128001:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788835065.128003:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788835065.128012:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254036864 00000100:00100000:1.0:1788835065.128017:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254036864 00000100:00100000:1.0:1788835065.128044:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788835065.128053:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1788835065.128054:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254036480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835065.128067:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875729254036992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835065.128103:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254036480:12345-0@lo:400:kworker.0 Request processed in 53us (979us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835065.128110:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1788835065.128116:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3617:x1875729254036992:12345-0@lo:400:kworker.0 Request processed in 51us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835065.128124:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1788835065.128473:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729254036096:12345-0@lo:400:kworker.0 Request processed in 1327us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835065.128481:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 214 00010000:00080000:2.0:1788835065.128517:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbf9bbb80 x1875729254035584/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835065.128534:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254035584:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788835065.128622:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788835065.128632:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254036864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835065.128667:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254036864:12345-0@lo:400:kworker.0 Request processed in 38us (1000us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835065.128673:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1788835065.128687:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788835065.128708:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82075f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729254035840:0@lo:400:kworker.0 00010000:00080000:1.0:1788835065.128719:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc82077480 x1875729254036352/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835065.128728:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82077480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254036352:0@lo:400:kworker.0 00000100:00100000:1.0:1788835065.128738:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9308a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254036864:0@lo:400:kworker.0 00000100:00100000:1.0:1788835065.128746:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e810a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729254035712:0@lo:400:kworker.0 00010000:00080000:1.0:1788835065.128889:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb930aa00 x1875729254036480/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835065.128967:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254036480:0@lo:400:kworker.0 00000100:00100000:1.0:1788835065.128985:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb9308e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254036992:0@lo:400:kworker.0 00000100:00100000:1.0:1788835065.128995:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82076680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729254036096:0@lo:400:kworker.0 00000100:00100000:1.0:1788835065.129388:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254037120:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835065.129430:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835065.129517:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254037120 00000100:00100000:0.0:1788835065.129523:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254037120 00000100:00100000:0.0:1788835065.129566:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1788835065.129574:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254037120:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788835065.129600:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835065.129642:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254037120:12345-0@lo:13:osp-pre-0-1.0 Request processed in 69us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835065.129648:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00010000:00080000:0.0:1788835065.129675:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbf9bbb80 x1875729254037120/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835081 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835065.129688:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254037120:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788835065.317940:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835065.639350:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254037248:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788835065.639427:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835065.639510:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788835065.639518:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254037376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788835065.639544:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835065.639601:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254037248 00000100:00100000:1.0:1788835065.639609:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254037248 00000100:00100000:1.0:1788835065.639653:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254037376 00000100:00100000:1.0:1788835065.639656:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254037376 00000100:00100000:1.0:1788835065.639806:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788835065.639818:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729254037248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788835065.639853:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835065.639900:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729254037248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835065.640149:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254037248:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788835065.643956:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1788835065.644000:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254037376:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788835065.644042:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788835065.644177:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e810a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254037376:12345-0@lo:13:osp-pre-1-1.0 Request processed in 201us (4630us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835065.644188:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788835065.644305:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254037376:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788835065.645768:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000001:00080000:2.0:1788835066.158757:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00010000:00010000:0.0:1788835066.341778:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835066.661895:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254037504:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788835066.661993:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835066.665577:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254037504 00000100:00100000:0.0:1788835066.665599:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254037504 00000100:00100000:0.0:1788835066.665765:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1788835066.665778:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254037504:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788835066.665837:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788835066.665978:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254037504:12345-0@lo:41:osp-pre-0-1.0 Request processed in 202us (3984us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835066.665986:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788835066.666118:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254037504:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788835067.365786:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835068.390010:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835069.025923:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835069.025983:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835069.026017:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835069.026054:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835069.026077:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835069.026121:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835069.026155:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242419072 00000100:00100000:3.0:1788835069.026190:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242419072 00000100:00100000:3.0:1788835069.026300:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:3.0:1788835069.026312:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242419072:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835069.026449:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242418944 00000100:00100000:1.0:1788835069.026455:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242418944 00000100:00100000:3.0:1788835069.026471:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242419072:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 160us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835069.026482:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:1.0:1788835069.026502:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242419200 00000100:00100000:1.0:1788835069.026507:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242419200 00000100:00100000:1.0:1788835069.026525:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242418816 00000100:00100000:1.0:1788835069.026528:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242418816 00000100:00080000:3.0:1788835069.026538:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788835069.026544:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242419328 00000100:00080000:3.0:1788835069.026545:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788835069.026548:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242419328 00000100:00080000:3.0:1788835069.026550:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788835069.026569:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 220 00000100:00100000:3.0:1788835069.026581:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242418944:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835069.026586:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 221 00000100:00100000:1.0:1788835069.026599:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242419200:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835069.026623:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242418944:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 45us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835069.026631:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 220 00000100:00100000:1.0:1788835069.026643:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242419200:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 46us (623us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835069.026654:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 222 00000100:00100000:3.0:1788835069.026669:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242418816:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835069.026669:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 221 00000100:00100000:1.0:1788835069.026690:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 223 00000100:00100000:1.0:1788835069.026699:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242419328:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835069.026706:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ee680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242418816:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 40us (649us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835069.026713:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 222 00000100:00080000:3.0:1788835069.026731:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788835069.026737:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9eca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242419328:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 38us (625us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835069.026965:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242418688 00000100:00100000:2.0:1788835069.026971:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242418688 00000100:00100000:2.0:1788835069.027014:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 369 00000100:00100000:2.0:1788835069.027022:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:2385:x1875729242418688:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835069.027055:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:2385:x1875729242418688:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 35us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835069.027061:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 369 00000100:00100000:1.0:1788835069.027279:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 223 00010000:00010000:0.0:1788835069.413940:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835070.245795:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788835070.245829:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254037632:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788835070.245878:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254037760:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788835070.245955:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254037888:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788835070.246038:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835070.246126:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254037760 00000100:00100000:0.0:1788835070.246135:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254037760 00000100:00100000:0.0:1788835070.246218:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1788835070.246230:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254037760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788835070.246281:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835070.246360:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83685f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254037760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835070.246370:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00080000:0.0:1788835070.246400:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788835070.246432:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254038272:0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.246470:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835070.246502:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254038784:0@lo:400:kworker.0 00000100:00100000:3.0:1788835070.246506:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254038144:0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.246542:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835070.246579:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254038784 00000100:00100000:3.0:1788835070.246584:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254038784 00010000:00080000:0.0:1788835070.246594:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbf9ba300 x1875729254037760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835070.246619:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254037760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788835070.246631:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 224 00000100:00100000:3.0:1788835070.246642:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254038784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.246643:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254039296:0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.246676:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1788835070.246710:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbf9ec000 x1875729254038784/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835070.246719:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254038784:12345-0@lo:400:kworker.0 Request processed in 77us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835070.246724:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254038784:0@lo:400:kworker.0 00000100:00100000:3.0:1788835070.246731:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 224 00000100:00100000:0.0:1788835070.246741:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:0.0:1788835070.246758:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254038400:0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.246786:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835070.246805:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254038912:0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.246825:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835070.246845:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254039424:0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.246867:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835070.246895:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254039296 00000100:00100000:0.0:1788835070.246899:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254039296 00000100:00100000:0.0:1788835070.246928:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254038912 00000100:00100000:0.0:1788835070.246931:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254038912 00000100:00100000:0.0:1788835070.246945:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254039424 00000100:00100000:0.0:1788835070.246947:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254039424 00000100:00100000:0.0:1788835070.246963:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788835070.246971:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254039296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.247006:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254039296:12345-0@lo:400:kworker.0 Request processed in 37us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835070.247013:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788835070.247023:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788835070.247029:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254038912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.247056:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254038912:12345-0@lo:400:kworker.0 Request processed in 28us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835070.247061:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788835070.247071:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788835070.247077:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254039424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.247103:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254039424:12345-0@lo:400:kworker.0 Request processed in 27us (236us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835070.247109:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1788835070.247134:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254038400 00000100:00100000:0.0:1788835070.247137:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254038400 00000100:00100000:0.0:1788835070.247163:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:0.0:1788835070.247169:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254038400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.247214:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254038400:12345-0@lo:400:kworker.0 Request processed in 45us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835070.247221:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00080000:0.0:1788835070.247245:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788835070.247248:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788835070.247251:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788835070.247274:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835070.247297:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254038656:0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.247359:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835070.247385:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254039168:0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.247406:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835070.247421:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788835070.247428:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254038016:0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.247455:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835070.247476:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254038528:0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.247498:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835070.247514:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729254039040:0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.247532:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835070.247550:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254038272 00000100:00100000:0.0:1788835070.247554:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254038272 00000100:00100000:0.0:1788835070.247579:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254038528 00000100:00100000:0.0:1788835070.247582:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254038528 00000100:00100000:0.0:1788835070.247592:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788835070.247597:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254038272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.247636:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83685180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254038272:12345-0@lo:400:kworker.0 Request processed in 39us (1167us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835070.247643:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:0.0:1788835070.247653:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788835070.247657:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254038528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.247683:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254038528:12345-0@lo:400:kworker.0 Request processed in 26us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835070.247689:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1788835070.247707:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254038144 00000100:00100000:0.0:1788835070.247710:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254038144 00000100:00100000:0.0:1788835070.247722:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254038656 00000100:00100000:0.0:1788835070.247725:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254038656 00000100:00100000:0.0:1788835070.247739:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254039168 00000100:00100000:0.0:1788835070.247741:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254039168 00000100:00100000:0.0:1788835070.247750:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254039040 00000100:00100000:0.0:1788835070.247752:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254039040 00000100:00100000:0.0:1788835070.247763:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788835070.247768:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254038144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.247794:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254038144:12345-0@lo:400:kworker.0 Request processed in 25us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835070.247799:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 226 00000100:00100000:0.0:1788835070.247809:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788835070.247815:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254038656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.247838:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254038656:12345-0@lo:400:kworker.0 Request processed in 23us (479us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835070.247844:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1788835070.247853:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788835070.247868:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875729254039168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.247897:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875729254039168:12345-0@lo:400:kworker.0 Request processed in 30us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835070.247902:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 228 00000100:00100000:0.0:1788835070.247913:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1788835070.247919:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729254039040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.247944:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729254039040:12345-0@lo:400:kworker.0 Request processed in 25us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835070.247949:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00080000:0.0:1788835070.247963:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788835070.247967:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788835070.247998:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254038528:0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.248009:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729254039040:0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.248019:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254038144:0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.248028:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254038656:0@lo:400:kworker.0 00010000:00080000:0.0:1788835070.248039:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa2dc00 x1875729254039168/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835070.248049:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254039168:0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.248085:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254038400:0@lo:400:kworker.0 00010000:00080000:0.0:1788835070.248095:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa2ce00 x1875729254038912/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835070.248104:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254038912:0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.248128:0:3614:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1788835070.248134:0:3614:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afdbf9b8700, transno 4294967301 00000100:00100000:0.0:1788835070.248146:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254039424:0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.248158:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254039296:0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.248170:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254038272:0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.248394:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254038016 00000100:00100000:0.0:1788835070.248399:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254038016 00000100:00100000:0.0:1788835070.248438:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788835070.248447:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729254038016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835070.248488:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729254038016:12345-0@lo:400:kworker.0 Request processed in 43us (1032us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835070.248494:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 370 00000100:00100000:0.0:1788835070.248537:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254038016:0@lo:400:kworker.0 00000100:00100000:2.0:1788835070.252967:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835070.253981:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835070.253998:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254037632 00000100:00100000:0.0:1788835070.254013:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254037632 00000100:00100000:0.0:1788835070.254116:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788835070.254131:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254037632:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788835070.254188:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788835070.254402:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254037632:12345-0@lo:41:osp-pre-1-0.0 Request processed in 274us (1447us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835070.254411:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1788835070.256797:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254037888 00000100:00100000:3.0:1788835070.256822:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254037888 00000100:00100000:3.0:1788835070.256919:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788835070.256934:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254037888:12345-0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788835070.256961:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254037632:0@lo:41:osp-pre-1-0.0 00002000:00000024:3.0:1788835070.256973:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788835070.257077:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9308e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254037888:12345-0@lo:13:osp-pre-0-1.0 Request processed in 146us (3101us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835070.257085:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00010000:00080000:1.0:1788835070.257207:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbf9bbb80 x1875729254037888/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835086 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835070.257225:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254037888:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788835070.437906:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835070.757927:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254039552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788835070.758068:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835070.758452:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254039552 00000100:00100000:0.0:1788835070.758462:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254039552 00000100:00100000:0.0:1788835070.758532:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788835070.758552:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254039552:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788835070.758592:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835070.758649:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254039552:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (580us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835070.758657:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788835070.758883:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254039552:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788835070.758907:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788835070.758916:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254039680:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788835070.758950:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835070.760615:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254039680 00000100:00100000:0.0:1788835070.760633:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254039680 00000100:00100000:0.0:1788835070.760720:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788835070.760732:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254039680:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788835070.760763:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835070.760931:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254039680:12345-0@lo:13:osp-pre-1-1.0 Request processed in 201us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835070.760939:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1788835070.761913:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254039680:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788835071.462268:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835071.795044:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788835071.795080:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254039808:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788835071.795188:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835071.798478:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254039808 00000100:00100000:3.0:1788835071.798501:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254039808 00000100:00100000:3.0:1788835071.798573:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788835071.798585:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254039808:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788835071.798641:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788835071.798735:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254039808:12345-0@lo:41:osp-pre-0-1.0 Request processed in 151us (3547us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835071.798755:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1788835071.798822:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254039808:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788835072.487195:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835073.509666:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788835073.576967:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:3.0:1788835073.639296:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788835074.147574:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835074.147624:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835074.147674:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835074.147770:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242419712 00000100:00100000:1.0:1788835074.147784:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242419712 00000100:00100000:1.0:1788835074.147866:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242419584 00000100:00100000:1.0:1788835074.147870:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242419584 00000100:00100000:1.0:1788835074.147898:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 230 00000100:00100000:1.0:1788835074.147910:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242419712:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835074.148016:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242419712:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 108us (391us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835074.148025:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 230 00000100:00100000:1.0:1788835074.148045:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 231 00000100:00100000:1.0:1788835074.148052:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242419584:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835074.148080:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242419584:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 28us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835074.148105:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 231 00000100:00080000:2.0:1788835074.148177:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788835074.148261:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788835074.148365:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242419456 00000100:00100000:3.0:1788835074.148371:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242419456 00000100:00100000:3.0:1788835074.148404:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 371 00000100:00100000:3.0:1788835074.148411:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:2385:x1875729242419456:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835074.148438:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fce450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:2385:x1875729242419456:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 28us (879us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835074.148445:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 371 00000100:00100000:0.0:1788835074.161161:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835074.161359:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242419840 00000100:00100000:3.0:1788835074.161374:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242419840 00000100:00100000:3.0:1788835074.161477:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:3.0:1788835074.161491:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2384:x1875729242419840:12345-192.168.203.22@tcp:9:kworker.0 00000020:00000080:3.0:1788835074.161541:0:8405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1d49 00000100:00080000:3.0:1788835074.161555:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9afdbfa5a800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788835074.161627:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00100000:3.0:1788835074.161856:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+2:2384:x1875729242419840:12345-192.168.203.22@tcp:9:kworker.0 Request processed in 367us (708us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835074.161866:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00080000:2.0:1788835074.161955:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788835074.162350:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835074.163512:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835074.163571:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835074.163667:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242419968 00000100:00100000:1.0:1788835074.163679:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242419968 00000100:00100000:1.0:1788835074.163764:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242420096 00000100:00100000:1.0:1788835074.163767:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242420096 00000100:00100000:1.0:1788835074.163795:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 232 00000100:00100000:1.0:1788835074.163805:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242419968:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835074.163891:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242419968:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 87us (393us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835074.163899:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 232 00000100:00100000:1.0:1788835074.163917:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 233 00000100:00100000:1.0:1788835074.163923:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242420096:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835074.163950:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242420096:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835074.163957:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 233 00000100:00080000:2.0:1788835074.164024:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788835074.164029:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788835074.534068:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835075.365756:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254039936:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788835075.365877:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835075.365984:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788835075.366011:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254040320:0@lo:400:kworker.0 00000100:00100000:3.0:1788835075.366044:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835075.366085:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254039936 00000100:00100000:3.0:1788835075.366095:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254039936 00000100:00100000:0.0:1788835075.366121:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254040320 00000100:00100000:0.0:1788835075.366126:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254040320 00000100:00100000:3.0:1788835075.366176:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788835075.366176:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:0.0:1788835075.366191:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254040320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835075.366194:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254039936:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788835075.366247:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835075.366272:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254040320:12345-0@lo:400:kworker.0 Request processed in 82us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835075.366281:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:3.0:1788835075.366304:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254039936:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (417us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835075.366335:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1788835075.366356:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254040192:0@lo:400:kworker.0 00000100:00080000:3.0:1788835075.366361:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788835075.366378:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254040448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788835075.366396:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835075.366413:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835075.366434:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788835075.366444:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254040064:0@lo:400:kworker.0 00000100:00100000:3.0:1788835075.366465:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254040320:0@lo:400:kworker.0 00000100:00100000:0.0:1788835075.366485:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:3.0:1788835075.366495:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfaaaa00 x1875729254039936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835075.366516:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaaaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254039936:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788835075.366528:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254040064 00000100:00100000:0.0:1788835075.366534:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254040064 00000100:00100000:3.0:1788835075.366555:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254040448 00000100:00100000:3.0:1788835075.366560:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254040448 00000100:00100000:0.0:1788835075.366582:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788835075.366593:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788835075.366594:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729254040064:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835075.366607:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254040448:12345-0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788835075.366632:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729254040064:12345-0@lo:400:kworker.0 Request processed in 42us (149us total) trans 0 rc 0/0 00000004:00000024:3.0:1788835075.366635:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:0.0:1788835075.366641:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 372 00000100:00100000:3.0:1788835075.366686:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254040448:12345-0@lo:41:osp-pre-1-0.0 Request processed in 81us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835075.366687:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254040192 00000100:00100000:0.0:1788835075.366692:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254040192 00000100:00100000:3.0:1788835075.366698:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788835075.366727:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1788835075.366735:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254040448:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788835075.366736:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254040192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835075.366769:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254040192:12345-0@lo:400:kworker.0 Request processed in 35us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835075.366775:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1788835075.366809:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254040576:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788835075.366809:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254040064:0@lo:400:kworker.0 00000100:00100000:0.0:1788835075.366828:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254040192:0@lo:400:kworker.0 00000100:00100000:1.0:1788835075.366861:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835075.367223:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729254040832:0@lo:400:kworker.0 00000100:00100000:2.0:1788835075.367273:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835075.367299:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254041344:0@lo:400:kworker.0 00000100:00100000:3.0:1788835075.367330:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254040576 00000100:00100000:3.0:1788835075.367336:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254040576 00000100:00100000:2.0:1788835075.367351:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835075.367380:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788835075.367381:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788835075.367390:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254040960:0@lo:400:kworker.0 00000100:00100000:3.0:1788835075.367393:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb930aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254040576:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788835075.367411:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788835075.367423:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835075.367450:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254041472:0@lo:400:kworker.0 00000100:00100000:3.0:1788835075.367455:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb930aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254040576:12345-0@lo:13:osp-pre-0-1.0 Request processed in 63us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835075.367463:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:3.0:1788835075.367481:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788835075.367484:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835075.367515:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254041344 00000100:00100000:2.0:1788835075.367521:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254041344 00000100:00100000:3.0:1788835075.367526:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254040832 00000100:00100000:3.0:1788835075.367531:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254040832 00000100:00100000:3.0:1788835075.367566:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254040960 00000100:00100000:3.0:1788835075.367569:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254040960 00000100:00100000:2.0:1788835075.367581:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254041472 00000100:00100000:2.0:1788835075.367586:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254041472 00000100:00100000:3.0:1788835075.367592:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788835075.367602:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729254040832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835075.367618:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788835075.367628:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254041344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835075.367644:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa22d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729254040832:12345-0@lo:400:kworker.0 Request processed in 44us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835075.367651:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1788835075.367665:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1788835075.367672:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254040960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835075.367744:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875729254041088:0@lo:400:kworker.0 00000100:00100000:0.0:1788835075.368857:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788835075.368876:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254041472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835075.369212:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa23b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254040960:12345-0@lo:400:kworker.0 Request processed in 1536us (1784us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835075.369223:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00080000:3.0:1788835075.370735:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788835075.370749:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788835075.370755:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1788835075.370869:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc836b8000 x1875729254040960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835075.371099:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254040960:0@lo:400:kworker.0 00000100:00100000:3.0:1788835075.371123:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729254040832:0@lo:400:kworker.0 00000100:00100000:3.0:1788835075.371138:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254041344:0@lo:400:kworker.0 00000100:00100000:3.0:1788835075.371199:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729254040704:0@lo:400:kworker.0 00000100:00100000:1.0:1788835075.371752:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1788835075.371930:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa2fb80 x1875729254040576/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835091 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835075.372748:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254040576:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835075.372817:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254041088 00000100:00100000:1.0:1788835075.372842:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254041088 00000100:00100000:1.0:1788835075.372915:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1788835075.372924:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875729254041088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835075.373250:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9308a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875729254041088:12345-0@lo:400:kworker.0 Request processed in 325us (1499us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835075.373260:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00080000:1.0:1788835075.373291:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788835075.373338:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875729254041088:0@lo:400:kworker.0 00000100:00100000:2.0:1788835075.373704:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa21500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254041344:12345-0@lo:400:kworker.0 Request processed in 6076us (6351us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835075.373714:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1788835075.374966:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa23100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254041472:12345-0@lo:400:kworker.0 Request processed in 6084us (7468us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835075.374979:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1788835075.375807:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254041472:0@lo:400:kworker.0 00000100:00100000:3.0:1788835075.376769:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835075.376913:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254041216:0@lo:400:kworker.0 00000100:00100000:3.0:1788835075.376964:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835075.383790:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254040704 00000100:00100000:0.0:1788835075.383811:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254040704 00000100:00100000:0.0:1788835075.383909:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254041216 00000100:00100000:0.0:1788835075.383914:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254041216 00000100:00100000:0.0:1788835075.383975:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788835075.383987:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729254040704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835075.384100:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729254040704:12345-0@lo:400:kworker.0 Request processed in 115us (7337us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835075.384107:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1788835075.384125:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1788835075.384131:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875729254041216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835075.384159:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875729254041216:12345-0@lo:400:kworker.0 Request processed in 28us (7195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835075.384164:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00080000:2.0:1788835075.384261:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788835075.384712:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729254040704:0@lo:400:kworker.0 00010000:00080000:3.0:1788835075.384732:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc836bbb80 x1875729254041216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835091 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835075.384745:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254041216:0@lo:400:kworker.0 00010000:00010000:0.0:1788835075.564129:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835075.878108:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254041600:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788835075.878215:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835075.878341:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254041600 00000100:00100000:3.0:1788835075.878352:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254041600 00000100:00100000:3.0:1788835075.878431:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788835075.878443:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254041600:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788835075.878484:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788835075.878545:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9308380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254041600:12345-0@lo:13:osp-pre-1-1.0 Request processed in 105us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835075.878554:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1788835075.878906:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254041600:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788835075.885438:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788835075.885589:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254041728:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788835075.885695:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835075.885921:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254041728 00000100:00100000:0.0:1788835075.885931:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254041728 00000100:00100000:0.0:1788835075.885996:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788835075.886007:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254041728:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788835075.886040:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835075.886111:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254041728:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (415us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835075.886120:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788835075.886306:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254041728:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1788835076.581570:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835076.904583:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254041856:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788835076.904696:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835076.904860:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254041856 00000100:00100000:3.0:1788835076.904870:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254041856 00000100:00100000:3.0:1788835076.904935:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788835076.904943:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254041856:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788835076.905000:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:3.0:1788835076.905055:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa22300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254041856:12345-0@lo:41:osp-pre-0-1.0 Request processed in 113us (361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835076.905061:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788835076.905275:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254041856:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788835077.606755:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835078.631710:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835079.262027:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835079.262191:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242420224 00000100:00100000:1.0:1788835079.262209:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242420224 00000100:00100000:1.0:1788835079.262309:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 373 00000100:00100000:1.0:1788835079.262347:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:2386:x1875729242420224:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835079.262423:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:2386:x1875729242420224:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 78us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835079.262430:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 373 00000100:00100000:0.0:1788835079.271876:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835079.271903:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835079.271929:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835079.272300:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835079.272363:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242420352 00000100:00100000:0.0:1788835079.272371:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242420352 00000100:00100000:0.0:1788835079.272426:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242420608 00000100:00100000:0.0:1788835079.272429:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242420608 00000100:00100000:0.0:1788835079.272442:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242420480 00000100:00100000:0.0:1788835079.272444:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242420480 00000100:00100000:0.0:1788835079.272454:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242420736 00000100:00100000:0.0:1788835079.272456:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242420736 00000100:00100000:0.0:1788835079.272472:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 240 00000100:00100000:0.0:1788835079.272481:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242420352:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835079.272548:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242420352:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 68us (685us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835079.272556:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 240 00000100:00100000:0.0:1788835079.272585:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 241 00000100:00100000:0.0:1788835079.272592:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242420608:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835079.272631:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242420608:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 39us (727us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835079.272638:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 241 00000100:00100000:0.0:1788835079.272652:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 242 00000100:00100000:0.0:1788835079.272658:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242420480:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835079.272678:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242420480:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 20us (748us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835079.272682:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 242 00000100:00100000:0.0:1788835079.272692:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 243 00000100:00100000:0.0:1788835079.272698:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242420736:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835079.272717:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242420736:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 20us (419us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835079.272733:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 243 00000100:00080000:0.0:1788835079.272749:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788835079.272752:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788835079.654196:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788835079.980884:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b8987b33-76f7-43a0-9448-1013c4af787f 00000020:00000080:3.0:1788835079.980896:0:9481:0:(genops.c:885:class_export_put()) final put ffff9afdbfa5b800/b8987b33-76f7-43a0-9448-1013c4af787f 00000020:00000080:1.0:1788835079.986413:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdbfa5b800/b8987b33-76f7-43a0-9448-1013c4af787f for lustre-OST0001 00000020:00000080:1.0:1788835079.986512:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afdbfa5a800 for lustre-OST0001 00000100:00100000:1.0:1788835080.485652:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1788835080.485667:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254042240:0@lo:400:kworker.0 00000100:00100000:1.0:1788835080.485676:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254042496:0@lo:400:kworker.0 00000100:00100000:2.0:1788835080.485787:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254042368:0@lo:400:kworker.0 00000100:00100000:0.0:1788835080.485799:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254042624:0@lo:400:kworker.0 00000100:00100000:1.0:1788835080.490110:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835080.491928:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254041984:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788835080.493627:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835080.493703:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254042880:0@lo:400:kworker.0 00000100:00100000:2.0:1788835080.493743:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835080.493793:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729254043392:0@lo:400:kworker.0 00000100:00100000:2.0:1788835080.493819:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835080.493859:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254043904:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788835080.493889:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835080.493920:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:2.0:1788835080.493927:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254042752:0@lo:400:kworker.0 00000100:00100000:2.0:1788835080.493950:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835080.493969:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254043264:0@lo:400:kworker.0 00000100:00100000:2.0:1788835080.493996:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835080.494016:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254043776:0@lo:400:kworker.0 00000100:00100000:2.0:1788835080.494039:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835080.494089:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254042368 00000100:00100000:2.0:1788835080.494099:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254042368 00000100:00100000:1.0:1788835080.494167:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835080.494182:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254042880 00000100:00100000:2.0:1788835080.494187:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254042880 00000100:00100000:1.0:1788835080.494216:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254042112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835080.494248:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835080.494279:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254043008:0@lo:400:kworker.0 00000100:00100000:1.0:1788835080.494304:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835080.494345:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729254043520:0@lo:400:kworker.0 00000100:00100000:1.0:1788835080.494370:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835080.494408:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254042496 00000100:00100000:1.0:1788835080.494413:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254042496 00000100:00100000:1.0:1788835080.494438:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254043904 00000100:00100000:1.0:1788835080.494441:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254043904 00000100:00100000:1.0:1788835080.494454:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254042752 00000100:00100000:1.0:1788835080.494456:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254042752 00000100:00100000:1.0:1788835080.494472:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788835080.494482:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254042496:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835080.494559:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254042496:12345-0@lo:400:kworker.0 Request processed in 78us (4465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835080.494568:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1788835080.494588:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788835080.494594:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1875729254043904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788835080.494624:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788835080.494665:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1875729254043904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 71us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835080.494671:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:1.0:1788835080.494682:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788835080.494688:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254042752:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835080.494724:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254042752:12345-0@lo:400:kworker.0 Request processed in 36us (774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835080.494731:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788835080.494911:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254043392 00000100:00100000:1.0:1788835080.494916:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254043392 00000100:00100000:1.0:1788835080.494941:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254043008 00000100:00100000:1.0:1788835080.494944:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254043008 00000100:00100000:1.0:1788835080.494955:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254043520 00000100:00100000:1.0:1788835080.495038:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254043520 00000100:00100000:1.0:1788835080.495060:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788835080.495067:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254042368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835080.495105:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254042368:12345-0@lo:400:kworker.0 Request processed in 39us (1489us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835080.495112:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1788835080.495127:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788835080.495132:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254042880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835080.495169:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254042880:12345-0@lo:400:kworker.0 Request processed in 36us (1425us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835080.495175:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1788835080.495186:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788835080.495202:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729254043392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835080.495234:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729254043392:12345-0@lo:400:kworker.0 Request processed in 42us (1414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835080.495240:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1788835080.495252:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788835080.495257:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254043008:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835080.497174:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254043008:12345-0@lo:400:kworker.0 Request processed in 1901us (2853us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835080.497205:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1788835080.497260:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788835080.497281:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729254043520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835080.497403:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82077800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729254043520:12345-0@lo:400:kworker.0 Request processed in 135us (3031us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835080.497410:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1788835080.497449:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254041984 00000100:00100000:1.0:1788835080.497459:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254041984 00000100:00100000:1.0:1788835080.497524:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254042112 00000100:00100000:1.0:1788835080.497529:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254042112 00000100:00100000:1.0:1788835080.497550:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788835080.497556:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254041984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788835080.497588:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835080.497630:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254041984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 74us (3464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835080.497636:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1788835080.497648:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788835080.497654:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254042112:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788835080.497701:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835080.497733:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82075f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254042112:12345-0@lo:13:osp-pre-0-1.0 Request processed in 79us (3485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835080.498010:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00010000:00080000:1.0:1788835080.498091:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa21f80 x1875729254043008/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835080.498129:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa21f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254043008:0@lo:400:kworker.0 00010000:00080000:1.0:1788835080.498152:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa22680 x1875729254043520/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835080.498163:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa22680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729254043520:0@lo:400:kworker.0 00000100:00100000:1.0:1788835080.498182:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa20e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254042496:0@lo:400:kworker.0 00010000:00080000:1.0:1788835080.498209:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb930a300 x1875729254041984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835080.498234:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254041984:0@lo:13:osp-pre-0-0.0 00010000:00080000:1.0:1788835080.498251:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa2c380 x1875729254042112/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835096 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835080.498267:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254042112:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835080.498438:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254043264 00000100:00100000:1.0:1788835080.498446:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254043264 00000100:00100000:1.0:1788835080.498492:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254043776 00000100:00100000:1.0:1788835080.498496:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254043776 00000100:00100000:1.0:1788835080.498523:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788835080.498531:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254043264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835080.498590:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254043264:12345-0@lo:400:kworker.0 Request processed in 59us (4593us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835080.498597:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788835080.498610:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788835080.498616:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254043776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835080.498667:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254043776:12345-0@lo:400:kworker.0 Request processed in 51us (4626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835080.498673:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:1.0:1788835080.498722:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788835080.498728:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788835080.498733:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788835080.498737:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788835080.500217:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835080.500274:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254042240 00000100:00100000:3.0:1788835080.500284:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254042240 00000100:00100000:3.0:1788835080.500374:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 374 00000100:00100000:3.0:1788835080.500384:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254042240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835080.500439:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa21c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254042752:0@lo:400:kworker.0 00000100:00100000:3.0:1788835080.500452:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254042240:12345-0@lo:400:kworker.0 Request processed in 69us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835080.500464:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 374 00010000:00080000:2.0:1788835080.500466:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa21180 x1875729254043264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835080.500484:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254043264:0@lo:400:kworker.0 00000100:00100000:2.0:1788835080.500515:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254043776:0@lo:400:kworker.0 00000100:00100000:3.0:1788835080.500518:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa20700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254042240:0@lo:400:kworker.0 00000100:00100000:2.0:1788835080.500547:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaabb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254043904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835080.500589:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa20380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254042368:0@lo:400:kworker.0 00000100:00100000:3.0:1788835080.500605:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254042880:0@lo:400:kworker.0 00000100:00100000:3.0:1788835080.500619:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa23800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729254043392:0@lo:400:kworker.0 00000100:00100000:0.0:1788835080.505862:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835080.505941:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254043136:0@lo:400:kworker.0 00000100:00100000:0.0:1788835080.505995:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835080.506033:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254043648:0@lo:400:kworker.0 00000100:00100000:0.0:1788835080.506060:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835080.506110:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254043136 00000100:00100000:0.0:1788835080.506120:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254043136 00000100:00100000:0.0:1788835080.506181:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254043648 00000100:00100000:0.0:1788835080.506184:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254043648 00000100:00100000:0.0:1788835080.506230:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788835080.506240:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254043136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835080.507850:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba758c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254043136:12345-0@lo:400:kworker.0 Request processed in 1596us (1840us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835080.507869:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788835080.508175:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1788835080.508202:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254043648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835080.508292:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254043648:12345-0@lo:400:kworker.0 Request processed in 107us (2230us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835080.508526:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254042624 00000100:00100000:2.0:1788835080.508538:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254042624 00000100:00100000:2.0:1788835080.508600:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:2.0:1788835080.508608:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254042624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835080.508654:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254042624:12345-0@lo:400:kworker.0 Request processed in 47us (2808us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835080.508662:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00080000:1.0:1788835080.509528:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788835080.509620:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa21880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254043648:0@lo:400:kworker.0 00000100:00100000:1.0:1788835080.509670:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa23480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254042624:0@lo:400:kworker.0 00010000:00080000:1.0:1788835080.509690:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa22a00 x1875729254043136/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835080.509702:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa22a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254043136:0@lo:400:kworker.0 00000100:00100000:0.0:1788835080.509744:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00010000:00010000:0.0:1788835080.677754:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835081.001182:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254044032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788835081.001337:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835081.001516:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254044032 00000100:00100000:0.0:1788835081.001527:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254044032 00000100:00100000:0.0:1788835081.001631:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788835081.001643:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb930b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254044032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788835081.001686:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835081.001751:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb930b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254044032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 111us (414us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835081.001760:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1788835081.002240:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254044032:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788835081.004350:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788835081.004377:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254044160:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788835081.004468:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835081.004604:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254044160 00000100:00100000:3.0:1788835081.004615:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254044160 00000100:00100000:3.0:1788835081.004687:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1788835081.004700:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb9308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254044160:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788835081.004737:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788835081.004832:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb9308000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254044160:12345-0@lo:13:osp-pre-1-1.0 Request processed in 133us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835081.004842:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788835081.005660:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254044160:0@lo:13:osp-pre-1-1.0 00010000:00010000:0.0:1788835081.705411:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835082.027710:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254044288:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788835082.027862:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835082.031933:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254044288 00000100:00100000:1.0:1788835082.031962:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254044288 00000100:00100000:1.0:1788835082.032105:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788835082.032120:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254044288:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788835082.033942:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:0.0:1788835082.034369:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254044288:12345-0@lo:41:osp-pre-0-1.0 Request processed in 2246us (6501us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835082.034383:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788835082.037797:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254044288:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788835082.728105:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835083.749924:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788835083.814382:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788835083.881725:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788835084.395109:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835084.398592:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835084.398629:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835084.398648:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835084.398734:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835084.398771:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242420992 00000100:00100000:0.0:1788835084.398784:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242420992 00000100:00100000:0.0:1788835084.398849:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242421248 00000100:00100000:0.0:1788835084.398853:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242421248 00000100:00100000:0.0:1788835084.398869:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242421120 00000100:00100000:0.0:1788835084.398871:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242421120 00000100:00100000:0.0:1788835084.398883:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242421376 00000100:00100000:0.0:1788835084.398886:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242421376 00000100:00100000:3.0:1788835084.399070:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 250 00000100:00100000:3.0:1788835084.399084:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242420992:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835084.399180:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242420992:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 100us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835084.399188:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 250 00000100:00100000:3.0:1788835084.399205:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 251 00000100:00100000:3.0:1788835084.399212:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242421248:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835084.399239:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242421248:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (609us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835084.399245:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 251 00000100:00100000:3.0:1788835084.399257:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 252 00000100:00100000:3.0:1788835084.399263:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242421120:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835084.399287:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242421120:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 24us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835084.399293:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 252 00000100:00100000:2.0:1788835084.399454:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242420864 00000100:00100000:2.0:1788835084.399460:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242420864 00000100:00100000:2.0:1788835084.399495:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 375 00000100:00100000:2.0:1788835084.399503:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:2385:x1875729242420864:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835084.399533:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:2385:x1875729242420864:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 31us (4435us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835084.399540:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 375 00000100:00100000:0.0:1788835084.400042:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 253 00000100:00100000:0.0:1788835084.400052:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242421376:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835084.400086:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242421376:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 37us (1352us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835084.400105:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 253 00000100:00080000:3.0:1788835084.400612:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788835084.400620:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1788835084.774013:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835085.605814:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788835085.605854:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb930a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254044416:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835085.605992:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835085.606110:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254044416 00000100:00100000:1.0:1788835085.606122:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254044416 00000100:00100000:1.0:1788835085.606217:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788835085.606231:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254044416:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788835085.606275:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835085.606358:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa22a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254044416:12345-0@lo:13:osp-pre-0-1.0 Request processed in 130us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835085.606367:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00080000:1.0:1788835085.606394:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1788835085.606712:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb930a300 x1875729254044416/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835085.606739:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb930a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254044416:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788835085.606951:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788835085.606965:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254044544:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788835085.607017:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835085.611559:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254044544 00000100:00100000:2.0:1788835085.611596:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254044544 00000100:00100000:3.0:1788835085.611617:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254045056:0@lo:400:kworker.0 00000100:00100000:2.0:1788835085.611668:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788835085.611687:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254044544:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788835085.611741:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788835085.611831:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835085.613740:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254045056 00000100:00100000:0.0:1788835085.613758:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254045056 00000100:00100000:0.0:1788835085.613830:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1788835085.613842:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254045056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835085.614036:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254044672:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788835085.616325:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254044544:12345-0@lo:41:osp-pre-1-0.0 Request processed in 4620us (9280us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835085.616346:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788835085.617721:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254045568:0@lo:400:kworker.0 00000100:00100000:3.0:1788835085.617819:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835085.617853:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254046080:0@lo:400:kworker.0 00000100:00100000:3.0:1788835085.617891:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835085.619156:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254045056:12345-0@lo:400:kworker.0 Request processed in 5307us (7316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835085.619184:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1788835085.619344:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788835085.619364:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254044928:0@lo:400:kworker.0 00000100:00100000:3.0:1788835085.619418:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835085.619470:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875729254045440:0@lo:400:kworker.0 00000100:00100000:3.0:1788835085.619629:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835085.619664:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254045952:0@lo:400:kworker.0 00000100:00100000:3.0:1788835085.619694:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835085.619755:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254045056:0@lo:400:kworker.0 00000100:00100000:3.0:1788835085.619816:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254045568 00000100:00100000:3.0:1788835085.619825:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254045568 00000100:00100000:3.0:1788835085.619901:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254046080 00000100:00100000:3.0:1788835085.620586:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254046080 00000100:00100000:3.0:1788835085.620620:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254045952 00000100:00100000:3.0:1788835085.620623:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254045952 00000100:00100000:3.0:1788835085.620642:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788835085.620652:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254045568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835085.620742:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254045568:12345-0@lo:400:kworker.0 Request processed in 91us (2922us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835085.620750:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788835085.620768:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788835085.620782:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254046080:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835085.620819:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254046080:12345-0@lo:400:kworker.0 Request processed in 38us (2928us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835085.620825:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788835085.620837:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788835085.620843:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254045952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835085.620873:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254045952:12345-0@lo:400:kworker.0 Request processed in 31us (1178us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835085.620880:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788835085.621598:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254044928 00000100:00100000:3.0:1788835085.621613:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254044928 00000100:00100000:3.0:1788835085.621676:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254045440 00000100:00100000:3.0:1788835085.621680:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254045440 00000100:00100000:3.0:1788835085.621716:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788835085.621725:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254044928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835085.621797:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254044928:12345-0@lo:400:kworker.0 Request processed in 73us (2379us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835085.621804:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1788835085.621820:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788835085.621826:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875729254045440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835085.621856:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875729254045440:12345-0@lo:400:kworker.0 Request processed in 30us (2361us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835085.621861:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1788835085.621936:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254044928:0@lo:400:kworker.0 00010000:00080000:3.0:1788835085.622638:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa2f480 x1875729254045440/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835085.622671:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875729254045440:0@lo:400:kworker.0 00000100:00100000:3.0:1788835085.622691:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254045952:0@lo:400:kworker.0 00010000:00080000:3.0:1788835085.622708:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa2c380 x1875729254045568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835085.622716:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254045568:0@lo:400:kworker.0 00000100:00100000:3.0:1788835085.622730:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254046080:0@lo:400:kworker.0 00000100:00080000:3.0:1788835085.622811:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788835085.622820:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788835085.622824:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788835085.630630:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835085.630888:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254044672 00000100:00100000:3.0:1788835085.630903:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254044672 00000100:00100000:3.0:1788835085.631002:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1788835085.631017:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254044672:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788835085.631059:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788835085.631146:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa23480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254044672:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (529us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835085.631155:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00010000:00080000:1.0:1788835085.631182:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa3a680 x1875729254044672/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835085.631210:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254044672:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788835085.631228:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729254044800:0@lo:400:kworker.0 00000100:00100000:1.0:1788835085.631278:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835085.631310:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875729254045312:0@lo:400:kworker.0 00000100:00100000:1.0:1788835085.631361:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835085.631388:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875729254045824:0@lo:400:kworker.0 00000100:00100000:3.0:1788835085.631423:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254044800 00000100:00100000:3.0:1788835085.631428:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254044800 00000100:00100000:1.0:1788835085.631446:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835085.631462:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788835085.631469:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3615:x1875729254044800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835085.633360:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254044544:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788835085.633430:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1788835085.633441:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254045184:0@lo:400:kworker.0 00000100:00100000:3.0:1788835085.635720:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3615:x1875729254044800:12345-0@lo:400:kworker.0 Request processed in 4234us (4424us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835085.635741:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 376 00000100:00100000:3.0:1788835085.636421:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254045312 00000100:00100000:3.0:1788835085.636432:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254045312 00000100:00100000:3.0:1788835085.636572:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254045824 00000100:00100000:3.0:1788835085.636577:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254045824 00000100:00100000:3.0:1788835085.636611:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788835085.636621:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875729254045312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835085.636710:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa21880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875729254045312:12345-0@lo:400:kworker.0 Request processed in 89us (5346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835085.636718:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1788835085.636733:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1788835085.636739:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875729254045824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835085.636771:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa21500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875729254045824:12345-0@lo:400:kworker.0 Request processed in 33us (5324us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835085.636777:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00080000:3.0:1788835085.636815:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788835085.636823:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788835085.637483:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835085.637541:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254045696:0@lo:400:kworker.0 00000100:00100000:1.0:1788835085.637582:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835085.637618:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254045184 00000100:00100000:1.0:1788835085.637624:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254045184 00000100:00100000:1.0:1788835085.637662:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254045696 00000100:00100000:1.0:1788835085.637666:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254045696 00000100:00100000:1.0:1788835085.637708:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788835085.637716:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254045184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835085.637756:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa23100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254045184:12345-0@lo:400:kworker.0 Request processed in 41us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835085.637763:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1788835085.637779:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1788835085.637786:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729254045696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835085.637815:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa23800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729254045696:12345-0@lo:400:kworker.0 Request processed in 29us (234us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835085.637821:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00080000:1.0:1788835085.637850:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788835085.637893:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254045696:0@lo:400:kworker.0 00000100:00100000:1.0:1788835085.637908:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729254044800:0@lo:400:kworker.0 00000100:00100000:1.0:1788835085.637922:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875729254045312:0@lo:400:kworker.0 00010000:00080000:1.0:1788835085.637965:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc836bb800 x1875729254045824/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835085.637977:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875729254045824:0@lo:400:kworker.0 00000100:00100000:1.0:1788835085.638015:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254045184:0@lo:400:kworker.0 00010000:00010000:1.0:1788835085.797601:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835086.117544:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254046208:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788835086.117622:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835086.117694:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788835086.117700:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254046336:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788835086.117722:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835086.117884:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254046208 00000100:00100000:2.0:1788835086.117892:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254046208 00000100:00100000:2.0:1788835086.117954:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254046336 00000100:00100000:2.0:1788835086.117958:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254046336 00000100:00100000:2.0:1788835086.117982:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788835086.117994:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254046208:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788835086.118028:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788835086.118089:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254046208:12345-0@lo:13:osp-pre-1-1.0 Request processed in 97us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835086.118096:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1788835086.118125:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788835086.118132:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254046336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1788835086.118143:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788835086.118181:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254046336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 50us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835086.118187:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1788835086.118229:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa20000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254046336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788835086.118244:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254046208:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788835086.821972:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835087.141944:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788835087.141985:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254046464:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788835087.142067:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835087.142301:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254046464 00000100:00100000:2.0:1788835087.142347:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254046464 00000100:00100000:2.0:1788835087.142434:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788835087.142443:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254046464:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788835087.142473:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:2.0:1788835087.142531:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa20380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254046464:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835087.142539:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1788835087.142608:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254046464:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788835087.845784:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788835088.601728:0:14029:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:38:07 (1788835087) 00010000:00010000:1.0:1788835088.869726:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835089.513099:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835089.513160:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835089.513191:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835089.513221:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835089.513246:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835089.513367:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242421504 00000100:00100000:3.0:1788835089.513370:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242421760 00000100:00100000:2.0:1788835089.513378:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242421504 00000100:00100000:3.0:1788835089.513385:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242421760 00000100:00100000:2.0:1788835089.513449:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 377 00000100:00100000:2.0:1788835089.513461:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:2387:x1875729242421504:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835089.513470:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242422016 00000100:00100000:3.0:1788835089.513476:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242422016 00000100:00100000:3.0:1788835089.513523:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242421632 00000100:00100000:3.0:1788835089.513527:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242421632 00000100:00100000:2.0:1788835089.513537:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:2387:x1875729242421504:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 76us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835089.513545:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242421888 00000100:00100000:2.0:1788835089.513551:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 377 00000100:00100000:3.0:1788835089.513552:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242421888 00000100:00100000:3.0:1788835089.513586:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 260 00000100:00100000:3.0:1788835089.513599:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+5:2387:x1875729242421760:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835089.513626:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 261 00000100:00100000:2.0:1788835089.513639:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2387:x1875729242422016:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835089.513678:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+5:2387:x1875729242421760:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 82us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835089.513690:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2387:x1875729242422016:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 49us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835089.513699:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 260 00000100:00100000:2.0:1788835089.513711:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 261 00000100:00100000:3.0:1788835089.513730:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 262 00000100:00100000:2.0:1788835089.513743:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 263 00000100:00100000:2.0:1788835089.513755:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2387:x1875729242421888:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835089.513779:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa41180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2387:x1875729242421888:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 28us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835089.513785:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 263 00000100:00080000:0.0:1788835089.513858:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788835089.513864:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788835089.514359:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+5:2387:x1875729242421632:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835089.514427:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83687b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+5:2387:x1875729242421632:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 686us (1204us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835089.514436:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 262 00010000:00010000:3.0:1788835089.897144:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835090.727691:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254046976:0@lo:400:kworker.0 00000100:00100000:3.0:1788835090.727793:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835090.727925:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729254047488:0@lo:400:kworker.0 00000100:00100000:3.0:1788835090.727980:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835090.728002:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254048000:0@lo:400:kworker.0 00000100:00100000:3.0:1788835090.728026:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835090.728059:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [3->2] 00000100:00100000:3.0:1788835090.728065:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254046592:0@lo:400:kworker.0 00000100:00100000:3.0:1788835090.728096:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835090.728118:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729254047104:0@lo:400:kworker.0 00000100:00100000:3.0:1788835090.728174:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835090.728206:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254047616:0@lo:400:kworker.0 00000100:00100000:3.0:1788835090.728231:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835090.728247:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254048128:0@lo:400:kworker.0 00000100:00100000:3.0:1788835090.728268:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835090.728301:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254046976 00000100:00100000:3.0:1788835090.728309:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254046976 00000100:00100000:3.0:1788835090.728402:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788835090.728413:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254046976:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835090.728479:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254046976:12345-0@lo:400:kworker.0 Request processed in 67us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835090.728488:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1788835090.728515:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254046592 00000100:00100000:3.0:1788835090.728519:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254046592 00000100:00100000:3.0:1788835090.728548:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788835090.728554:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254046592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835090.728584:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254046592:12345-0@lo:400:kworker.0 Request processed in 30us (488us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835090.728590:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 378 00000100:00100000:3.0:1788835090.728622:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254047488 00000100:00100000:3.0:1788835090.728625:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254047488 00000100:00100000:3.0:1788835090.728662:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254048000 00000100:00100000:3.0:1788835090.728665:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254048000 00000100:00100000:3.0:1788835090.728683:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254047104 00000100:00100000:3.0:1788835090.728686:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254047104 00000100:00100000:3.0:1788835090.728701:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788835090.728707:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729254047488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835090.728749:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729254047488:12345-0@lo:400:kworker.0 Request processed in 42us (768us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835090.728754:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1788835090.728766:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788835090.728771:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254048000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835090.728794:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254048000:12345-0@lo:400:kworker.0 Request processed in 23us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835090.728800:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1788835090.728808:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788835090.728813:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729254047104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835090.728834:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729254047104:12345-0@lo:400:kworker.0 Request processed in 21us (660us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835090.728840:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1788835090.728860:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254047616 00000100:00100000:3.0:1788835090.728863:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254047616 00000100:00100000:3.0:1788835090.728886:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254048128 00000100:00100000:3.0:1788835090.728890:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254048128 00000100:00100000:3.0:1788835090.728909:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788835090.728916:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254047616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835090.728945:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254047616:12345-0@lo:400:kworker.0 Request processed in 30us (714us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835090.728951:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1788835090.728961:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788835090.728966:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254048128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835090.728990:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254048128:12345-0@lo:400:kworker.0 Request processed in 24us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835090.729004:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1788835090.729056:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788835090.729061:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788835090.729064:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788835090.729093:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa39880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254046592:0@lo:400:kworker.0 00000100:00100000:3.0:1788835090.729108:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa39500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729254047104:0@lo:400:kworker.0 00010000:00080000:3.0:1788835090.729122:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa38700 x1875729254047616/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835090.729147:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa38700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254047616:0@lo:400:kworker.0 00000100:00100000:3.0:1788835090.729158:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254048128:0@lo:400:kworker.0 00000100:00100000:3.0:1788835090.729167:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254046976:0@lo:400:kworker.0 00010000:00080000:3.0:1788835090.729176:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa3a300 x1875729254047488/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835090.729183:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa3a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729254047488:0@lo:400:kworker.0 00010000:00080000:3.0:1788835090.729192:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa39180 x1875729254048000/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835090.729201:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa39180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254048000:0@lo:400:kworker.0 00000100:00100000:1.0:1788835090.732489:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729254046720:0@lo:400:kworker.0 00000100:00100000:1.0:1788835090.732567:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835090.732623:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254047232:0@lo:400:kworker.0 00000100:00100000:1.0:1788835090.732651:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835090.732673:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254047744:0@lo:400:kworker.0 00000100:00100000:1.0:1788835090.732697:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835090.732716:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254048256:0@lo:400:kworker.0 00000100:00100000:1.0:1788835090.732738:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835090.732764:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788835090.732771:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254046848:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788835090.734366:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835090.734423:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729254047360:0@lo:400:kworker.0 00000100:00100000:1.0:1788835090.734473:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835090.734513:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875729254047872:0@lo:400:kworker.0 00000100:00100000:1.0:1788835090.734537:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835090.734558:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254048384:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835090.734586:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835090.735875:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254047232 00000100:00100000:1.0:1788835090.735901:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254047232 00000100:00100000:1.0:1788835090.735947:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254046848 00000100:00100000:1.0:1788835090.735951:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254046848 00000100:00100000:1.0:1788835090.735967:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788835090.735975:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729254047232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835090.736053:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa20700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729254047232:12345-0@lo:400:kworker.0 Request processed in 78us (3401us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835090.736059:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788835090.736076:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788835090.736082:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254046848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788835090.736107:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788835090.736161:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa21f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254046848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 76us (3366us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835090.736169:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1788835090.736541:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254046720 00000100:00100000:0.0:1788835090.736554:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254046720 00000100:00100000:1.0:1788835090.736769:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254048384 00000100:00100000:1.0:1788835090.736776:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254048384 00000100:00100000:1.0:1788835090.736838:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788835090.736846:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254048384:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788835090.736868:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835090.736916:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254048384:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (2329us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835090.736922:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788835090.738080:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254047360 00000100:00100000:1.0:1788835090.738088:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254047360 00000100:00100000:1.0:1788835090.738150:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254047872 00000100:00100000:1.0:1788835090.738154:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254047872 00000100:00100000:1.0:1788835090.738173:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788835090.738182:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729254046720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835090.738436:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729254046720:12345-0@lo:400:kworker.0 Request processed in 251us (5865us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835090.738446:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1788835090.738479:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788835090.738492:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729254047360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835090.738528:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa20000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729254047360:12345-0@lo:400:kworker.0 Request processed in 44us (4055us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835090.738535:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788835090.738547:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788835090.738553:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb930a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875729254047872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835090.738581:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb930a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875729254047872:12345-0@lo:400:kworker.0 Request processed in 29us (4043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835090.738587:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1788835090.738636:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254046848:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788835090.738649:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729254047360:0@lo:400:kworker.0 00000100:00100000:1.0:1788835090.738658:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875729254047872:0@lo:400:kworker.0 00010000:00080000:1.0:1788835090.738671:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa21180 x1875729254048384/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835090.738683:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa21180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254048384:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835090.738707:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa38a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729254046720:0@lo:400:kworker.0 00000100:00100000:1.0:1788835090.738716:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254047232:0@lo:400:kworker.0 00000100:00100000:2.0:1788835090.739001:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788835090.739033:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254048512:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788835090.739911:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788835090.740023:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788835090.740061:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254048512 00000100:00100000:2.0:1788835090.740068:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254048512 00000100:00100000:2.0:1788835090.740213:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1788835090.740224:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254048512:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788835090.740258:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788835090.740330:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254048512:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835090.740339:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00010000:00080000:2.0:1788835090.740395:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa3bb80 x1875729254048512/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835090.740413:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254047744 00000100:00100000:2.0:1788835090.740421:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254048512:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788835090.740431:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254047744 00000100:00080000:2.0:1788835090.740453:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788835090.740467:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254048256 00000100:00100000:2.0:1788835090.740472:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254048256 00000100:00100000:1.0:1788835090.740507:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1788835090.740524:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254047744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835090.740538:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788835090.740548:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254048256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835090.740614:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa22680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254048256:12345-0@lo:400:kworker.0 Request processed in 68us (7874us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835090.740622:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1788835090.740639:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa20e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254047744:12345-0@lo:400:kworker.0 Request processed in 115us (7933us total) trans 0 rc 0/0 00000100:00080000:2.0:1788835090.740645:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788835090.740650:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00010000:00080000:1.0:1788835090.740724:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa38380 x1875729254047744/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835090.740740:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254047744:0@lo:400:kworker.0 00000100:00100000:1.0:1788835090.740773:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa38e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254048256:0@lo:400:kworker.0 00000100:00100000:0.0:1788835090.800700:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835090.800831:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242422144 00000100:00100000:1.0:1788835090.800844:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242422144 00000100:00100000:1.0:1788835090.800929:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:1.0:1788835090.800942:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+5:11045:x1875729242422144:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788835090.800979:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835090.801014:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d1e29 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae04c9 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835090.801099:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d1e30 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835090.801116:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d1e30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835090.801165:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d1e30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835090.801242:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788835090.801248:0:9047:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835090.801299:0:9047:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d1e30 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835090.801379:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d1e29 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04c9 expref: 7 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835090.801402:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d1e30 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04c9 expref: 6 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835090.801412:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afd93eb1500) 00010000:00010000:1.0:1788835090.801415:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788835090.801419:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60600, rc 0) 00000100:00100000:1.0:1788835090.801491:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa41500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+6:11045:x1875729242422144:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 552us (809us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835090.801500:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:2.0:1788835090.839577:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835090.839759:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242422272 00000100:00100000:3.0:1788835090.839773:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242422272 00000100:00100000:3.0:1788835090.839850:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:3.0:1788835090.839862:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+6:11046:x1875729242422272:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788835090.839888:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835090.839934:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d1e37 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae04d0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.840255:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1e3e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.840276:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1e3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.840291:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1e3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.840455:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d1e45 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.840465:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d1e45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.840473:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d1e45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.840554:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a000/0xdf60171e5a5d1e4c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.840563:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a000/0xdf60171e5a5d1e4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.840570:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a000/0xdf60171e5a5d1e4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835090.840621:0:9806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:3.0:1788835090.840626:0:9806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788835090.841079:0:9806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a000/0xdf60171e5a5d1e4c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.841105:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1e3e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.841113:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1e3e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.841120:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1e3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.841137:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204bc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835090.841143:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1e3e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.841151:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1e3e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.841167:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afd93eb1500) 00010000:00010000:3.0:1788835090.841170:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835090.841175:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1e3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.841193:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1e3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.841212:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d1e45 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.841218:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d1e45 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.841225:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d1e45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.841238:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204ae00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835090.841241:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d1e45 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.841248:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d1e45 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.841258:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9afc810b8800) 00010000:00010000:3.0:1788835090.841261:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835090.841264:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d1e45 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.841270:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d1e45 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.841381:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d1e37 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04d0 expref: 8 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.841399:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a000/0xdf60171e5a5d1e4c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04d0 expref: 7 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835090.841408:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9afc810b8400) 00010000:00010000:3.0:1788835090.841410:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788835090.841413:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204a000, rc 0) 00000100:00100000:3.0:1788835090.841572:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+7:11046:x1875729242422272:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 1712us (2010us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835090.841581:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:0.0:1788835090.865728:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835090.865966:0:6498:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242422400 00000100:00100000:3.0:1788835090.866010:0:6498:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242422400 00000100:00100000:3.0:1788835090.866093:0:6498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:3.0:1788835090.866106:0:6498:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b8987b33-76f7-43a0-9448-1013c4af787f+7:11046:x1875729242422400:12345-192.168.203.22@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1788835090.866238:0:6498:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa43b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b8987b33-76f7-43a0-9448-1013c4af787f+7:11046:x1875729242422400:12345-192.168.203.22@tcp:900:lhsmtool_posix.0 Request processed in 134us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835090.866256:0:6498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:1.0:1788835090.873020:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835090.873153:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242422656 00000100:00100000:0.0:1788835090.873167:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242422656 00000100:00100000:0.0:1788835090.873264:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:0.0:1788835090.873277:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+7:11046:x1875729242422656:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788835090.873387:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835090.873418:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d1e53 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae04d7 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.873526:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1e5a lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.873545:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1e5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.873560:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1e5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.875745:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d1e61 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.875774:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d1e61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.875789:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d1e61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.877524:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1e68 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.877545:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1e68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.877558:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1e68 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788835090.877577:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:0.0:1788835090.877729:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1e5a lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.877737:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1e5a lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.877745:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1e5a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.877752:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835090.877756:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1e5a lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.877764:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1e5a lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.877779:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9afc810b8400) 00010000:00010000:0.0:1788835090.877782:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835090.877787:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1e5a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.877793:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1e5a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.877811:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d1e61 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.877818:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d1e61 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.877824:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d1e61 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.877841:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4400 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835090.877844:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d1e61 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.877849:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d1e61 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.877858:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9afc835ccd00) 00010000:00010000:0.0:1788835090.877860:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835090.877863:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d1e61 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.877868:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d1e61 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.888765:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d1e53 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04d7 expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.888801:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1e68 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04d7 expref: 9 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835090.888811:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afc835ccc00) 00010000:00010000:0.0:1788835090.888815:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835090.888818:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f4800, rc 0) 00000100:00100000:0.0:1788835090.888909:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+9:11046:x1875729242422656:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 15634us (15905us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788835090.888920:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:2.0:1788835090.893580:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835090.893717:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242422784 00000100:00100000:0.0:1788835090.893748:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242422784 00000100:00100000:0.0:1788835090.893822:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:0.0:1788835090.893834:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+9:11046:x1875729242422784:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788835090.893960:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+9:11046:x1875729242422784:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 Request processed in 127us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835090.893968:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:2.0:1788835090.901117:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835090.901664:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242422912 00000100:00100000:3.0:1788835090.901678:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242422912 00000100:00100000:3.0:1788835090.901775:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:3.0:1788835090.901789:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+5:11046:x1875729242422912:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 00000004:00080000:2.0:1788835090.907004:0:9806:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 5146us 00010000:00010000:3.0:1788835090.918631:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835090.923653:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+5:11046:x1875729242422912:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 Request processed in 21838us (22527us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835090.923673:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00000040:00080000:1.0:1788835090.982218:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788835091.046068:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788835091.237529:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1788835091.237557:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254048640:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788835091.237646:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835091.237728:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254048768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788835091.237737:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254048640 00000100:00100000:1.0:1788835091.237747:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254048640 00000100:00100000:3.0:1788835091.237756:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835091.237806:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254048768 00000100:00100000:1.0:1788835091.237810:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254048768 00000100:00100000:1.0:1788835091.237830:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1788835091.237841:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254048640:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788835091.237847:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788835091.237862:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254048768:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788835091.237906:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00002000:00000024:1.0:1788835091.237906:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788835091.237979:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254048768:12345-0@lo:13:osp-pre-1-1.0 Request processed in 121us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835091.237988:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:2.0:1788835091.251583:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254048640:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788835091.251625:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254048768:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788835091.252239:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254048640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 14395us (14587us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835091.252254:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00010000:00010000:1.0:1788835091.945579:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835092.261510:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788835092.261541:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254048896:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788835092.261636:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835092.261783:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254048896 00000100:00100000:1.0:1788835092.261792:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254048896 00000100:00100000:1.0:1788835092.261867:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788835092.261887:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaaf3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254048896:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788835092.261932:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446305792 avail 1300066304 00000100:00100000:1.0:1788835092.261997:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaaf3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254048896:12345-0@lo:41:osp-pre-0-1.0 Request processed in 120us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835092.262005:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788835092.262054:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa43800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254048896:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788835092.965923:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788835093.030193:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:1.0:1788835093.093975:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788835093.638408:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835093.639090:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242423040 00000100:00100000:3.0:1788835093.639118:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242423040 00000100:00100000:3.0:1788835093.639207:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:3.0:1788835093.639221:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+9:11089:x1875729242423040:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788835093.639243:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835093.639263:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d1e76 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae04de expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.639364:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d1e7d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.639392:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d1e7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.639404:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d1e7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.639420:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1e84 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.639427:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1e84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.639434:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1e84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.639476:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d1e7d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.639484:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d1e7d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.639491:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d1e7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.639496:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204b800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835093.639500:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d1e7d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.639509:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d1e7d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.639521:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afd93eb1500) 00000100:00080000:2.0:1788835093.640062:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788835093.640120:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835093.640126:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d1e7d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.640133:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d1e7d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.640150:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1e84 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.640155:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1e84 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.640162:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1e84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.640307:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204bc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835093.640311:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1e84 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.640406:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1e84 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.640418:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9afdb2e6e900) 00010000:00010000:3.0:1788835093.640421:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835093.640425:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1e84 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.640432:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1e84 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.640474:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d1e76 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04de expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.640498:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afd93eb1500) 00010000:00010000:3.0:1788835093.640501:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835093.640507:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d1e76 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04de expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835093.640523:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204ae00, rc 0) 00000100:00100000:3.0:1788835093.640660:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+9:11089:x1875729242423040:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1442us (2268us total) trans 0 rc 301/301 00000100:00100000:3.0:1788835093.640668:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:0.0:1788835093.649710:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835093.651904:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242423296 00000100:00100000:2.0:1788835093.651938:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242423296 00000100:00100000:2.0:1788835093.652042:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:2.0:1788835093.652055:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+9:11089:x1875729242423296:12345-192.168.203.22@tcp:36:lfs.0 00010000:00010000:2.0:1788835093.652146:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835093.652185:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d1e30 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04c9 expref: 9 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.652211:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afd93eb1500) 00010000:00010000:2.0:1788835093.652224:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788835093.652306:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1e8b lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.652365:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1e8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.652379:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1e8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.652416:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62000/0xdf60171e5a5d1e92 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.652425:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62000/0xdf60171e5a5d1e92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.652433:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62000/0xdf60171e5a5d1e92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.653078:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1e99 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.653091:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1e99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.653099:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1e99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788835093.653128:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000034f589c reply state 00000000e6ac6ff3 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1e99 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.653140:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1e99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.653148:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:2.0:1788835093.653151:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788835093.653154:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788835093.653160:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788835093.653168:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1e8b lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.653175:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1e8b lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.653192:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1e8b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.653199:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e63200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835093.653205:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1e8b lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.653214:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1e8b lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.653225:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afda01ec700) 00010000:00010000:2.0:1788835093.653228:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835093.653231:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1e8b lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.653238:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1e8b lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788835093.653255:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000034f589c reply state 00000000e6ac6ff3 transno 4294967312 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62000/0xdf60171e5a5d1e92 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.653263:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62000/0xdf60171e5a5d1e92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.653270:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9afda01eca00) 00010000:00010000:2.0:1788835093.653272:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788835093.653274:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788835093.653454:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83dec380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+10:11089:x1875729242423296:12345-192.168.203.22@tcp:36:lfs.0 Request processed in 1399us (3751us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1788835093.653463:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:0.0:1788835093.719778:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835093.719906:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242423424 00000100:00100000:1.0:1788835093.719920:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242423424 00000100:00100000:1.0:1788835093.719997:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:1.0:1788835093.720008:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+10:11097:x1875729242423424:12345-192.168.203.22@tcp:101:lctl.0 00010000:00010000:1.0:1788835093.720040:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835093.720071:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d1ea0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae04e5 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835093.720232:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d1ea7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835093.720271:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d1ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835093.720285:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d1ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835093.720386:0:9806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788835093.720390:0:9806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835093.720438:0:9806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d1ea7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835093.720468:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d1ea0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04e5 expref: 12 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835093.720490:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d1ea7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04e5 expref: 11 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835093.720500:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afdba168f00) 00010000:00010000:1.0:1788835093.720503:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788835093.720507:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60e00, rc 0) 00000100:00100000:1.0:1788835093.720579:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83dedc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+11:11097:x1875729242423424:12345-192.168.203.22@tcp:101:lctl.0 Request processed in 573us (820us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835093.720588:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:3.0:1788835093.772624:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835093.772757:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242423552 00000100:00100000:2.0:1788835093.772773:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242423552 00000100:00100000:2.0:1788835093.772858:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:2.0:1788835093.772870:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+11:11103:x1875729242423552:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1788835093.772905:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835093.772936:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1eae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae04ec expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773029:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63e00/0xdf60171e5a5d1eb5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773048:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63e00/0xdf60171e5a5d1eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773062:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63e00/0xdf60171e5a5d1eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773074:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1ebc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773081:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1ebc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773087:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1ebc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773201:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63000/0xdf60171e5a5d1ec3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773208:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63000/0xdf60171e5a5d1ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773234:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63000/0xdf60171e5a5d1ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835093.773276:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788835093.773281:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788835093.773359:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63000/0xdf60171e5a5d1ec3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773375:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63e00/0xdf60171e5a5d1eb5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773382:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63e00/0xdf60171e5a5d1eb5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773390:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63e00/0xdf60171e5a5d1eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773398:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e63e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835093.773403:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63e00/0xdf60171e5a5d1eb5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773412:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63e00/0xdf60171e5a5d1eb5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773427:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afdba168f00) 00010000:00010000:2.0:1788835093.773430:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835093.773437:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63e00/0xdf60171e5a5d1eb5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773443:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63e00/0xdf60171e5a5d1eb5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773474:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1ebc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773480:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1ebc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773486:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1ebc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773491:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e63a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835093.773494:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1ebc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773500:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1ebc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773507:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9afda01eca00) 00010000:00010000:2.0:1788835093.773510:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835093.773513:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1ebc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773518:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63a00/0xdf60171e5a5d1ebc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773547:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63200/0xdf60171e5a5d1eae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04ec expref: 13 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773563:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63000/0xdf60171e5a5d1ec3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04ec expref: 12 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.773583:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:2.0:1788835093.773586:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1788835093.773589:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e63000, rc 0) 00000100:00100000:2.0:1788835093.773686:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+12:11103:x1875729242423552:12345-192.168.203.22@tcp:101:bash.0 Request processed in 818us (1080us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835093.773694:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:0.0:1788835093.789345:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835093.789496:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242423808 00000100:00100000:2.0:1788835093.789510:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242423808 00000100:00100000:2.0:1788835093.789687:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:2.0:1788835093.789700:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+12:11103:x1875729242423808:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1788835093.789732:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835093.789773:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62c00/0xdf60171e5a5d1eca lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae04f3 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.789938:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1ed1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.789957:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1ed1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.789971:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1ed1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.791599:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d1ed8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.791626:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d1ed8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.791661:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d1ed8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788835093.792142:0:6488:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x2:0x0], index 0: 0 00010000:00010000:2.0:1788835093.792362:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d1edf lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.792385:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d1edf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.792394:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d1edf lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.792440:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1ed1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.792448:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1ed1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.792454:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1ed1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.792460:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374cc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835093.792464:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1ed1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.792471:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1ed1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.792486:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:2.0:1788835093.792489:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835093.792503:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1ed1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.792510:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1ed1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788835093.792525:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002b78452b reply state 000000001a1fcb76 transno 4294967313 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d1ed8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.792535:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d1ed8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.792541:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afda01ec700) 00010000:00010000:2.0:1788835093.792543:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788835093.792546:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788835093.792585:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62c00/0xdf60171e5a5d1eca lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04f3 expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.792600:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d1edf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04f3 expref: 14 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.792608:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ec900) 00010000:00010000:2.0:1788835093.792610:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788835093.792612:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374d000, rc 0) 00000100:00100000:2.0:1788835093.792703:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83def800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+15:11103:x1875729242423808:12345-192.168.203.22@tcp:101:bash.0 Request processed in 3004us (3403us total) trans 4294967313 rc 0/0 00000100:00100000:2.0:1788835093.792713:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:2.0:1788835093.801782:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835093.803846:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242423936 00000100:00100000:1.0:1788835093.803868:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242423936 00000100:00100000:1.0:1788835093.803948:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:1.0:1788835093.803959:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2384:x1875729242423936:12345-192.168.203.22@tcp:8:bash.0 00010000:00080000:1.0:1788835093.804008:0:8403:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp t0 exp 0000000000000000 cur 335 last 0 00000020:00000080:1.0:1788835093.804066:0:8403:0:(genops.c:1385:class_connect()) connect: client b8987b33-76f7-43a0-9448-1013c4af787f, cookie 0xdf60171e5a5d1eed 00002000:00100000:1.0:1788835093.804084:0:8403:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b8987b33-76f7-43a0-9448-1013c4af787f/ffff9afc83d67000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1788835093.804116:0:8403:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1788835093.804221:0:8403:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788835093.804267:0:8403:0:(import.c:65:import_set_state_nolock()) ffff9afc83d65000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788835093.804402:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa39180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+6:2384:x1875729242423936:12345-192.168.203.22@tcp:8:bash.0 Request processed in 443us (2630us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835093.804411:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:1.0:1788835093.810142:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835093.810302:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242424064 00000100:00100000:2.0:1788835093.810348:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242424064 00000100:00100000:2.0:1788835093.810458:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:2.0:1788835093.810471:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+6:0:x1875729242424064:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1788835093.810501:0:9814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835093.810539:0:9814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d1ef4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae04fa expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788835093.810579:0:9814:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788835093.810609:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=335s v=(0 0) 00010000:00010000:2.0:1788835093.810615:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835093.810627:0:9814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d1ef4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04fa expref: 7 pid: 9814 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.810657:0:9814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d1ef4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04fa expref: 7 pid: 9814 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.810678:0:9814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374ce00, rc 0) 00000100:00100000:2.0:1788835093.810777:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+7:0:x1875729242424064:12345-192.168.203.22@tcp:101:bash.0 Request processed in 309us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835093.810785:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00080000:1.0:1788835093.811153:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788835093.816213:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835093.816653:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242424192 00000100:00100000:0.0:1788835093.816667:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242424192 00000100:00100000:0.0:1788835093.816755:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:0.0:1788835093.816767:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+7:11103:x1875729242424192:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1788835093.816791:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835093.816822:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000041a11a50/0xdf60171e5a5d1efb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0501 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835093.816871:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d1ef4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04fa expref: 8 pid: 9814 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835093.817094:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835093.817099:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835093.817116:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041a11a50/0xdf60171e5a5d1efb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0501 expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835093.817171:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d1ef4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04fa expref: 8 pid: 9814 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835093.817190:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d1ef4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04fa expref: 8 pid: 9814 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835093.817207:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83deca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8403:1875729254049024:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788835093.817614:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b2cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788835093.822985:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83deca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8403:1875729254049024:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788835093.823052:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000041a11a50/0xdf60171e5a5d1efb lrc: 3/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0501 expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835093.823095:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f4600, rc 0) 00000100:00100000:1.0:1788835093.823203:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+8:11103:x1875729242424192:12345-192.168.203.22@tcp:101:bash.0 Request processed in 6437us (7006us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835093.823213:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:3.0:1788835093.825592:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835093.825939:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242424320 00000100:00100000:2.0:1788835093.825955:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242424320 00010000:00010000:2.0:1788835093.826011:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d1ef4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04fa expref: 8 pid: 9814 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835093.826082:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:2.0:1788835093.826094:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaae6d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+8:2385:x1875729242424320:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835093.826142:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835093.826172:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d1ef4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04fa expref: 8 pid: 9814 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.826189:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d1ef4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04fa expref: 8 pid: 9814 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.826219:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d1ef4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04fa expref: 8 pid: 9814 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.826236:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835093.826242:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835093.826252:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000041a11a50/0xdf60171e5a5d1efb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0501 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.826265:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000041a11a50/0xdf60171e5a5d1efb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0501 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.826339:0:6475:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000041a11a50/0xdf60171e5a5d1efb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0501 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835093.826357:0:6475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa3a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6475:1875729254049152:192.168.203.22@tcp:105: 00000100:00100000:2.0:1788835093.826489:0:6475:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8663e600 going to sleep for 11 seconds 00000100:00100000:0.0:1788835093.841401:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835093.841520:0:6475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa3a300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:6475:1875729254049152:192.168.203.22@tcp:105: 00010000:00010000:2.0:1788835093.841553:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835093.841644:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaae6d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+7:2385:x1875729242424320:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 15551us (16065us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835093.841658:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:3.0:1788835093.841923:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242424576 00000100:00100000:3.0:1788835093.841932:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242424576 00000100:00100000:3.0:1788835093.841994:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:3.0:1788835093.842004:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+15:11103:x1875729242424576:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:2.0:1788835093.842447:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+16:11103:x1875729242424576:12345-192.168.203.22@tcp:35:bash.0 Request processed in 443us (1055us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1788835093.842459:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:3.0:1788835093.965965:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835093.970823:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242424832 00000100:00100000:2.0:1788835093.970846:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242424832 00000100:00100000:2.0:1788835093.970962:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:2.0:1788835093.970975:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+16:11113:x1875729242424832:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788835093.971011:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835093.971042:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d1f02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0508 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835093.971191:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788835093.971355:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d1f02 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0508 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.971373:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afdba168f00) 00010000:00010000:2.0:1788835093.971376:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788835093.971381:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d1f02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0508 expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835093.971398:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374ce00, rc 0) 00000100:00100000:2.0:1788835093.971495:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+17:11113:x1875729242424832:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 522us (5547us total) trans 4294967315 rc 301/301 00000100:00100000:2.0:1788835093.971504:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:0.0:1788835093.980211:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835093.980292:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242425088 00000100:00100000:2.0:1788835093.980305:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242425088 00000100:00100000:2.0:1788835093.980423:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:2.0:1788835093.980435:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+17:11113:x1875729242425088:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1788835093.980817:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+18:11113:x1875729242425088:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 382us (620us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1788835093.980827:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00010000:00010000:3.0:1788835093.994604:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835094.102936:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835094.103035:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242425216 00000100:00100000:3.0:1788835094.103050:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242425216 00000100:00100000:3.0:1788835094.103180:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:3.0:1788835094.103192:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+18:11119:x1875729242425216:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788835094.103227:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835094.103255:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d1f10 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae050f expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.103445:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1f17 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.103464:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1f17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.103478:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1f17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835094.103547:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:3.0:1788835094.103551:0:9047:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788835094.103585:0:9047:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1f17 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.103620:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d1f10 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae050f expref: 20 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.103643:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1f17 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae050f expref: 19 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.103653:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:3.0:1788835094.103656:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788835094.103660:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204bc00, rc 0) 00000100:00100000:3.0:1788835094.103733:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+19:11119:x1875729242425216:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 543us (823us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835094.103742:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:3.0:1788835094.110016:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835094.110428:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242425472 00000100:00100000:2.0:1788835094.110443:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242425472 00000100:00100000:2.0:1788835094.110541:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:2.0:1788835094.110555:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+19:11119:x1875729242425472:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788835094.110587:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835094.110619:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d1f1e lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0516 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.110936:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d1f25 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.110957:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d1f25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.110972:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d1f25 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835094.110987:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788835094.111480:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d1f1e lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0516 expref: 22 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.111529:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d1f25 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0516 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.111539:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ec900) 00010000:00010000:2.0:1788835094.111544:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788835094.111549:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374da00, rc 0) 00000100:00100000:0.0:1788835094.114828:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+21:11119:x1875729242425472:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 4256us (4807us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1788835094.114846:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:0.0:1788835094.118091:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835094.118305:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242425728 00000100:00100000:3.0:1788835094.118384:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242425728 00000100:00100000:3.0:1788835094.118468:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:3.0:1788835094.118480:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+21:11119:x1875729242425728:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788835094.118514:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835094.118543:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d1f33 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae051d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.118688:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d1f3a lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.118706:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d1f3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.118721:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d1f3a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835094.119258:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788835094.122578:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d1f33 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae051d expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.122623:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d1f3a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae051d expref: 23 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.122633:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ec900) 00010000:00010000:3.0:1788835094.122636:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788835094.122640:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204b800, rc 0) 00000100:00100000:3.0:1788835094.122729:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83deca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+23:11119:x1875729242425728:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 4250us (4654us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788835094.122750:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:2.0:1788835094.123156:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835094.129729:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242425856 00000100:00100000:3.0:1788835094.129755:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242425856 00000100:00100000:3.0:1788835094.129898:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:3.0:1788835094.129910:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+23:2388:x1875729242425856:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788835094.129942:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835094.129975:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d1f25 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0516 expref: 23 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.129999:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ec900) 00010000:00010000:3.0:1788835094.130004:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835094.130088:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+22:2388:x1875729242425856:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 180us (6933us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835094.130097:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:0.0:1788835094.133532:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835094.133640:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242425984 00000100:00100000:2.0:1788835094.133656:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242425984 00000100:00100000:2.0:1788835094.133747:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:2.0:1788835094.133759:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+7:2386:x1875729242425984:12345-192.168.203.22@tcp:1:lfs.0 00010000:00010000:2.0:1788835094.133843:0:9814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015b96851/0xdf60171e5a5d1f48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.133868:0:9814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000041a11a50/0xdf60171e5a5d1efb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0501 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.133878:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1788835094.133883:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788835094.133889:0:9814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015b96851/0xdf60171e5a5d1f48 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.134079:0:9814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000041a11a50/0xdf60171e5a5d1efb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0501 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.134110:0:9814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000041a11a50/0xdf60171e5a5d1efb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0501 expref: 7 pid: 8403 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835094.134156:0:9814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9814:1875729254049280:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788835094.136077:0:9814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8663e000 going to sleep for 11 seconds 00000100:00100000:2.0:1788835094.140205:0:9814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa3b800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9814:1875729254049280:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788835094.140255:0:9814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000015b96851/0xdf60171e5a5d1f48 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835094.149689:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835094.150263:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242426112 00000100:00100000:2.0:1788835094.150275:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242426112 00002000:00100000:2.0:1788835094.150591:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9afd9e815c00 x1875729242426112/t0(0) o4->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:15/0 lens 504/0 e 0 to 0 dl 1788835105 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788835094.150603:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afd9e815c00 with x1875729242426112 ext(0->12) 00010000:00010000:2.0:1788835094.150685:0:8408:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000041a11a50/0xdf60171e5a5d1efb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0501 expref: 8 pid: 8403 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.150703:0:8408:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000041a11a50/0xdf60171e5a5d1efb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0501 expref: 8 pid: 8403 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788835094.150712:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9afd9e815c00 00000100:00100000:2.0:1788835094.150784:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:2.0:1788835094.150793:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b8987b33-76f7-43a0-9448-1013c4af787f+8:2385:x1875729242426112:12345-192.168.203.22@tcp:4:lfs.0 00000001:00100000:0.0:1788835094.152911:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b8987b33-76f7-43a0-9448-1013c4af787f 00000100:00100000:2.0:1788835094.153831:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e815c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b8987b33-76f7-43a0-9448-1013c4af787f+9:2385:x1875729242426112:12345-192.168.203.22@tcp:4:lfs.0 Request processed in 3031us (4145us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1788835094.153843:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00002000:00100000:2.0:1788835094.153866:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x2:0x0] (0->12) req@ffff9afd9e815c00 x1875729242426112/t4294967300(0) o4->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:15/0 lens 504/448 e 0 to 0 dl 1788835105 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1788835094.153877:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afd9e815c00 with x1875729242426112 ext(0->12) 00010000:00010000:2.0:1788835094.153887:0:8408:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000041a11a50/0xdf60171e5a5d1efb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0501 expref: 9 pid: 8403 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.153904:0:8408:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000041a11a50/0xdf60171e5a5d1efb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0501 expref: 9 pid: 8403 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788835094.153912:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9afd9e815c00 00000100:00100000:3.0:1788835094.165455:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835094.165744:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242426240 00000100:00100000:2.0:1788835094.165759:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242426240 00010000:00010000:2.0:1788835094.165815:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000041a11a50/0xdf60171e5a5d1efb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0501 expref: 9 pid: 8403 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835094.165861:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:2.0:1788835094.165872:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+9:2386:x1875729242426240:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835094.165888:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788835094.165908:0:9491:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788835094.165912:0:9491:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb mtime from disk: 0 -> 1788835094 00002000:00010000:2.0:1788835094.165914:0:9491:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb atime from disk: 0 -> 1788835095 00002000:00010000:2.0:1788835094.165917:0:9491:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb ctime from disk: 0 -> 1788835094 00002000:00010000:2.0:1788835094.165919:0:9491:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x2:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788835094.165926:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000041a11a50/0xdf60171e5a5d1efb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0501 expref: 9 pid: 8403 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.165961:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000041a11a50/0xdf60171e5a5d1efb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0501 expref: 9 pid: 8403 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.165986:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000041a11a50/0xdf60171e5a5d1efb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0501 expref: 9 pid: 8403 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.166005:0:9491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788835094.166010:0:9491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788835094.166016:0:9491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000015b96851/0xdf60171e5a5d1f48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.166025:0:9491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000015b96851/0xdf60171e5a5d1f48 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.166127:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835094.166197:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+8:2386:x1875729242426240:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 326us (758us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835094.166206:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00010000:00010000:1.0:1788835094.166755:0:9814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000015b96851/0xdf60171e5a5d1f48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.166769:0:9814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000015b96851/0xdf60171e5a5d1f48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.166793:0:9814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000015b96851/0xdf60171e5a5d1f48 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.166811:0:9814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000015b96851/0xdf60171e5a5d1f48 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.166819:0:9814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000015b96851/0xdf60171e5a5d1f48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.166831:0:9814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374c000 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:1.0:1788835094.166836:0:9814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000015b96851/0xdf60171e5a5d1f48 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.166846:0:9814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000015b96851/0xdf60171e5a5d1f48 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.166860:0:9814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000015b96851/0xdf60171e5a5d1f48 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.166881:0:9814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000015b96851/0xdf60171e5a5d1f48 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835094.167052:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e816680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+7:2386:x1875729242425984:12345-192.168.203.22@tcp:1:lfs.0 Request processed in 33292us (33535us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835094.167061:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:0.0:1788835094.180029:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835094.180130:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242426496 00000100:00100000:2.0:1788835094.180140:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242426496 00000100:00100000:2.0:1788835094.180232:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:2.0:1788835094.180245:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+22:11119:x1875729242426496:12345-192.168.203.22@tcp:35:lfs.0 00000004:00010000:2.0:1788835094.180367:0:6491:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d1f3a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae051d expref: 22 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788835094.180602:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:2.0:1788835094.180664:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1788835094.180966:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00010000:00010000:2.0:1788835094.181004:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f4f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.181020:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d1edf lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04f3 expref: 26 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.181029:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f4f lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.181063:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d1edf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04f3 expref: 26 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.181078:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d1edf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04f3 expref: 26 pid: 6488 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835094.181092:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa3b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6491:1875729254049408:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788835094.181204:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8663e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788835094.184310:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa3b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6491:1875729254049408:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788835094.184379:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f4f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835094.186275:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835094.187008:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242426624 00000100:00100000:2.0:1788835094.187025:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242426624 00010000:00010000:2.0:1788835094.187075:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d1edf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04f3 expref: 27 pid: 6488 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835094.187125:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:2.0:1788835094.187135:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+27:2385:x1875729242426624:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835094.187152:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835094.187158:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d1edf lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04f3 expref: 27 pid: 6488 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.187183:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d1edf lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04f3 expref: 27 pid: 6488 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.187207:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d1edf lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04f3 expref: 27 pid: 6488 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.187223:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ec900) 00010000:00010000:2.0:1788835094.187228:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f4f lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.187237:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f4f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.187245:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f4f lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.187276:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835094.187373:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+26:2385:x1875729242426624:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 238us (1109us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835094.187390:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 54 00010000:00010000:0.0:1788835094.187620:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f4f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835094.187629:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f4f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788835094.187749:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000001:00080000:0.0:1788835094.187886:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:0.0:1788835094.187977:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6491:1875729254049536:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788835094.188029:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835094.188059:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b2900 going to sleep for 11 seconds 00000100:00100000:2.0:1788835094.188165:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254049536 00000100:00100000:2.0:1788835094.188172:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254049536 00000100:00100000:2.0:1788835094.188230:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788835094.188239:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6491:x1875729254049536:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788835094.188356:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6491:x1875729254049536:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 118us (326us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835094.188363:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1788835094.188403:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b4a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6491:1875729254049536:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788835094.188556:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00000100:00100000:2.0:1788835094.188596:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa3b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6491:1875729254049664:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788835094.188624:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835094.188642:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8663e0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788835094.188655:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254049664 00000100:00100000:2.0:1788835094.188659:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254049664 00000100:00100000:2.0:1788835094.188683:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1788835094.188689:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6491:x1875729254049664:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788835094.188829:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6491:x1875729254049664:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 140us (204us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788835094.188836:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:1.0:1788835094.188934:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788835094.189002:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa3b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6491:1875729254049664:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1788835094.189038:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1788835094.189070:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f4f lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.189078:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f4f lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.189097:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f4f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.189115:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374c000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835094.189120:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f4f lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.189128:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f4f lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.189141:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ec900) 00010000:00010000:2.0:1788835094.189144:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788835094.189148:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f4f lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.189154:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f4f lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788835094.189240:0:6491:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788835094.189300:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1788835094.189311:0:6491:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 336230995652ns, next at 337230993780ns, rc = 0 00000001:00080000:2.0:1788835094.189567:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967326 00010000:00010000:2.0:1788835094.189596:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ec900) 00010000:00010000:2.0:1788835094.189599:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788835094.189605:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d1f3a lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae051d expref: 30 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835094.189704:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+29:11119:x1875729242426496:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 9462us (9685us total) trans 4294967327 rc 0/0 00000100:00100000:2.0:1788835094.189722:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000020:00080000:2.0:1788835094.189726:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1788835094.195066:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835094.195153:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242426752 00000100:00100000:1.0:1788835094.195164:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242426752 00000100:00100000:1.0:1788835094.195241:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:1.0:1788835094.195254:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+29:11119:x1875729242426752:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788835094.195282:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835094.195358:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d1f56 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0524 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.195429:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d1f56 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0524 expref: 30 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.195445:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d1f56 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0524 expref: 30 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.195464:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:1.0:1788835094.195468:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788835094.195471:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61a00, rc 0) 00000100:00100000:1.0:1788835094.195524:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+30:11119:x1875729242426752:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 272us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835094.195531:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:0.0:1788835094.199658:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835094.199799:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242427008 00000100:00100000:2.0:1788835094.199808:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242427008 00000100:00100000:2.0:1788835094.199898:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1788835094.199908:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84e65050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+30:11119:x1875729242427008:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1788835094.200156:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84e65050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+31:11119:x1875729242427008:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 248us (505us total) trans 4294967328 rc 0/0 00000100:00100000:2.0:1788835094.200171:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1788835094.266031:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835094.266194:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242427264 00000100:00100000:0.0:1788835094.266208:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242427264 00000100:00100000:0.0:1788835094.266502:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:0.0:1788835094.266513:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+31:11129:x1875729242427264:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788835094.266539:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835094.266557:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d1f5d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae052b expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788835094.266669:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788835094.266785:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d1f5d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae052b expref: 33 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835094.266799:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afdba168f00) 00010000:00010000:0.0:1788835094.266803:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788835094.266808:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d1f5d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae052b expref: 33 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835094.266843:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5e00, rc 0) 00000100:00100000:0.0:1788835094.266903:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+32:11129:x1875729242427264:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 393us (884us total) trans 4294967329 rc 301/301 00000100:00100000:0.0:1788835094.266914:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:3.0:1788835094.270723:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835094.270841:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242427392 00000100:00100000:2.0:1788835094.270852:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242427392 00000100:00100000:2.0:1788835094.270952:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:2.0:1788835094.270962:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+32:11129:x1875729242427392:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:2.0:1788835094.271061:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f6b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271080:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271094:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271117:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d1f72 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271125:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d1f72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271156:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d1f72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271277:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d1f79 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271287:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d1f79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271294:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d1f79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788835094.271395:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d1f79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271410:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f6b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271417:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f6b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271424:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271430:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374c000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835094.271435:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f6b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271442:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f6b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271456:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:2.0:1788835094.271464:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835094.271470:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f6b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271477:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1f6b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271491:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d1f72 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271497:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d1f72 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271502:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d1f72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271507:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374ce00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835094.271510:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d1f72 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271515:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d1f72 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271522:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afda01ec700) 00010000:00010000:2.0:1788835094.271524:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835094.271527:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d1f72 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271532:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d1f72 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271541:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d1f79 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271552:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d1f79 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271558:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d1f79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271563:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835094.271567:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d1f79 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271574:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d1f79 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271582:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:2.0:1788835094.271584:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835094.271587:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d1f79 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.271593:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d1f79 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835094.271671:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83680000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+32:11129:x1875729242427392:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 710us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835094.271679:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:3.0:1788835094.274485:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835094.274602:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242427648 00000100:00100000:0.0:1788835094.274613:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242427648 00000100:00100000:0.0:1788835094.274673:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:0.0:1788835094.274683:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+32:11129:x1875729242427648:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:0.0:1788835094.274918:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83682300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+33:11129:x1875729242427648:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 236us (444us total) trans 4294967330 rc 0/0 00000100:00100000:0.0:1788835094.274926:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:3.0:1788835094.302251:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835094.302348:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242427904 00000100:00100000:1.0:1788835094.302357:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242427904 00000100:00100000:1.0:1788835094.302451:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:1.0:1788835094.302461:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+33:11132:x1875729242427904:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788835094.302485:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835094.302505:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d1f80 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0532 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302574:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d1f87 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302588:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d1f87 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302617:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d1f87 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302629:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d1f8e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302636:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d1f8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302642:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d1f8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302746:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d1f95 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302754:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d1f95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302761:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d1f95 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835094.302770:0:9806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:1.0:1788835094.302842:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d1f87 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302849:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d1f87 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302855:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d1f87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302861:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835094.302871:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d1f87 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302878:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d1f87 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302890:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:1.0:1788835094.302893:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835094.302897:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d1f87 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302902:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d1f87 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302914:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d1f8e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302919:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d1f8e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302925:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d1f8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302931:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835094.302934:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d1f8e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302939:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d1f8e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302946:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afda01ec700) 00010000:00010000:1.0:1788835094.302948:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835094.302956:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d1f8e lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.302961:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d1f8e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.303000:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d1f80 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0532 expref: 36 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.303021:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d1f95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0532 expref: 35 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835094.303028:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:1.0:1788835094.303030:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788835094.303033:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60000, rc 0) 00000100:00100000:1.0:1788835094.303095:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83681880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+35:11132:x1875729242427904:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 636us (854us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1788835094.303113:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:3.0:1788835094.306137:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835094.306758:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242428032 00000100:00100000:0.0:1788835094.306768:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242428032 00000100:00100000:0.0:1788835094.306830:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:0.0:1788835094.306841:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+35:11132:x1875729242428032:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:0.0:1788835094.306908:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d1fa3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835094.306924:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d1fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835094.306935:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d1fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835094.306970:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d1fa3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835094.306994:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d1fa3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835094.307001:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d1fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835094.307007:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835094.307011:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d1fa3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835094.307018:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d1fa3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835094.307030:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:0.0:1788835094.307033:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788835094.307038:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d1fa3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835094.307043:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d1fa3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835094.307717:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+35:11132:x1875729242428032:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 874us (1585us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835094.307728:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:3.0:1788835094.312679:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835094.313191:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242428288 00000100:00100000:0.0:1788835094.313202:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242428288 00000100:00100000:0.0:1788835094.313259:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:0.0:1788835094.313269:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+35:11132:x1875729242428288:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:0.0:1788835094.313790:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+36:11132:x1875729242428288:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 520us (1119us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1788835094.313813:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:3.0:1788835094.537964:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835094.540204:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242428544 00000100:00100000:2.0:1788835094.540220:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242428544 00000100:00100000:2.0:1788835094.540349:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:2.0:1788835094.540363:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+36:11163:x1875729242428544:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:2.0:1788835094.540390:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835094.540442:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d1faa lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0539 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.540556:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d1fb1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.540572:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d1fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.540595:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d1fb1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835094.540605:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:2.0:1788835094.540729:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d1faa lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0539 expref: 39 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.540748:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d1fb1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0539 expref: 38 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.540757:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:2.0:1788835094.540760:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788835094.540764:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374ce00, rc 0) 00000100:00100000:2.0:1788835094.540835:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+38:11163:x1875729242428544:12345-192.168.203.22@tcp:101:cat.0 Request processed in 476us (2883us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1788835094.540842:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:3.0:1788835094.548742:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835094.548784:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835094.548819:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242428800 00000100:00100000:0.0:1788835094.548830:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242428800 00000100:00100000:0.0:1788835094.548896:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:0.0:1788835094.548906:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+38:11163:x1875729242428800:12345-192.168.203.22@tcp:35:cat.0 00000100:00100000:0.0:1788835094.549394:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+39:11163:x1875729242428800:12345-192.168.203.22@tcp:35:cat.0 Request processed in 486us (661us total) trans 4294967334 rc 0/0 00000100:00100000:2.0:1788835094.549399:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242428928 00000100:00100000:2.0:1788835094.549405:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242428928 00000100:00100000:0.0:1788835094.549405:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:2.0:1788835094.549451:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:2.0:1788835094.549461:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+39:2387:x1875729242428928:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835094.549490:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835094.549514:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d1fb1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0539 expref: 39 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.549532:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:2.0:1788835094.549538:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835094.549561:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+38:2387:x1875729242428928:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 102us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835094.549567:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:0.0:1788835094.628033:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835094.628086:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835094.628516:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242429056 00000100:00100000:2.0:1788835094.628527:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242429056 00000100:00100000:2.0:1788835094.628595:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 379 00000100:00100000:2.0:1788835094.628605:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:2388:x1875729242429056:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835094.628685:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242429312 00000100:00100000:3.0:1788835094.628690:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242429312 00000100:00100000:3.0:1788835094.628721:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 96 00000100:00100000:3.0:1788835094.628727:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+7:2388:x1875729242429312:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835094.636774:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:2388:x1875729242429056:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 8158us (8739us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835094.636797:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 379 00000100:00100000:3.0:1788835094.637167:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+7:2388:x1875729242429312:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 8438us (9079us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835094.637191:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 96 00000100:00100000:0.0:1788835094.638747:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835094.638814:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835094.638848:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835094.638880:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242429568 00000100:00100000:0.0:1788835094.638890:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242429568 00000100:00100000:0.0:1788835094.638947:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242429184 00000100:00100000:0.0:1788835094.638950:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242429184 00000100:00100000:0.0:1788835094.638965:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242429440 00000100:00100000:0.0:1788835094.638967:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242429440 00000100:00100000:0.0:1788835094.638994:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 270 00000100:00100000:0.0:1788835094.639002:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2388:x1875729242429568:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835094.639143:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 271 00000100:00100000:1.0:1788835094.639153:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+5:2388:x1875729242429184:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835094.639212:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 272 00000100:00100000:2.0:1788835094.639221:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2388:x1875729242429440:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835094.639399:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2388:x1875729242429568:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 397us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835094.639408:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 270 00000100:00080000:0.0:1788835094.639431:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788835094.639435:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788835094.646718:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e811c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+5:2388:x1875729242429184:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 7555us (7891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835094.646735:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 271 00000100:00100000:2.0:1788835094.649735:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e813100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2388:x1875729242429440:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 10503us (10873us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835094.649753:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 272 00000100:00100000:2.0:1788835094.657577:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835094.657666:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242429824 00000100:00100000:0.0:1788835094.657676:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242429824 00000100:00100000:0.0:1788835094.657738:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:0.0:1788835094.657748:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+38:11169:x1875729242429824:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:0.0:1788835094.657773:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835094.657777:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788835094.657813:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d1f17 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae050f expref: 38 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835094.657832:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:0.0:1788835094.657838:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788835094.657851:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1fbf lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0540 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835094.657948:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d1fc6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835094.657963:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d1f95 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0532 expref: 38 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835094.657971:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d1fc6 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835094.658010:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d1f95 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0532 expref: 38 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835094.658023:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d1f95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0532 expref: 38 pid: 9806 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835094.658057:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e810000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1875729254049792:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788835094.658169:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b2000 going to sleep for 11 seconds 00000100:00100000:1.0:1788835094.664571:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835094.664662:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242429952 00000100:00100000:3.0:1788835094.664674:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242429952 00010000:00010000:3.0:1788835094.664722:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d1f95 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0532 expref: 39 pid: 9806 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835094.664771:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:3.0:1788835094.664781:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+39:2388:x1875729242429952:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788835094.664796:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835094.664803:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d1f95 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0532 expref: 39 pid: 9806 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.664818:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d1f95 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0532 expref: 39 pid: 9806 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.664842:0:9491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:3.0:1788835094.664847:0:9491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d1fc6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.664857:0:9491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d1fc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.664864:0:9491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d1fc6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.664881:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835094.664932:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa43800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+39:2388:x1875729242429952:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 151us (370us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835094.664960:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00010000:00010000:3.0:1788835094.665028:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d1f95 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0532 expref: 38 pid: 9806 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835094.665043:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e810000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1875729254049792:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788835094.665065:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d1fc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.665075:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d1fc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.665081:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d1fc6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835094.672911:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 13 00010000:00010000:3.0:1788835094.673147:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1fbf lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0540 expref: 39 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.673172:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d1fc6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0540 expref: 38 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835094.673182:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:3.0:1788835094.673185:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788835094.673188:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5600, rc 0) 00000100:00100000:3.0:1788835094.673264:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+38:11169:x1875729242429824:12345-192.168.203.22@tcp:101:dd.0 Request processed in 15517us (15696us total) trans 4294967335 rc 0/0 00000100:00100000:3.0:1788835094.673272:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:1.0:1788835094.695528:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835094.695762:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242430080 00000100:00100000:2.0:1788835094.695773:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242430080 00000100:00100000:2.0:1788835094.695853:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:2.0:1788835094.695864:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+38:11169:x1875729242430080:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:2.0:1788835094.695899:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835094.695923:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1fd4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0547 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.695973:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1fdb lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.695991:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1fdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.696004:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1fdb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.696138:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d1fd4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0547 expref: 40 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.696159:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1fdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0547 expref: 39 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.696167:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:2.0:1788835094.696170:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788835094.696174:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374cc00, rc 0) 00000100:00100000:2.0:1788835094.696240:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa21180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+39:11169:x1875729242430080:12345-192.168.203.22@tcp:101:dd.0 Request processed in 378us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835094.696248:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:0.0:1788835094.698573:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835094.698710:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242430336 00000100:00100000:2.0:1788835094.698718:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242430336 00000100:00100000:2.0:1788835094.698778:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:2.0:1788835094.698799:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+39:11169:x1875729242430336:12345-192.168.203.22@tcp:36:dd.0 00010000:00010000:2.0:1788835094.699029:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d1fe2 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.699061:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d1fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.699073:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d1fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788835094.699138:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967336 00000004:00010000:2.0:1788835094.699161:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000009b90933 reply state 00000000b84fada7 transno 4294967337 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d1fe2 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.699173:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d1fe2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835094.699181:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:2.0:1788835094.699184:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788835094.699187:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788835094.699287:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e810000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+42:11169:x1875729242430336:12345-192.168.203.22@tcp:36:dd.0 Request processed in 490us (721us total) trans 4294967337 rc 0/0 00000100:00100000:2.0:1788835094.699295:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 62 00000020:00080000:2.0:1788835094.699299:0:6487:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1788835095.013832:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835095.320275:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835095.323115:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242430464 00000100:00100000:0.0:1788835095.323133:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242430464 00000100:00100000:0.0:1788835095.323243:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:0.0:1788835095.323255:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+42:11183:x1875729242430464:12345-192.168.203.22@tcp:101:stat.0 00010000:00010000:0.0:1788835095.323280:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835095.323301:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d1fe9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae054e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835095.323397:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1ff0 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835095.323412:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835095.323436:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835095.323449:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d1ff7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835095.323457:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d1ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835095.323463:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d1ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835095.323564:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ffe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835095.323576:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d1fc6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0540 expref: 43 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835095.323585:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ffe lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835095.323623:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d1fc6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0540 expref: 43 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835095.323649:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d1fc6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0540 expref: 43 pid: 6488 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835095.323664:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1875729254049920:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788835095.323784:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b2840 going to sleep for 11 seconds 00000100:00080000:1.0:1788835095.324061:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788835095.332494:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bb800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1875729254049920:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788835095.332533:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ffe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835095.334949:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835095.335250:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242430720 00000100:00100000:0.0:1788835095.335262:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242430720 00000100:00100000:0.0:1788835095.335351:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:0.0:1788835095.335362:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+44:6157:x1875729242430720:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1788835095.335708:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+45:6157:x1875729242430720:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 347us (768us total) trans 4294967338 rc 0/0 00000100:00100000:0.0:1788835095.335728:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:3.0:1788835095.346434:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835095.346630:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242430848 00000100:00100000:0.0:1788835095.346641:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242430848 00010000:00010000:0.0:1788835095.346681:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d1fc6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0540 expref: 45 pid: 6488 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835095.346722:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:0.0:1788835095.346732:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+45:2386:x1875729242430848:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788835095.346746:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835095.346752:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d1fc6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0540 expref: 45 pid: 6488 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835095.346764:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d1fc6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0540 expref: 45 pid: 6488 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835095.346787:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d1fc6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0540 expref: 45 pid: 6488 timeout: 437 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835095.346805:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:0.0:1788835095.346810:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ffe lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835095.346820:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ffe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835095.346828:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ffe lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835095.346882:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835095.346947:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+44:2386:x1875729242430848:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 215us (535us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835095.346955:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 56 00010000:00010000:1.0:1788835095.347070:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ffe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.347079:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ffe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835095.347140:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:1.0:1788835095.347144:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835095.347189:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ffe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.347202:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ffe lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.347211:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1ff0 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.347218:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1ff0 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.347225:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.347231:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835095.347235:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1ff0 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.347242:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1ff0 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.347252:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:1.0:1788835095.347261:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835095.347266:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1ff0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.347272:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d1ff0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.347285:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d1ff7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.347291:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d1ff7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.347297:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d1ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.347302:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5400 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835095.347305:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d1ff7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.347310:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d1ff7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.347374:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afda01ec700) 00010000:00010000:1.0:1788835095.347377:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835095.347380:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d1ff7 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.347386:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d1ff7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.347605:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d1fe9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae054e expref: 44 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.347636:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ffe lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae054e expref: 43 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.347644:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:1.0:1788835095.347647:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788835095.347650:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5000, rc 0) 00000100:00100000:1.0:1788835095.347684:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+43:11183:x1875729242430464:12345-192.168.203.22@tcp:101:stat.0 Request processed in 24432us (27431us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835095.347692:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:3.0:1788835095.480758:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835095.480872:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242431104 00000100:00100000:1.0:1788835095.480884:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242431104 00000100:00100000:1.0:1788835095.480949:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:1.0:1788835095.480960:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+43:11189:x1875729242431104:12345-192.168.203.22@tcp:36:truncate.0 00010000:00010000:1.0:1788835095.481028:0:9047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835095.481066:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d1ffe lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae054e expref: 43 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.481087:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:1.0:1788835095.481102:0:9047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788835095.481271:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2005 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.481285:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2005 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.481296:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2005 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788835095.481400:0:9047:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967339 00000004:00010000:1.0:1788835095.481668:0:9047:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a6fcd162 reply state 00000000109c9046 transno 4294967340 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2005 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.481681:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2005 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.481688:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:1.0:1788835095.481691:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788835095.481694:0:9047:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788835095.481849:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+45:11189:x1875729242431104:12345-192.168.203.22@tcp:36:truncate.0 Request processed in 890us (1102us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1788835095.481857:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00000020:00080000:1.0:1788835095.481862:0:9047:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788835095.817128:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835095.817621:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242431232 00000100:00100000:1.0:1788835095.817635:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242431232 00000100:00100000:1.0:1788835095.817721:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:1.0:1788835095.817733:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+45:11203:x1875729242431232:12345-192.168.203.22@tcp:101:stat.0 00010000:00010000:1.0:1788835095.817762:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835095.817785:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d200c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0555 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.817865:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2013 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.817882:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2013 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.817895:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2013 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.817926:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d201a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.817933:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d201a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.817940:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d201a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818030:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2021 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818054:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2021 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818063:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2021 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835095.818140:0:9806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1788835095.818144:0:9806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835095.818179:0:9806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2021 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818193:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2021 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818201:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2013 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818208:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2013 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818226:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2013 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818232:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835095.818236:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2013 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818814:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2013 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818830:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:1.0:1788835095.818834:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835095.818839:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2013 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818845:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2013 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818863:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d201a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818869:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d201a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818874:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d201a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818879:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835095.818882:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d201a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818901:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d201a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818910:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afda01ec700) 00010000:00010000:1.0:1788835095.818912:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835095.818915:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d201a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818920:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d201a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818959:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d200c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0555 expref: 47 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818973:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2021 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0555 expref: 46 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835095.818981:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:1.0:1788835095.818984:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788835095.818987:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60c00, rc 0) 00000100:00100000:1.0:1788835095.819084:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+46:11203:x1875729242431232:12345-192.168.203.22@tcp:101:stat.0 Request processed in 1352us (1967us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835095.819102:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 65 00000004:00080000:2.0:1788835095.845621:0:8609:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 337887300527ns, next at 338887295922ns, rc = 0 00000100:00100000:0.0:1788835095.845800:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788835095.845842:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254050048:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788835095.845925:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835095.846132:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254050048 00000100:00100000:2.0:1788835095.846141:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254050048 00000100:00100000:3.0:1788835095.846413:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254050304:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.846449:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835095.846470:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254050816:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.846487:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835095.846502:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd90483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254051328:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.846520:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835095.846541:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788835095.846546:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254050176:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.846570:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835095.846588:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254050688:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.846609:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835095.846622:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd90481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729254051200:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.846640:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835095.846672:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254050432:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.846694:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835095.846708:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254050944:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.846725:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835095.846735:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd90483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254051456:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.846754:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835095.846769:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788835095.846774:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254050560:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.846800:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835095.846824:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254051072:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.846842:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835095.846857:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd90482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254051584:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.846872:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835095.846896:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254051456 00000100:00100000:3.0:1788835095.846900:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254051456 00000100:00100000:3.0:1788835095.846938:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254051072 00000100:00100000:3.0:1788835095.846940:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254051072 00000100:00100000:3.0:1788835095.846951:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254051584 00000100:00100000:3.0:1788835095.846953:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254051584 00000100:00100000:3.0:1788835095.846966:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788835095.846973:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254051456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847023:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90482a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254051456:12345-0@lo:400:kworker.0 Request processed in 50us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835095.847030:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1788835095.847045:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788835095.847051:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254051072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847101:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90483800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254051072:12345-0@lo:400:kworker.0 Request processed in 37us (245us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835095.847108:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1788835095.847119:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788835095.847125:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254051584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847148:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90482680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254051584:12345-0@lo:400:kworker.0 Request processed in 23us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835095.847153:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:3.0:1788835095.847174:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788835095.847178:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788835095.847188:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254050688 00000100:00100000:3.0:1788835095.847191:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254050688 00000100:00100000:3.0:1788835095.847209:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254050432 00000100:00100000:3.0:1788835095.847212:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254050432 00000100:00100000:3.0:1788835095.847222:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788835095.847226:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254050688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847256:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90483480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254050688:12345-0@lo:400:kworker.0 Request processed in 29us (647us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835095.847262:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1788835095.847271:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788835095.847275:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254050432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847294:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90480000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254050432:12345-0@lo:400:kworker.0 Request processed in 19us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835095.847299:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1788835095.847351:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ef100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254050688:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847376:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ece00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254051072:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847385:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd90482300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254051584:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847392:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ee300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254050432:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847398:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd90483100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254051456:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847418:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254050304 00000100:00100000:3.0:1788835095.847421:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254050304 00000100:00100000:3.0:1788835095.847439:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254050816 00000100:00100000:3.0:1788835095.847442:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254050816 00000100:00100000:3.0:1788835095.847459:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254051328 00000100:00100000:3.0:1788835095.847468:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254051328 00000100:00100000:3.0:1788835095.847485:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254051200 00000100:00100000:3.0:1788835095.847487:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254051200 00000100:00100000:3.0:1788835095.847498:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254050944 00000100:00100000:3.0:1788835095.847501:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254050944 00000100:00100000:3.0:1788835095.847510:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254050560 00000100:00100000:3.0:1788835095.847512:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254050560 00000100:00100000:3.0:1788835095.847524:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788835095.847529:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254050304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847562:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90480700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254050304:12345-0@lo:400:kworker.0 Request processed in 33us (1112us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835095.847567:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:3.0:1788835095.847577:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788835095.847581:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254050816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847600:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90480380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254050816:12345-0@lo:400:kworker.0 Request processed in 19us (1113us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835095.847606:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1788835095.847613:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788835095.847618:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875729254051328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847640:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90480e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875729254051328:12345-0@lo:400:kworker.0 Request processed in 21us (1118us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835095.847645:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:3.0:1788835095.847655:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788835095.847660:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729254051200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847686:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90481c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729254051200:12345-0@lo:400:kworker.0 Request processed in 26us (1045us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835095.847692:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:3.0:1788835095.847708:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788835095.847713:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254050944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847741:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90481f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254050944:12345-0@lo:400:kworker.0 Request processed in 28us (1015us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835095.847747:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00000100:00100000:3.0:1788835095.847756:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1788835095.847760:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254050560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847780:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90481180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254050560:12345-0@lo:400:kworker.0 Request processed in 20us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835095.847786:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:3.0:1788835095.847799:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788835095.847802:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788835095.847818:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd90481500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729254051200:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847827:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254050304:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847835:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254050816:0@lo:400:kworker.0 00010000:00080000:3.0:1788835095.847846:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afd90483b80 x1875729254051328/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835095.847857:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd90483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254051328:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847878:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ed500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254050560:0@lo:400:kworker.0 00010000:00080000:3.0:1788835095.847887:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbf9ef800 x1875729254050944/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835111 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835095.847895:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ef800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254050944:0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847930:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254050176 00000100:00100000:3.0:1788835095.847938:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254050176 00000100:00100000:3.0:1788835095.847961:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788835095.847966:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729254050176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835095.847999:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fcec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729254050176:12345-0@lo:400:kworker.0 Request processed in 33us (1428us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835095.848005:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 380 00000100:00100000:3.0:1788835095.848044:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254050176:0@lo:400:kworker.0 00000100:00100000:2.0:1788835095.848417:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1788835095.848430:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729254050048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788835095.848459:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788835095.848512:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9bb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729254050048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (2587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835095.848528:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1788835095.851082:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254051712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835095.851165:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835095.857130:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa38380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254050048:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788835095.857351:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd90483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254051840:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835095.857421:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835095.857470:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254051840 00000100:00100000:3.0:1788835095.857477:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254051840 00000100:00100000:3.0:1788835095.857522:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788835095.857532:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254051840:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788835095.857568:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788835095.857614:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90481500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254051840:12345-0@lo:41:osp-pre-1-0.0 Request processed in 83us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835095.857621:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788835095.857658:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd90483b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254051840:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788835095.884512:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254051712 00000100:00100000:0.0:1788835095.884534:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254051712 00000100:00100000:0.0:1788835095.884696:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1788835095.884707:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254051712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788835095.884736:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 28672 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788835095.885054:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82078700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254051712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 347us (33887us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835095.885062:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1788835095.885961:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254051712:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788835096.012754:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835096.012880:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242431488 00000100:00100000:2.0:1788835096.012892:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242431488 00000100:00100000:2.0:1788835096.012968:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:2.0:1788835096.013109:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+46:11213:x1875729242431488:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788835096.013133:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835096.013155:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2028 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae055c expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835096.016444:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788835096.017441:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2028 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae055c expref: 48 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835096.017465:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afdba168f00) 00010000:00010000:2.0:1788835096.017468:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788835096.017474:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2028 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae055c expref: 48 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835096.017491:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374c000, rc 0) 00000100:00100000:2.0:1788835096.017587:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90483b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+47:11213:x1875729242431488:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 4482us (4849us total) trans 4294967341 rc 301/301 00000100:00100000:3.0:1788835096.024540:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835096.024728:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242431744 00000100:00100000:3.0:1788835096.024741:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242431744 00000100:00100000:3.0:1788835096.024800:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:3.0:1788835096.024811:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+48:11213:x1875729242431744:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1788835096.025574:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:0.0:1788835096.031266:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+48:11213:x1875729242431744:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 6440us (6721us total) trans 4294967342 rc 0/0 00000100:00100000:0.0:1788835096.031283:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000001:00080000:3.0:1788835096.034894:0:6467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967341 is committed 00000004:00080000:3.0:1788835096.034919:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:3.0:1788835096.034981:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1788835096.034993:0:6467:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9afd8663eb40 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1788835096.034998:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afd91329300 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9afd8663e6c0 00000020:00080000:3.0:1788835096.035002:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afd91329d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9afd8670cc00 00000100:00100000:1.0:1788835096.035424:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254051968:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788835096.035534:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835096.035930:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254051968 00000100:00100000:1.0:1788835096.035939:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254051968 00000100:00100000:1.0:1788835096.036001:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1788835096.036010:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729254051968:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788835096.036124:0:8403:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:2 count 1 00002000:00010000:1.0:1788835096.036299:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x2:0x0] initial LVB size: 13, mtime: 0x6a9f7516, atime: 0x6a9f7517, ctime: 0x6a9f7516, blocks: 0x8 00010000:00010000:1.0:1788835096.036308:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0bb3cc9/0xdf60171e5a5d2036 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.036356:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=338s v=(0 0) 00010000:00010000:1.0:1788835096.036360:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835096.036366:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0bb3cc9/0xdf60171e5a5d2036 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788835096.036556:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788835096.036970:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0bb3cc9/0xdf60171e5a5d2036 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.036988:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0bb3cc9/0xdf60171e5a5d2036 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.036997:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0bb3cc9/0xdf60171e5a5d2036 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.037023:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000020:00080000:2.0:1788835096.037197:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1788835096.037447:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00010000:00010000:0.0:1788835096.038646:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62000/0xdf60171e5a5d1e92 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.038663:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62000/0xdf60171e5a5d1e92 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.038672:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62000/0xdf60171e5a5d1e92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.038705:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e62000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835096.038722:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62000/0xdf60171e5a5d1e92 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.038732:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62000/0xdf60171e5a5d1e92 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.038758:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9afda01eca00) 00010000:00010000:0.0:1788835096.038762:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788835096.039520:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c20a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3614:x1875729254051968:12345-0@lo:6:osp-syn-0-0.0 Request processed in 3505us (3980us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788835096.039547:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:3.0:1788835096.039855:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788835096.039865:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0bb3cc9/0xdf60171e5a5d2036 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.039877:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61200 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:3.0:1788835096.039882:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0bb3cc9/0xdf60171e5a5d2036 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.039891:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0bb3cc9/0xdf60171e5a5d2036 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.039917:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0bb3cc9/0xdf60171e5a5d2036 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.039925:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0bb3cc9/0xdf60171e5a5d2036 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.039955:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835096.039956:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835096.039966:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1788835096.041343:0:3614:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afc83741500/2, rc 0, transno 4294967302 00000100:00100000:3.0:1788835096.041363:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83741500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254051968:0@lo:6:osp-syn-0-0.0 00010000:00010000:3.0:1788835096.043526:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835096.043787:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62000/0xdf60171e5a5d1e92 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.043814:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e62000/0xdf60171e5a5d1e92 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.043842:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1e99 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.043850:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1e99 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.043857:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1e99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.043863:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e63400 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835096.043867:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1e99 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.043876:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1e99 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.043913:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:0.0:1788835096.043917:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835096.043921:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1e99 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.043927:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63400/0xdf60171e5a5d1e99 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.043958:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d1ed8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.043965:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d1ed8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.043971:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d1ed8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.043977:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374dc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835096.043980:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d1ed8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.043986:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d1ed8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.043994:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afda01ec700) 00010000:00010000:0.0:1788835096.043996:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835096.043999:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d1ed8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.044006:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d1ed8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.044049:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d1fe2 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.044056:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d1fe2 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.044062:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d1fe2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.044066:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835096.044069:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d1fe2 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.044075:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d1fe2 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.044083:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:0.0:1788835096.044085:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835096.044097:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d1fe2 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.044104:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d1fe2 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.044114:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2005 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.044120:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2005 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.044126:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2005 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.044138:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835096.044141:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2005 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.044147:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2005 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.044156:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:0.0:1788835096.044158:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835096.044160:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2005 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.044166:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2005 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835096.136839:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835096.136936:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242432000 00000100:00100000:3.0:1788835096.136947:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242432000 00000100:00100000:3.0:1788835096.137013:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:3.0:1788835096.137025:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+13:11219:x1875729242432000:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1788835096.137051:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835096.137073:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d203d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0563 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.137196:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2044 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.137213:0:9047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2021 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0555 expref: 14 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.137222:0:9047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2044 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.137269:0:9047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2021 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0555 expref: 14 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.137285:0:9047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2021 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0555 expref: 14 pid: 9806 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835096.137299:0:9047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd90482300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9047:1875729254052096:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788835096.139109:0:9047:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd83e4e480 going to sleep for 11 seconds 00000100:00100000:2.0:1788835096.151128:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835096.151883:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242432128 00000100:00100000:0.0:1788835096.151893:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242432128 00010000:00010000:0.0:1788835096.151937:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2021 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0555 expref: 15 pid: 9806 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835096.151982:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:0.0:1788835096.151991:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaae6e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+15:2385:x1875729242432128:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788835096.152007:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835096.152015:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2021 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0555 expref: 15 pid: 9806 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.152029:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2021 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0555 expref: 15 pid: 9806 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.152082:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:0.0:1788835096.152095:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2044 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.152105:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2044 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.152112:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2044 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835096.152132:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835096.152204:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaae6e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+15:2385:x1875729242432128:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 213us (1086us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835096.152211:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 57 00010000:00010000:1.0:1788835096.152537:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2021 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0555 expref: 14 pid: 9806 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835096.152555:0:9047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd90482300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9047:1875729254052096:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788835096.152584:0:9047:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2044 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.152592:0:9047:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2044 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.152597:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2044 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835096.152622:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1788835096.152764:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d203d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0563 expref: 15 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.152780:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2044 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0563 expref: 14 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.152787:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:1.0:1788835096.152790:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788835096.152793:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204b000, rc 0) 00000100:00100000:1.0:1788835096.152820:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83c21c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+14:11219:x1875729242432000:12345-192.168.203.22@tcp:101:bash.0 Request processed in 15798us (15995us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1788835096.152828:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:3.0:1788835096.156822:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835096.156985:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242432384 00000100:00100000:1.0:1788835096.156994:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242432384 00000100:00100000:1.0:1788835096.157057:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:1.0:1788835096.157067:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+14:11219:x1875729242432384:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:1.0:1788835096.157492:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2052 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.157643:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2052 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.157657:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2052 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788835096.157711:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967344 00000004:00010000:1.0:1788835096.157737:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005b5f65f9 reply state 000000007b8ad015 transno 4294967345 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2052 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.157750:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2052 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.157758:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:1.0:1788835096.157761:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788835096.157764:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788835096.157883:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90481880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+17:11219:x1875729242432384:12345-192.168.203.22@tcp:36:bash.0 Request processed in 815us (1067us total) trans 4294967345 rc 0/0 00000100:00100000:1.0:1788835096.157892:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 68 00000020:00080000:1.0:1788835096.157899:0:6488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788835096.177188:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835096.177736:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242432512 00000100:00100000:3.0:1788835096.177750:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242432512 00000100:00100000:3.0:1788835096.177818:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:3.0:1788835096.177830:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+17:11219:x1875729242432512:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1788835096.177861:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835096.177888:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2059 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae056a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.178003:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d2060 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.178019:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2044 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0563 expref: 18 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.178028:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d2060 lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.178077:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2044 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0563 expref: 18 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.178103:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2044 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0563 expref: 18 pid: 9047 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835096.178118:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd90480a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875729254052224:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788835096.178225:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd83e4e180 going to sleep for 11 seconds 00000100:00100000:2.0:1788835096.185923:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835096.186076:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242432640 00000100:00100000:1.0:1788835096.186096:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242432640 00010000:00010000:1.0:1788835096.186166:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2044 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0563 expref: 19 pid: 9047 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835096.186236:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:1.0:1788835096.186248:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+19:2386:x1875729242432640:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788835096.186273:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835096.186283:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2044 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0563 expref: 19 pid: 9047 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.186298:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2044 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0563 expref: 19 pid: 9047 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.186376:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:1.0:1788835096.186395:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d2060 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.186410:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d2060 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.186420:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d2060 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.186451:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788835096.186533:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+19:2386:x1875729242432640:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 288us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835096.186541:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00010000:00010000:3.0:1788835096.200371:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2044 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0563 expref: 18 pid: 9047 timeout: 438 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835096.201709:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd90480a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875729254052224:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788835096.201739:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d2060 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.201749:0:6487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d2060 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.201755:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d2060 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835096.201820:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788835096.201825:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788835096.201854:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d2060 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.201892:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2059 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae056a expref: 18 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.201911:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d2060 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae056a expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.201921:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:3.0:1788835096.201924:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788835096.201927:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204a200, rc 0) 00000100:00100000:3.0:1788835096.202006:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+17:11219:x1875729242432512:12345-192.168.203.22@tcp:101:bash.0 Request processed in 24178us (24831us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835096.202016:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:2.0:1788835096.207885:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835096.207975:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242432896 00000100:00100000:0.0:1788835096.207985:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242432896 00000100:00100000:0.0:1788835096.208055:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:0.0:1788835096.208067:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84e67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+17:11219:x1875729242432896:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:0.0:1788835096.208862:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84e67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+18:11219:x1875729242432896:12345-192.168.203.22@tcp:35:bash.0 Request processed in 795us (985us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1788835096.208873:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:0.0:1788835096.359058:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd90480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254052352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788835096.359179:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835096.359366:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254052352 00000100:00100000:3.0:1788835096.359375:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254052352 00000100:00100000:3.0:1788835096.359453:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788835096.359465:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254052352:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788835096.359511:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788835096.359568:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254052352:12345-0@lo:13:osp-pre-1-1.0 Request processed in 104us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835096.359575:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1788835096.360977:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788835096.360998:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfacc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254052480:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788835096.361078:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835096.361971:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd90480a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254052352:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788835096.362018:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254052480 00000100:00100000:0.0:1788835096.362025:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254052480 00000100:00100000:0.0:1788835096.362133:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1788835096.362143:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254052480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788835096.362182:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835096.362524:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90482d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254052480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 381us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835096.362532:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:2.0:1788835096.375968:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfacc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254052480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788835096.404041:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835096.404550:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242433152 00000100:00100000:2.0:1788835096.404562:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242433152 00000100:00100000:2.0:1788835096.404645:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:2.0:1788835096.404657:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+18:11229:x1875729242433152:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788835096.404690:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835096.404731:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2067 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0571 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835096.405042:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:2.0:1788835096.405179:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2067 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0571 expref: 20 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835096.405198:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afdba168f00) 00010000:00010000:2.0:1788835096.405202:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788835096.405207:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2067 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0571 expref: 20 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835096.405225:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374da00, rc 0) 00000100:00100000:2.0:1788835096.405940:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+19:11229:x1875729242433152:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1279us (1907us total) trans 4294967347 rc 301/301 00000100:00100000:2.0:1788835096.405949:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:2.0:1788835096.410473:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835096.410868:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242433280 00000100:00100000:3.0:1788835096.410882:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242433280 00000100:00100000:3.0:1788835096.411021:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:3.0:1788835096.411043:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+19:11229:x1875729242433280:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:3.0:1788835096.411135:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2075 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411161:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2075 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411175:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2075 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411193:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d207c lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411200:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d207c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411228:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d207c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411358:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d2083 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411369:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d2083 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411376:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d2083 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788835096.411432:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d2083 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411447:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2075 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411453:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2075 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411460:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2075 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411466:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204a600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835096.411470:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2075 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411478:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2075 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411492:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:3.0:1788835096.411513:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835096.411517:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2075 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411524:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2075 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411539:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d207c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411545:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d207c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411551:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d207c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411556:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204b000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835096.411558:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d207c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411564:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d207c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411572:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afdb2e6e900) 00010000:00010000:3.0:1788835096.411574:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835096.411577:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d207c lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411582:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d207c lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411596:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d2083 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411610:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d2083 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411615:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d2083 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411620:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204ae00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835096.411622:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d2083 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411628:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d2083 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411635:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:3.0:1788835096.411638:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835096.411640:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d2083 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.411645:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d2083 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835096.411744:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83dec700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+19:11229:x1875729242433280:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 713us (1284us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835096.411752:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:2.0:1788835096.422912:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835096.423011:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242433536 00000100:00100000:3.0:1788835096.423022:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242433536 00000100:00100000:3.0:1788835096.423108:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:3.0:1788835096.423119:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+19:11229:x1875729242433536:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1788835096.423400:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+20:11229:x1875729242433536:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 282us (500us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1788835096.423423:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:0.0:1788835096.539417:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835096.539799:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242433792 00000100:00100000:3.0:1788835096.539813:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242433792 00000100:00100000:3.0:1788835096.539903:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:3.0:1788835096.539915:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+20:11232:x1875729242433792:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788835096.539947:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835096.539971:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d208a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0578 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540073:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2091 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540102:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2091 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540116:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2091 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540132:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2098 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540139:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2098 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540146:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2098 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540289:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d209f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540355:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d209f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540362:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d209f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835096.540373:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788835096.540465:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2091 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540473:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2091 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540480:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2091 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540487:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204b000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835096.540492:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2091 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540501:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2091 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540515:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:3.0:1788835096.540518:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835096.540523:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2091 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540530:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2091 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540766:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2098 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540782:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2098 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540788:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2098 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540793:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204a600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835096.540796:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2098 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540803:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2098 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540812:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afdb2e6e900) 00010000:00010000:3.0:1788835096.540815:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835096.540817:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2098 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540823:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2098 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540873:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d208a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0578 expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540886:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d209f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0578 expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.540893:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:3.0:1788835096.540895:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788835096.540903:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204bc00, rc 0) 00000100:00100000:3.0:1788835096.540976:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+22:11232:x1875729242433792:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1062us (1569us total) trans 4294967349 rc 0/0 00000100:00100000:3.0:1788835096.540985:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:2.0:1788835096.553643:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835096.553780:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242433920 00000100:00100000:1.0:1788835096.553791:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242433920 00000100:00100000:1.0:1788835096.553871:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:1.0:1788835096.553884:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+22:11232:x1875729242433920:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:1.0:1788835096.553968:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d20ad lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.553985:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d20ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.553998:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d20ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.554035:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d20ad lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.554042:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d20ad lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.554048:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d20ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.554053:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60c00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835096.554058:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d20ad lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.554066:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d20ad lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.554079:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:1.0:1788835096.554093:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788835096.554098:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d20ad lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.554105:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d20ad lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835096.554201:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+22:11232:x1875729242433920:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 320us (571us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835096.554208:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:2.0:1788835096.557529:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835096.557608:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242434048 00000100:00100000:3.0:1788835096.557617:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242434048 00000100:00100000:3.0:1788835096.557683:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:3.0:1788835096.557692:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba368a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+22:2386:x1875729242434048:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788835096.557709:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835096.557741:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d209f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0578 expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.557761:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:3.0:1788835096.557914:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835096.557972:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba368a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+21:2386:x1875729242434048:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 280us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835096.557980:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:0.0:1788835096.561001:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835096.561079:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242434304 00000100:00100000:3.0:1788835096.561097:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242434304 00000100:00100000:3.0:1788835096.561160:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:3.0:1788835096.561169:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+21:11232:x1875729242434304:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1788835096.561404:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+22:11232:x1875729242434304:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 235us (409us total) trans 4294967350 rc 0/0 00000100:00100000:3.0:1788835096.561412:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:2.0:1788835096.813643:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835096.813778:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242434560 00000100:00100000:3.0:1788835096.813788:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242434560 00000100:00100000:3.0:1788835096.813849:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 74 00000100:00100000:3.0:1788835096.813877:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+22:11250:x1875729242434560:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:3.0:1788835096.813920:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835096.813954:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d20b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae057f expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.814133:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d20bb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.814157:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d20bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.814177:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d20bb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835096.814196:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:3.0:1788835096.814366:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d20b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae057f expref: 25 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.814386:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d20bb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae057f expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.814394:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:3.0:1788835096.814397:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1788835096.814400:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204ae00, rc 0) 00000100:00100000:3.0:1788835096.814482:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba369f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+24:11250:x1875729242434560:12345-192.168.203.22@tcp:101:cat.0 Request processed in 610us (847us total) trans 4294967351 rc 0/0 00000100:00100000:3.0:1788835096.814489:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 74 00000100:00100000:2.0:1788835096.849858:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835096.850550:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242434688 00000100:00100000:1.0:1788835096.850563:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242434688 00000100:00100000:1.0:1788835096.850634:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 75 00000100:00100000:1.0:1788835096.850645:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+24:11251:x1875729242434688:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788835096.850670:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835096.850690:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d20c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0586 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.850773:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d20d0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.850789:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d20d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.851014:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d20d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835096.851070:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788835096.851074:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835096.851104:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d20d0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.851132:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d20c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0586 expref: 26 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.851150:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d20d0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0586 expref: 25 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835096.851169:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:1.0:1788835096.851172:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788835096.851176:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61000, rc 0) 00000100:00100000:1.0:1788835096.851250:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86629880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+25:11251:x1875729242434688:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 598us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835096.851258:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 75 00000100:00100000:1.0:1788835096.889055:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835096.889362:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242435072 00000100:00100000:3.0:1788835096.889374:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242435072 00000100:00100000:3.0:1788835096.889458:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:3.0:1788835096.889470:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+25:11251:x1875729242435072:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1788835096.889818:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+26:11251:x1875729242435072:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 349us (784us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1788835096.889826:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:2.0:1788835096.896425:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835096.896513:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242435200 00000100:00100000:3.0:1788835096.896523:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242435200 00000100:00100000:3.0:1788835096.896598:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:3.0:1788835096.896609:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86628a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+26:11251:x1875729242435200:12345-192.168.203.22@tcp:103:lfs.0 00010000:00010000:3.0:1788835096.896625:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1788835096.896652:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d2060 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae056a expref: 26 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.896677:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d20bb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0xd/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae057f expref: 25 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.896690:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d1f56 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0524 expref: 24 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.896700:0:9491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:3.0:1788835096.896705:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835096.898283:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86628a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+23:11251:x1875729242435200:12345-192.168.203.22@tcp:103:lfs.0 Request processed in 1667us (1859us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835096.898295:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:2.0:1788835096.914490:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835096.914575:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242435328 00000100:00100000:3.0:1788835096.914588:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242435328 00000100:00100000:3.0:1788835096.914660:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:3.0:1788835096.914683:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd8662ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+23:11251:x1875729242435328:12345-192.168.203.22@tcp:58:lfs.0 00010000:00010000:3.0:1788835096.914822:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d20d7 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.914840:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d20d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.914851:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d20d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788835096.915115:0:9806:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788835096.915246:0:9806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:3.0:1788835096.915384:0:9806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:3.0:1788835096.915473:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd8662ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+23:11251:x1875729242435328:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 790us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835096.915481:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:0.0:1788835096.961837:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835096.961916:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242435456 00000100:00100000:3.0:1788835096.961927:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242435456 00000100:00100000:3.0:1788835096.961988:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:3.0:1788835096.961999:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+23:11253:x1875729242435456:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788835096.962045:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835096.962068:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d20de lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae058d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962165:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d20e5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962183:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d20e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962221:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d20e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962241:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d20ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962249:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d20ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962256:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d20ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962390:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d20f3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962400:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d20f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962407:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d20f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835096.962458:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788835096.962463:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788835096.962485:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d20f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x53/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962498:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d20f3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962507:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d20e5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962528:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d20e5 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962535:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d20e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962542:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204bc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835096.962547:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d20e5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962556:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d20e5 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962571:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:3.0:1788835096.962574:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835096.962579:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d20e5 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962585:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d20e5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962604:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d20ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962610:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d20ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962616:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d20ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962622:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204a600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835096.962631:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d20ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962637:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d20ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962645:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afdb2e6e900) 00010000:00010000:3.0:1788835096.962648:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835096.962651:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d20ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962657:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d20ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962692:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d20de lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae058d expref: 25 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962707:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d20f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae058d expref: 24 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835096.962714:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:3.0:1788835096.962717:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788835096.962720:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204b000, rc 0) 00000100:00100000:3.0:1788835096.962789:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+24:11253:x1875729242435456:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 792us (964us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835096.962797:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 77 00010000:00010000:1.0:1788835097.063304:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788835097.128726:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788835097.128738:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788835097.128777:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788835097.128788:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788835097.128948:0:13768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd86629500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875729254052608:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788835097.129108:0:13768:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc836723c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788835097.134977:0:13768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd86629500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875729254052608:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788835097.135501:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835097.135662:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242435584 00000100:00100000:0.0:1788835097.135672:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242435584 00000100:00100000:0.0:1788835097.135761:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:0.0:1788835097.135772:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+24:11264:x1875729242435584:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788835097.135807:0:6488:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788835097.135956:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90480a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+24:11264:x1875729242435584:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 186us (457us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835097.135964:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00080000:3.0:1788835097.136274:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788835097.140839:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835097.141750:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242435712 00000100:00100000:3.0:1788835097.141763:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242435712 00000100:00100000:3.0:1788835097.141846:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:3.0:1788835097.141858:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+24:11264:x1875729242435712:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788835097.141946:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d20fa lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.141965:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d20fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.141979:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d20fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.143460:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2101 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.143495:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2101 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.143513:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2101 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.143574:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2108 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.143586:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2108 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.144265:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2108 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835097.144895:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00000004:00200000:3.0:1788835097.144904:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788835097.144928:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2108 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.144970:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d20fa lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.144978:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d20fa lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.144987:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d20fa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.144994:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204a200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835097.144999:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d20fa lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.145009:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d20fa lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.145032:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afc835ccc00) 00010000:00010000:3.0:1788835097.145035:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835097.145042:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d20fa lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.145050:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d20fa lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.145071:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2101 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.145078:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2101 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.145093:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2101 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.145106:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204a600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835097.145109:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2101 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.145116:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2101 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.145125:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x840cc931 (ffff9afdb2e6e900) 00010000:00010000:3.0:1788835097.145128:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835097.145131:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2101 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.145136:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2101 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x840cc931 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.146853:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2108 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.146862:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2108 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.146872:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2108 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.146879:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204bc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835097.146885:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2108 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.146893:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2108 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.146930:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:3.0:1788835097.146933:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835097.146938:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2108 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.146945:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2108 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835097.147104:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+24:11264:x1875729242435712:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 Request processed in 5240us (6270us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835097.147118:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:0.0:1788835097.153679:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835097.153769:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242435968 00000100:00100000:2.0:1788835097.153782:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242435968 00000100:00100000:2.0:1788835097.153857:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:2.0:1788835097.153869:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+24:11264:x1875729242435968:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788835097.153891:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835097.153917:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d210f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0594 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.154046:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2116 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.154063:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2116 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.154077:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2116 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835097.154111:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788835097.154192:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2116 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.154200:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2116 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.154207:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2116 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.154213:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374c000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835097.154218:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2116 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.154226:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2116 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.154240:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:2.0:1788835097.154245:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788835097.154251:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2116 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.154259:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2116 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.154309:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d210f lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0594 expref: 26 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.154352:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afc835ccc00) 00010000:00010000:2.0:1788835097.154355:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788835097.154365:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d210f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0594 expref: 26 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.154378:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374d600, rc 0) 00000100:00100000:2.0:1788835097.154456:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+25:11264:x1875729242435968:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 589us (790us total) trans 4294967353 rc 301/301 00000100:00100000:2.0:1788835097.154464:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:2.0:1788835097.162701:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835097.162787:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242436096 00000100:00100000:3.0:1788835097.162797:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242436096 00000100:00100000:3.0:1788835097.162861:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:3.0:1788835097.162871:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+25:11264:x1875729242436096:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788835097.162910:0:9806:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788835097.163256:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86629500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+25:11264:x1875729242436096:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 386us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835097.163264:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:3.0:1788835097.181688:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835097.186675:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242436352 00000100:00100000:0.0:1788835097.186695:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242436352 00000100:00100000:0.0:1788835097.186873:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:0.0:1788835097.186885:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+25:11264:x1875729242436352:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788835097.186911:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835097.186915:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788835097.188894:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d20d0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0586 expref: 25 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.188926:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:0.0:1788835097.188933:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788835097.189213:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2124 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae059b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788835097.190381:0:6489:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x3:0x0], index 1: 0 00010000:00010000:0.0:1788835097.192140:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d212b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.192228:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d212b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.192242:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d212b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.192373:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2124 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae059b expref: 27 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.192393:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d212b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae059b expref: 26 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.192401:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9afc835cc600) 00010000:00010000:0.0:1788835097.192404:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788835097.192407:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5600, rc 0) 00000100:00100000:0.0:1788835097.192478:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90483100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+26:11264:x1875729242436352:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 5594us (10800us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1788835097.192499:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:1.0:1788835097.198625:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835097.198699:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242436608 00000100:00100000:1.0:1788835097.198711:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242436608 00000100:00100000:1.0:1788835097.198783:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:1.0:1788835097.198795:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+26:11264:x1875729242436608:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788835097.198860:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835097.198894:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d212b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae059b expref: 26 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.198912:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9afc835cc600) 00010000:00010000:1.0:1788835097.198922:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788835097.198947:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2139 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.198971:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2139 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.198982:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2139 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.199052:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d2140 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xe65189c7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.199060:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d2140 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe65189c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.199066:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d2140 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe65189c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.199119:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2139 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.199126:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2139 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.199131:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2139 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.199136:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835097.199141:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2139 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.199149:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2139 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.199157:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:1.0:1788835097.199160:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835097.199164:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2139 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.199169:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2139 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.199186:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d2140 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xe65189c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.199192:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d2140 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe65189c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.199199:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d2140 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe65189c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.199204:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835097.199207:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d2140 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe65189c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.199212:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d2140 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xe65189c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.199219:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xe65189c7 (ffff9afdba168600) 00010000:00010000:1.0:1788835097.199222:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835097.199225:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d2140 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe65189c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.199230:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d2140 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xe65189c7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835097.199308:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+25:11264:x1875729242436608:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 515us (697us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788835097.199343:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:2.0:1788835097.203216:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835097.205241:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242436736 00000100:00100000:3.0:1788835097.205255:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242436736 00000100:00100000:3.0:1788835097.205354:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 84 00000100:00100000:3.0:1788835097.205366:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd8662bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+25:11264:x1875729242436736:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788835097.205388:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835097.205411:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d2147 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae05a2 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.205463:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d214e lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.205478:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d214e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.205488:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d214e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.205724:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d2147 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05a2 expref: 27 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.205742:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d214e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05a2 expref: 26 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.205750:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9afdb2e6e900) 00010000:00010000:3.0:1788835097.205753:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788835097.205756:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204bc00, rc 0) 00000100:00100000:3.0:1788835097.206637:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd8662bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+26:11264:x1875729242436736:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 1268us (3425us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835097.206647:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 84 00000100:00100000:2.0:1788835097.229706:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835097.231894:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242436992 00000100:00100000:0.0:1788835097.231911:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242436992 00000100:00100000:0.0:1788835097.232010:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 85 00000100:00100000:0.0:1788835097.232020:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd8662b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+26:11264:x1875729242436992:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788835097.232154:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2155 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.232173:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2155 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.232187:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2155 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788835097.234143:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:0.0:1788835097.234160:0:6488:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 339275844258ns, next at 340275840578ns, rc = 0 00000004:00010000:0.0:1788835097.234243:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6f3fbe7 reply state 000000007d1bf359 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2155 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.234266:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2155 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.234275:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9afdb2e6e900) 00010000:00010000:0.0:1788835097.234278:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788835097.234281:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788835097.234438:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd8662b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+28:11264:x1875729242436992:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 2415us (4739us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1788835097.234448:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 85 00000100:00100000:3.0:1788835097.236963:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835097.240795:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242437120 00000100:00100000:2.0:1788835097.240810:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242437120 00000100:00100000:3.0:1788835097.241829:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 86 00000100:00100000:3.0:1788835097.241842:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+28:11264:x1875729242437120:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788835097.241866:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835097.241887:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d215c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae05a9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.241981:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d215c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05a9 expref: 29 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.241997:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d215c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05a9 expref: 29 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.242016:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9afdb2e6e900) 00010000:00010000:3.0:1788835097.242020:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788835097.242024:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204b800, rc 0) 00000100:00100000:3.0:1788835097.242100:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90482300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+29:11264:x1875729242437120:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 261us (5148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835097.242108:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 86 00000100:00100000:3.0:1788835097.245659:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835097.245794:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242437248 00000100:00100000:2.0:1788835097.245805:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242437248 00000100:00100000:2.0:1788835097.245851:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:2.0:1788835097.245861:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2384:x1875729242437248:12345-192.168.203.22@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1788835097.245894:0:9814:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp t0 exp 0000000000000000 cur 339 last 0 00000020:00000080:2.0:1788835097.245923:0:9814:0:(genops.c:1385:class_connect()) connect: client b8987b33-76f7-43a0-9448-1013c4af787f, cookie 0xdf60171e5a5d2163 00002000:00100000:2.0:1788835097.245935:0:9814:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b8987b33-76f7-43a0-9448-1013c4af787f/ffff9afd82bff800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 8437760 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788835097.245944:0:9814:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788835097.246035:0:9814:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788835097.246066:0:9814:0:(import.c:65:import_set_state_nolock()) ffff9afd82bfd000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788835097.246144:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ed880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+6:2384:x1875729242437248:12345-192.168.203.22@tcp:8:lhsmtool_posix.0 Request processed in 282us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835097.246152:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:0.0:1788835097.271804:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835097.272000:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242437376 00000100:00100000:1.0:1788835097.272010:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242437376 00000100:00100000:1.0:1788835097.272091:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:1.0:1788835097.272107:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+6:0:x1875729242437376:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1788835097.272354:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1788835097.275504:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000001:00100000:3.0:1788835097.275524:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b8987b33-76f7-43a0-9448-1013c4af787f 00000100:00100000:1.0:1788835097.276870:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:0:x1875729242437376:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 4752us (5064us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1788835097.276886:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:3.0:1788835097.280134:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835097.280360:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242437632 00000100:00100000:2.0:1788835097.280371:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242437632 00000100:00100000:2.0:1788835097.280436:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:2.0:1788835097.280446:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+29:11264:x1875729242437632:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788835097.280744:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+30:11264:x1875729242437632:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 299us (620us total) trans 4294967356 rc 0/0 00000100:00100000:2.0:1788835097.280752:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:2.0:1788835097.285108:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835097.285380:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242437888 00000100:00100000:3.0:1788835097.285393:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242437888 00000100:00100000:3.0:1788835097.285472:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:3.0:1788835097.285484:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd8662a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+30:11264:x1875729242437888:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788835097.285609:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd8662a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+30:11264:x1875729242437888:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 127us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835097.285617:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:3.0:1788835097.290237:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835097.293106:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242438016 00000100:00100000:1.0:1788835097.293123:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242438016 00000100:00100000:1.0:1788835097.293205:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:1.0:1788835097.293216:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+30:11264:x1875729242438016:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788835097.293240:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835097.293263:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d216a lrc: 2/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae05b0 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.293366:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2171 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.293384:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2171 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.293397:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2171 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835097.293449:0:9806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835097.293471:0:9806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2171 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.293497:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d216a lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05b0 expref: 32 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.293518:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2171 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05b0 expref: 31 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.293542:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9afdb2e6e900) 00010000:00010000:1.0:1788835097.293546:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788835097.293550:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60800, rc 0) 00000100:00100000:1.0:1788835097.293640:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ed500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+31:11264:x1875729242438016:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 424us (3413us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835097.293647:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:2.0:1788835097.313016:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835097.313115:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242438144 00000100:00100000:3.0:1788835097.313151:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242438144 00000100:00100000:3.0:1788835097.313209:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:3.0:1788835097.313219:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242438144:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788835097.313237:0:9814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835097.313261:0:9814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000036725224/0xdf60171e5a5d2178 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae05b7 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788835097.313288:0:9814:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f751a, blocks: 0x0 00010000:00010000:3.0:1788835097.313307:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=339s v=(0 0) 00010000:00010000:3.0:1788835097.313311:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835097.313339:0:9814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000036725224/0xdf60171e5a5d2178 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05b7 expref: 6 pid: 9814 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.313363:0:9814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000036725224/0xdf60171e5a5d2178 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05b7 expref: 6 pid: 9814 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.313376:0:9814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204a600, rc 0) 00000100:00100000:3.0:1788835097.313434:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86628700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+6:2385:x1875729242438144:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 216us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835097.313442:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:2.0:1788835097.320785:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835097.321738:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242438400 00000100:00100000:0.0:1788835097.321751:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242438400 00000100:00100000:0.0:1788835097.321944:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 89 00000100:00100000:0.0:1788835097.321957:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+31:11264:x1875729242438400:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788835097.322093:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86628380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+31:11264:x1875729242438400:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 127us (1310us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835097.322101:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 89 00000100:00100000:0.0:1788835097.328446:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835097.328483:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242438528 00000100:00100000:0.0:1788835097.328493:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242438528 00000100:00100000:0.0:1788835097.328541:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:0.0:1788835097.328552:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+6:11264:x1875729242438528:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788835097.328581:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835097.328599:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d217f lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae05be expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.328630:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000036725224/0xdf60171e5a5d2178 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05b7 expref: 7 pid: 9814 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.328640:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835097.328645:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835097.328650:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d217f lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05be expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.328689:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000036725224/0xdf60171e5a5d2178 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05b7 expref: 7 pid: 9814 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.328726:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000036725224/0xdf60171e5a5d2178 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05b7 expref: 7 pid: 9814 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835097.328743:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8403:1875729254052736:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788835097.328841:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788835097.335853:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8403:1875729254052736:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788835097.335899:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d217f lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05be expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.335928:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5400, rc 0) 00000100:00100000:0.0:1788835097.336002:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+7:11264:x1875729242438528:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 7451us (7564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835097.336010:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:2.0:1788835097.338051:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835097.338157:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242438656 00000100:00100000:0.0:1788835097.338166:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242438656 00010000:00010000:0.0:1788835097.338209:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000036725224/0xdf60171e5a5d2178 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05b7 expref: 7 pid: 9814 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835097.338254:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:0.0:1788835097.338264:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86628e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+7:2386:x1875729242438656:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788835097.338281:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835097.338304:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000036725224/0xdf60171e5a5d2178 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05b7 expref: 7 pid: 9814 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.338373:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000036725224/0xdf60171e5a5d2178 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05b7 expref: 7 pid: 9814 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.338398:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000036725224/0xdf60171e5a5d2178 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05b7 expref: 7 pid: 9814 timeout: 439 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.338421:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835097.338426:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835097.338434:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d217f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05be expref: 6 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.338444:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d217f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05be expref: 6 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.338479:0:6474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d217f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05be expref: 6 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835097.338493:0:6474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6474:1875729254052864:192.168.203.22@tcp:105: 00000100:00100000:0.0:1788835097.338676:0:6474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b2000 going to sleep for 11 seconds 00000100:00100000:2.0:1788835097.354565:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835097.356392:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242438784 00000100:00100000:3.0:1788835097.356411:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242438784 00002000:00100000:3.0:1788835097.356475:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9afd8662b480 x1875729242438784/t0(0) o4->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:18/0 lens 504/0 e 0 to 0 dl 1788835108 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788835097.356488:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afd8662b480 with x1875729242438784 ext(0->8) 00002000:00010000:3.0:1788835097.356494:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afd8662b480 00000100:00100000:3.0:1788835097.356544:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:3.0:1788835097.356568:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd8662b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b8987b33-76f7-43a0-9448-1013c4af787f+7:2385:x1875729242438784:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788835097.362663:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd8662b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b8987b33-76f7-43a0-9448-1013c4af787f+9:2385:x1875729242438784:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 Request processed in 6096us (8112us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788835097.362676:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00002000:00100000:3.0:1788835097.362690:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x3:0x0] (0->8) req@ffff9afd8662b480 x1875729242438784/t4294967303(0) o4->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:18/0 lens 504/448 e 0 to 0 dl 1788835108 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788835097.362700:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afd8662b480 with x1875729242438784 ext(0->8) 00002000:00010000:3.0:1788835097.362705:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afd8662b480 00000100:00100000:0.0:1788835097.366445:0:6474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6474:1875729254052864:192.168.203.22@tcp:105: 00010000:00010000:0.0:1788835097.366472:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835097.366539:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86628e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+8:2386:x1875729242438656:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 28276us (28497us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835097.366626:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:2.0:1788835097.381602:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfacdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254052992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788835097.381689:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835097.381816:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254052992 00000100:00100000:1.0:1788835097.381825:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254052992 00000100:00100000:1.0:1788835097.381887:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788835097.381897:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254052992:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788835097.381934:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788835097.381989:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86629c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254052992:12345-0@lo:41:osp-pre-0-1.0 Request processed in 93us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835097.381995:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1788835097.382039:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfacdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254052992:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788835097.389051:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835097.389236:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242438912 00000100:00100000:1.0:1788835097.389246:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242438912 00000100:00100000:1.0:1788835097.389312:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 90 00000100:00100000:1.0:1788835097.389337:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+31:11264:x1875729242438912:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788835097.396461:0:6467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967356 is committed 00000004:00080000:3.0:1788835097.396489:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:1.0:1788835097.397720:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2052 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.397738:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2052 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.397746:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2052 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.397761:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835097.397767:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2052 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.397775:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2052 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.397793:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:1.0:1788835097.397796:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835097.397802:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2052 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.397808:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2052 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.397829:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2155 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.397835:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2155 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.397840:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2155 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.397845:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835097.397847:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2155 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.397853:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2155 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.397871:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9afdb2e6e900) 00010000:00010000:1.0:1788835097.397873:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788835097.397876:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2155 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.397881:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2155 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835097.408930:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd86629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254053120:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788835097.409005:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835097.409208:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254053120 00000100:00100000:2.0:1788835097.409216:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254053120 00000100:00100000:2.0:1788835097.409289:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788835097.409299:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254053120:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788835097.409618:0:9814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788835097.409622:0:9814:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788835098 00002000:00010000:2.0:1788835097.409625:0:9814:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788835097.409627:0:9814:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788835098 -> 1788835098 00002000:00010000:2.0:1788835097.409629:0:9814:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788835097.409676:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83682300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729254053120:12345-0@lo:2:osp-syn-1-0.0 Request processed in 378us (670us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1788835097.409684:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000020:00080000:3.0:1788835097.409939:0:6467:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:2.0:1788835097.409991:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1788835097.410015:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00080000:0.0:1788835097.410787:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1788835097.410833:0:3614:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afd86629f80/2, rc 0, transno 4294967304 00000100:00100000:0.0:1788835097.410842:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd86629f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254053120:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1788835097.421824:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86628000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+14:11264:x1875729242438912:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 Request processed in 32481us (32774us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835097.421837:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 90 00000100:00100000:3.0:1788835097.428222:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835097.428360:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242439040 00000100:00100000:0.0:1788835097.428371:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242439040 00000100:00100000:0.0:1788835097.428422:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:0.0:1788835097.428432:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+8:2388:x1875729242439040:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1788835097.431605:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1788835097.431621:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000100:00100000:1.0:1788835097.431890:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ec700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+6:2388:x1875729242439040:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 Request processed in 3452us (3670us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835097.431903:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:2.0:1788835097.445380:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835097.445469:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242439296 00000100:00100000:1.0:1788835097.445479:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242439296 00000100:00100000:1.0:1788835097.445551:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 91 00000100:00100000:1.0:1788835097.445571:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd8662aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+14:11264:x1875729242439296:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788835097.445621:0:9806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835097.445646:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2171 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05b0 expref: 14 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.445662:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9afdb2e6e900) 00010000:00010000:1.0:1788835097.445667:0:9806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788835097.445695:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2186 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.445726:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2186 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.445737:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2186 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788835097.445856:0:9806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fdcc30ed reply state 0000000070013333 transno 4294967357 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2186 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.445869:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2186 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.445875:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9afdb2e6e900) 00010000:00010000:1.0:1788835097.445878:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788835097.445880:0:9806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788835097.445983:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd8662aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+15:11264:x1875729242439296:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 413us (611us total) trans 4294967357 rc 0/0 00000100:00100000:1.0:1788835097.445991:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 91 00000100:00100000:2.0:1788835097.458520:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835097.459532:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242439424 00000100:00100000:3.0:1788835097.459557:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242439424 00000100:00100000:3.0:1788835097.459629:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:3.0:1788835097.459640:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+6:2385:x1875729242439424:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788835097.460101:0:9814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788835097.460106:0:9814:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788835098 -> 1788835097 00002000:00010000:3.0:1788835097.460109:0:9814:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 0 -> 1788835095 00002000:00010000:3.0:1788835097.460112:0:9814:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788835098 -> 1788835097 00002000:00010000:3.0:1788835097.460114:0:9814:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:0.0:1788835097.460288:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86629180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+7:2385:x1875729242439424:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 647us (1775us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1788835097.460298:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:0.0:1788835097.476206:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835097.476354:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242439680 00000100:00100000:2.0:1788835097.476363:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242439680 00000100:00100000:2.0:1788835097.476417:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 92 00000100:00100000:2.0:1788835097.476427:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+15:11264:x1875729242439680:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788835097.476495:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d218d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.476513:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d214e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05a2 expref: 15 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.476523:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d218d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.476558:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d214e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05a2 expref: 15 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.476574:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d214e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05a2 expref: 15 pid: 9806 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835097.476589:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd8662b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1875729254053248:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788835097.476693:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc836723c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788835097.481179:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd8662b800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1875729254053248:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788835097.481210:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d218d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835097.484255:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835097.484530:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242439808 00000100:00100000:3.0:1788835097.484542:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242439808 00010000:00010000:3.0:1788835097.484588:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d214e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05a2 expref: 16 pid: 9806 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835097.484656:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:3.0:1788835097.484667:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+16:2386:x1875729242439808:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788835097.484685:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835097.484693:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d214e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05a2 expref: 16 pid: 9806 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.484706:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d214e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05a2 expref: 16 pid: 9806 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.484733:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d214e lrc: 0/0,0 mode: --/PR res: [0x200000402:0x6:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05a2 expref: 16 pid: 9806 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.484749:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9afdb2e6e900) 00010000:00010000:3.0:1788835097.484754:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d218d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.484764:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d218d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.484772:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d218d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.484797:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835097.484857:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+15:2386:x1875729242439808:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 192us (615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835097.484866:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 60 00010000:00010000:0.0:1788835097.485380:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d218d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.485391:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d218d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.485438:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d218d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.485445:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d218d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.485452:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d218d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.485470:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374dc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835097.485475:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d218d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.485483:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d218d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.485497:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9afdb2e6e900) 00010000:00010000:0.0:1788835097.485500:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1788835097.485503:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d218d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.485510:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d218d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835097.485568:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+14:11264:x1875729242439680:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 Request processed in 9141us (9369us total) trans 0 rc -22/-22 00000100:00100000:0.0:1788835097.485578:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 92 00000100:00100000:3.0:1788835097.495389:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835097.495525:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242439936 00000100:00100000:1.0:1788835097.495535:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242439936 00000100:00100000:1.0:1788835097.495591:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:1.0:1788835097.495601:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+7:2387:x1875729242439936:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788835097.495643:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2194 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.495662:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d217f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05be expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.495682:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835097.495685:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788835097.495690:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2194 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.495726:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d217f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05be expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.495740:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d217f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05be expref: 7 pid: 8403 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835097.495754:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfacdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8403:1875729254053376:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788835097.495836:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc836eb000 going to sleep for 11 seconds 00000100:00100000:1.0:1788835097.501507:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfacdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8403:1875729254053376:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788835097.501538:0:8403:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2194 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835097.504092:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835097.504503:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242440064 00000100:00100000:2.0:1788835097.504514:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242440064 00010000:00010000:2.0:1788835097.504563:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d217f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05be expref: 8 pid: 8403 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835097.504617:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:2.0:1788835097.504628:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+8:2385:x1875729242440064:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835097.504650:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835097.504675:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d217f lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05be expref: 8 pid: 8403 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.504690:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d217f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05be expref: 8 pid: 8403 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.504719:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d217f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05be expref: 8 pid: 8403 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.504741:0:9491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788835097.504746:0:9491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788835097.504750:0:9491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2194 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.504761:0:9491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2194 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.504811:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835097.504880:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ee300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+7:2385:x1875729242440064:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 253us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835097.504888:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 61 00010000:00010000:1.0:1788835097.504950:0:8403:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2194 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.504959:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2194 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.504978:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2194 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.504992:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2194 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.505000:0:8403:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2194 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.505007:0:8403:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:1.0:1788835097.505011:0:8403:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2194 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.505020:0:8403:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2194 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.505044:0:8403:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2194 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.505052:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2194 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835097.505108:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ec000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+6:2387:x1875729242439936:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 Request processed in 9508us (9728us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835097.505115:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:3.0:1788835097.518495:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835097.518640:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242440320 00000100:00100000:1.0:1788835097.518650:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242440320 00000100:00100000:1.0:1788835097.518700:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 93 00000100:00100000:1.0:1788835097.518723:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+14:11264:x1875729242440320:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1788835097.518803:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d219b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.518818:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1fdb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0547 expref: 14 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.518828:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d219b lrc: 4/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.518864:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1fdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0547 expref: 14 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.518878:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1fdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0547 expref: 14 pid: 6489 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835097.518893:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfacdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875729254053504:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788835097.518981:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc836eb000 going to sleep for 11 seconds 00000100:00100000:3.0:1788835097.521752:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835097.521855:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfacdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875729254053504:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788835097.521884:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d219b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835097.521954:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242440448 00000100:00100000:2.0:1788835097.521963:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242440448 00010000:00010000:2.0:1788835097.521996:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1fdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0547 expref: 15 pid: 6489 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835097.522040:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:2.0:1788835097.522049:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaae6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+15:2386:x1875729242440448:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835097.522064:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835097.522071:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1fdb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0547 expref: 15 pid: 6489 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.522094:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1fdb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0547 expref: 15 pid: 6489 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.522116:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d1fdb lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0547 expref: 15 pid: 6489 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.522132:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:2.0:1788835097.522137:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d219b lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.522158:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d219b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.522180:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d219b lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.522205:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835097.522269:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaae6b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+14:2386:x1875729242440448:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 220us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835097.522277:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 62 00010000:00010000:1.0:1788835097.522553:0:6487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d219b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.522561:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d219b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.522757:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21a2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.522777:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d215c lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05a9 expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.522784:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21a2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.522812:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d215c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05a9 expref: 14 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.522825:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d215c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05a9 expref: 14 pid: 6487 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835097.522837:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfacdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875729254053632:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788835097.522902:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc836eb900 going to sleep for 11 seconds 00000100:00100000:3.0:1788835097.527365:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835097.531176:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242440576 00000100:00100000:2.0:1788835097.531198:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242440576 00010000:00010000:2.0:1788835097.531275:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d215c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05a9 expref: 15 pid: 6487 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835097.531343:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:2.0:1788835097.531354:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+15:2385:x1875729242440576:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835097.531370:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835097.531376:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d215c lrc: 5/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05a9 expref: 15 pid: 6487 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.531390:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d215c lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05a9 expref: 15 pid: 6487 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.531416:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9afdb2e6e900) 00010000:00010000:2.0:1788835097.531422:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21a2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.531432:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.531459:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21a2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835097.531481:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835097.531551:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ef100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+15:2385:x1875729242440576:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 198us (4194us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835097.531559:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00010000:00010000:1.0:1788835097.539242:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d215c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05a9 expref: 14 pid: 6487 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835097.539277:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfacdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875729254053632:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788835097.539304:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.540226:0:6487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.540238:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788835097.540393:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:1.0:1788835097.540535:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000001:00080000:1.0:1788835097.540575:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:1.0:1788835097.540670:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfacdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6487:1875729254053760:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788835097.540746:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835097.540796:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc836eb480 going to sleep for 11 seconds 00000100:00100000:2.0:1788835097.540883:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254053760 00000100:00100000:2.0:1788835097.540890:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254053760 00000100:00100000:2.0:1788835097.540941:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788835097.540952:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6487:x1875729254053760:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788835097.541049:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6487:x1875729254053760:12345-0@lo:1000:mdt00_000.0 Request processed in 98us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835097.541057:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788835097.542576:0:6487:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1788835097.542587:0:6487:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afd86629f80, transno 4294967304 00000100:00100000:1.0:1788835097.542647:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfacdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6487:1875729254053760:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1788835097.542835:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00000100:00100000:1.0:1788835097.542919:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfacdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6487:1875729254053888:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788835097.542989:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835097.543041:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc836eb600 going to sleep for 11 seconds 00000100:00100000:0.0:1788835097.544372:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254053888 00000100:00100000:0.0:1788835097.544384:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254053888 00000100:00100000:0.0:1788835097.544450:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1788835097.544461:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6487:x1875729254053888:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1788835097.544650:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6487:x1875729254053888:12345-0@lo:1000:mdt00_000.0 Request processed in 190us (1659us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1788835097.544659:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788835097.544774:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfacdc00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6487:1875729254053888:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1788835097.544824:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21a2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.544834:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21a2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.544843:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21a2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.544850:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835097.544855:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21a2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.544863:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21a2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.544878:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9afdb2e6e900) 00010000:00010000:1.0:1788835097.544890:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788835097.544896:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21a2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.544903:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21a2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.544942:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d20d7 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.544948:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d20d7 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.544954:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d20d7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.544960:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204ae00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835097.544964:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d20d7 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.544971:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d20d7 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.544979:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:1.0:1788835097.544981:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788835097.544984:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d20d7 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.544989:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d20d7 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.545014:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21a9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.545051:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d20f3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae058d expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.545060:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21a9 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.545102:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d20f3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae058d expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.545117:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d20f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae058d expref: 17 pid: 6487 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835097.545131:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfacea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875729254054016:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788835097.545231:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc836eb600 going to sleep for 11 seconds 00000100:00100000:0.0:1788835097.549228:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835097.549264:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242440704 00000100:00100000:0.0:1788835097.549274:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242440704 00010000:00010000:0.0:1788835097.549349:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d20f3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae058d expref: 18 pid: 6487 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835097.549388:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:0.0:1788835097.549397:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+18:2386:x1875729242440704:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788835097.549413:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835097.549421:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d20f3 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae058d expref: 18 pid: 6487 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.549434:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d20f3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae058d expref: 18 pid: 6487 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.549456:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:0.0:1788835097.549461:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21a9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.549472:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.549480:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21a9 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835097.549500:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835097.549564:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+18:2386:x1875729242440704:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 167us (347us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835097.549571:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00010000:00010000:1.0:1788835097.550816:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d20f3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae058d expref: 17 pid: 6487 timeout: 439 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835097.550841:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfacea00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875729254054016:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788835097.550863:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.550872:0:6487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.550878:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.550891:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21a9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.550921:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21a9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.550929:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21a9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.550936:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835097.551210:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21a9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.551221:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21a9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.551236:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:1.0:1788835097.551239:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835097.551254:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21a9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.551261:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21a9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.551273:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d219b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.551280:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d219b lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.551286:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d219b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.551291:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835097.551301:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d219b lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.551307:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d219b lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.551336:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168b00) 00010000:00010000:1.0:1788835097.551339:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788835097.551342:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d219b lrc: 2/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835097.551348:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d219b lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835097.551537:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ece00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+16:11264:x1875729242440320:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 32814us (33051us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1788835097.551547:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 93 00000020:00080000:1.0:1788835097.551554:0:6487:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1788835097.552465:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788835097.552473:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788835097.552493:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1788835097.552509:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788835097.567891:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835097.567971:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242440960 00000100:00100000:3.0:1788835097.567981:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242440960 00000100:00100000:3.0:1788835097.568049:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:3.0:1788835097.568060:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+16:11264:x1875729242440960:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788835097.568396:0:6491:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788835097.568439:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967363 00010000:00010000:3.0:1788835097.568479:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d21b0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.568499:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d21b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.568514:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d21b0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.568523:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d21b0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.568529:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d21b0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.568536:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d21b0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.568556:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788835097.568665:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+18:11264:x1875729242440960:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 606us (785us total) trans 4294967364 rc 0/0 00000100:00100000:3.0:1788835097.568687:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000020:00080000:3.0:1788835097.568693:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788835097.568739:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788835097.568747:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d21b0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.568755:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204bc00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:3.0:1788835097.568760:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d21b0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.568769:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d21b0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.568782:0:7429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9afdb2e6e900) 00010000:00010000:3.0:1788835097.568785:0:7429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788835097.568791:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d21b0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.568797:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d21b0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x6:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835097.568811:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835097.568813:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835097.568814:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788835098.051708:0:14178:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788835098.051720:0:14178:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788835098.051760:0:14178:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1788835098.051767:0:14178:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788835098.086786:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835098.272504:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835098.272607:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242441216 00000100:00100000:3.0:1788835098.272625:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242441216 00000100:00100000:0.0:1788835098.272882:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 94 00000100:00100000:0.0:1788835098.272895:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+18:11275:x1875729242441216:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788835098.272927:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835098.272952:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d21b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae05c5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835098.273091:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d21be lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835098.273106:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d21be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835098.273118:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d21be lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788835098.273129:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00010000:00010000:0.0:1788835098.273250:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d21b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05c5 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835098.273270:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d21be lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05c5 expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835098.273278:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:0.0:1788835098.273281:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788835098.273284:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5e00, rc 0) 00000100:00100000:0.0:1788835098.273360:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa43800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+20:11275:x1875729242441216:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 468us (873us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1788835098.273383:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 94 00000100:00100000:0.0:1788835098.285042:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835098.285838:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242441344 00000100:00100000:1.0:1788835098.285849:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242441344 00000100:00100000:1.0:1788835098.285899:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 95 00000100:00100000:1.0:1788835098.285910:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+20:11275:x1875729242441344:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:1.0:1788835098.285981:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d21cc lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.285996:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d21cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286008:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d21cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286039:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286047:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286055:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286138:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21da lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286147:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286154:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788835098.286195:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286207:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d21cc lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286214:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d21cc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286222:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d21cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286228:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835098.286233:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d21cc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286247:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d21cc lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286259:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:1.0:1788835098.286263:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835098.286267:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d21cc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286274:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d21cc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286284:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286291:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286296:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286302:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835098.286305:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286311:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286340:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afdba168600) 00010000:00010000:1.0:1788835098.286343:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835098.286346:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286362:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d21d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286377:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21da lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286385:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21da lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286391:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286397:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835098.286400:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21da lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286407:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21da lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286416:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afdba168e00) 00010000:00010000:1.0:1788835098.286418:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835098.286420:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21da lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.286426:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d21da lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835098.286499:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+20:11275:x1875729242441344:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 589us (1465us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835098.286507:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 95 00000100:00100000:2.0:1788835098.332827:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835098.332865:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242441600 00000100:00100000:2.0:1788835098.332874:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242441600 00000100:00100000:2.0:1788835098.332925:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 96 00000100:00100000:2.0:1788835098.332935:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+20:11278:x1875729242441600:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788835098.332954:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835098.332974:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d21e1 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae05cc expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333053:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d21e8 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333067:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d21e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333089:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d21e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333104:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d21ef lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333111:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d21ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333117:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d21ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333237:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d21f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333246:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d21f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333253:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d21f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835098.333263:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:2.0:1788835098.333366:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d21e8 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333374:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d21e8 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333388:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d21e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333394:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835098.333398:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d21e8 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333405:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d21e8 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333416:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:2.0:1788835098.333418:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835098.333423:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d21e8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333429:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d21e8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333440:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d21ef lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333445:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d21ef lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333450:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d21ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333455:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374ce00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835098.333457:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d21ef lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333472:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d21ef lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333479:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afda01ec900) 00010000:00010000:2.0:1788835098.333481:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835098.333483:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d21ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333488:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d21ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333525:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d21e1 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05cc expref: 23 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333538:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d21f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05cc expref: 22 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.333544:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ecb00) 00010000:00010000:2.0:1788835098.333546:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788835098.333549:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374d200, rc 0) 00000100:00100000:2.0:1788835098.333603:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86628a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+22:11278:x1875729242441600:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 669us (782us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1788835098.333611:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 96 00000100:00100000:2.0:1788835098.340489:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835098.340558:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242441728 00000100:00100000:3.0:1788835098.340567:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242441728 00000100:00100000:3.0:1788835098.340634:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00100000:3.0:1788835098.340646:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+22:11278:x1875729242441728:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:3.0:1788835098.340728:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2204 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.340745:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2204 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.340757:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2204 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.340791:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2204 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.340798:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2204 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.340805:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2204 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.340811:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204bc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835098.340815:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2204 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.340822:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2204 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.340834:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ecb00) 00010000:00010000:3.0:1788835098.340837:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788835098.340842:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2204 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.340849:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d2204 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835098.340932:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86628e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+22:11278:x1875729242441728:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 289us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835098.340941:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00100000:2.0:1788835098.343382:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835098.343430:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242441984 00000100:00100000:3.0:1788835098.343438:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242441984 00000100:00100000:3.0:1788835098.343490:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:3.0:1788835098.343500:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84e65450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+22:11278:x1875729242441984:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1788835098.343768:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84e65450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+23:11278:x1875729242441984:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 268us (394us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1788835098.343776:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:2.0:1788835098.391478:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835098.391521:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242442240 00000100:00100000:2.0:1788835098.391530:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242442240 00000100:00100000:2.0:1788835098.391593:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 98 00000100:00100000:2.0:1788835098.391603:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd8662b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+23:10804:x1875729242442240:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1788835098.392782:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835098.392805:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d220b lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae05d3 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.392925:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2212 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.392943:0:9806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d21f6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05cc expref: 24 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.392952:0:9806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2212 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.392988:0:9806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d21f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05cc expref: 24 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.393005:0:9806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d21f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05cc expref: 24 pid: 6487 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835098.393020:0:9806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd8662a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9806:1875729254054144:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788835098.393140:0:9806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82e76000 going to sleep for 11 seconds 00000100:00100000:3.0:1788835098.402486:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835098.402544:0:9806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd8662a680 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9806:1875729254054144:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788835098.402571:0:9806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2212 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835098.402600:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242442368 00000100:00100000:3.0:1788835098.402606:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242442368 00010000:00010000:3.0:1788835098.402653:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d21f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05cc expref: 25 pid: 6487 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835098.402689:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:3.0:1788835098.402698:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+25:2386:x1875729242442368:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788835098.402727:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835098.402735:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d21f6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05cc expref: 25 pid: 6487 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.402760:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d21f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05cc expref: 25 pid: 6487 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.402781:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d21f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05cc expref: 25 pid: 6487 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.402797:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ecb00) 00010000:00010000:3.0:1788835098.402802:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2212 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.402811:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2212 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.402819:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2212 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.402838:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835098.402885:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ef800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+24:2386:x1875729242442368:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 188us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835098.402892:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 65 00010000:00010000:3.0:1788835098.403016:0:9806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2212 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.403029:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2212 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835098.403045:0:9806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 9 00010000:00010000:3.0:1788835098.404395:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d220b lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05d3 expref: 25 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.404439:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2212 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05d3 expref: 24 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.404448:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ecb00) 00010000:00010000:3.0:1788835098.404451:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788835098.404454:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374ce00, rc 0) 00000100:00100000:3.0:1788835098.404507:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd8662b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+24:10804:x1875729242442240:12345-192.168.203.22@tcp:101:bash.0 Request processed in 12906us (13039us total) trans 4294967368 rc 0/0 00000100:00100000:3.0:1788835098.404516:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 98 00000100:00100000:3.0:1788835098.412136:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835098.413129:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242442496 00000100:00100000:1.0:1788835098.413271:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242442496 00000100:00100000:1.0:1788835098.413358:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 99 00000100:00100000:1.0:1788835098.413368:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+24:10804:x1875729242442496:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1788835098.413392:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835098.413413:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2220 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae05da expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.413446:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2227 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.413461:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2227 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.413472:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2227 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.413585:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2220 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05da expref: 26 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.413602:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2227 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05da expref: 25 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.413611:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ecb00) 00010000:00010000:1.0:1788835098.413614:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788835098.413618:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60800, rc 0) 00000100:00100000:1.0:1788835098.414833:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ee300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+25:10804:x1875729242442496:12345-192.168.203.22@tcp:101:bash.0 Request processed in 1460us (2702us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835098.414843:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 99 00000100:00100000:3.0:1788835098.419900:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835098.419976:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242442752 00000100:00100000:1.0:1788835098.419985:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242442752 00000100:00100000:1.0:1788835098.420054:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 100 00000100:00100000:1.0:1788835098.420065:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+25:10804:x1875729242442752:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:1.0:1788835098.421433:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d222e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.421454:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d222e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.421467:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d222e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788835098.421511:0:6489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000004:00010000:1.0:1788835098.421533:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e123e8fe reply state 0000000041e456ba transno 4294967370 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d222e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.421546:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d222e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.421554:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ecb00) 00010000:00010000:1.0:1788835098.421557:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788835098.421561:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788835098.421601:0:6489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967370 00000100:00100000:1.0:1788835098.421705:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83dec000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+29:10804:x1875729242442752:12345-192.168.203.22@tcp:36:bash.0 Request processed in 1640us (1812us total) trans 4294967371 rc 0/0 00000100:00100000:1.0:1788835098.421714:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 100 00000020:00080000:1.0:1788835098.421719:0:6489:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1788835098.427175:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835098.427247:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242442880 00000100:00100000:0.0:1788835098.427256:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242442880 00000100:00100000:0.0:1788835098.427348:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 101 00000100:00100000:0.0:1788835098.427360:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+29:10804:x1875729242442880:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1788835098.427383:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835098.427401:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2235 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae05e1 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835098.427459:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2235 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05e1 expref: 30 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835098.427474:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2235 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05e1 expref: 30 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835098.427493:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ecb00) 00010000:00010000:0.0:1788835098.427496:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788835098.427500:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5600, rc 0) 00000100:00100000:0.0:1788835098.427553:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+30:10804:x1875729242442880:12345-192.168.203.22@tcp:101:bash.0 Request processed in 196us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835098.427561:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 101 00000100:00100000:0.0:1788835098.443872:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835098.443941:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242443008 00000100:00100000:2.0:1788835098.443951:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242443008 00000100:00100000:2.0:1788835098.444005:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:2.0:1788835098.444014:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+6:10804:x1875729242443008:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1788835098.444040:0:9814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835098.444087:0:9814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa97d7b3/0xdf60171e5a5d223c lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae05e8 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788835098.444111:0:9814:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f7519, atime: 0x6a9f7517, ctime: 0x6a9f7519, blocks: 0x8 00010000:00010000:2.0:1788835098.444131:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=340s v=(0 0) 00010000:00010000:2.0:1788835098.444145:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835098.444154:0:9814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa97d7b3/0xdf60171e5a5d223c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05e8 expref: 7 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.444173:0:9814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aa97d7b3/0xdf60171e5a5d223c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05e8 expref: 7 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.444185:0:9814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374d600, rc 0) 00000100:00100000:2.0:1788835098.444240:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+7:10804:x1875729242443008:12345-192.168.203.22@tcp:101:bash.0 Request processed in 227us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835098.444248:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:3.0:1788835098.447647:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835098.447729:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242443136 00000100:00100000:2.0:1788835098.447739:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242443136 00002000:00010000:2.0:1788835098.447774:0:8408:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1788835098.447780:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afd8543bb80 with x1875729242443136 ext(0->18446744073709551615) 00002000:00010000:2.0:1788835098.447790:0:8408:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afd8543bb80. 00000100:00100000:2.0:1788835098.447826:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:2.0:1788835098.447836:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd8543bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b8987b33-76f7-43a0-9448-1013c4af787f+7:2386:x1875729242443136:12345-192.168.203.22@tcp:10:bash.0 00002000:00010000:2.0:1788835098.448109:0:8408:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1788835098.448112:0:8408:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb mtime from disk: 1788835097 -> 1788835099 00002000:00010000:2.0:1788835098.448115:0:8408:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb atime from disk: 1788835095 -> 1788835095 00002000:00010000:2.0:1788835098.448124:0:8408:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb ctime from disk: 1788835097 -> 1788835099 00002000:00010000:2.0:1788835098.448126:0:8408:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x3:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:2.0:1788835098.448198:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd8543bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b8987b33-76f7-43a0-9448-1013c4af787f+8:2386:x1875729242443136:12345-192.168.203.22@tcp:10:bash.0 Request processed in 364us (572us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1788835098.448206:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00002000:00010000:2.0:1788835098.448209:0:8408:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/3 (0->18446744073709551615) 00002000:00100000:2.0:1788835098.448211:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afd8543bb80 with x1875729242443136 ext(0->18446744073709551615) 00002000:00010000:2.0:1788835098.448216:0:8408:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afd8543bb80. 00000100:00100000:3.0:1788835098.587491:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835098.587648:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242443264 00000100:00100000:1.0:1788835098.587666:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242443264 00000100:00100000:1.0:1788835098.587738:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 102 00000100:00100000:1.0:1788835098.587761:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd8543b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+30:11292:x1875729242443264:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:1.0:1788835098.587833:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2243 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.587849:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2243 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.587862:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2243 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.587876:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d224a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.587883:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d224a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.587889:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d224a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.587959:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2251 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.587969:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2251 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.587975:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2251 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788835098.588016:0:9047:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2251 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588026:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2243 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588037:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2243 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588044:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2243 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588049:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835098.588053:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2243 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588060:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2243 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588083:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:1.0:1788835098.588086:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835098.588090:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2243 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588095:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2243 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588108:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d224a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588114:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d224a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588120:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d224a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588125:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835098.588133:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d224a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588139:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d224a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588292:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afdba168e00) 00010000:00010000:1.0:1788835098.588296:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835098.588300:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d224a lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588305:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d224a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588374:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2251 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588380:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2251 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588386:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2251 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588391:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60c00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835098.588395:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2251 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588401:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2251 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588409:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ecb00) 00010000:00010000:1.0:1788835098.588411:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835098.588421:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2251 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.588427:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2251 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835098.588515:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd8543b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+30:11292:x1875729242443264:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 754us (1032us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835098.588524:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 102 00000100:00100000:0.0:1788835098.684663:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835098.684747:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242443520 00000100:00100000:3.0:1788835098.684757:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242443520 00000100:00100000:3.0:1788835098.684815:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 103 00000100:00100000:3.0:1788835098.684825:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+30:11295:x1875729242443520:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788835098.684845:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835098.684866:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d2258 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae05ef expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.684941:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d225f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.684956:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d225f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.684981:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d225f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.685000:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2266 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.685658:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835098.685669:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.689993:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d226d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.690921:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d226d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.690937:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d226d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835098.690952:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 0 00010000:00010000:2.0:1788835098.691089:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d225f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.691098:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d225f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.691106:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d225f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.691112:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204bc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835098.691116:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d225f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.691155:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d225f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.691169:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:2.0:1788835098.691172:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835098.691177:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d225f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.691183:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d225f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.691202:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2266 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.691208:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2266 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.691212:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2266 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.691217:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204b000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835098.691220:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2266 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.691355:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2266 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.691367:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afc810b8000) 00010000:00010000:2.0:1788835098.691370:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835098.691373:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2266 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.691388:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d2266 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.691441:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d2258 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05ef expref: 33 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.691459:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d226d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05ef expref: 32 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.691466:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ecb00) 00010000:00010000:2.0:1788835098.691469:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788835098.691471:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374dc00, rc 0) 00000100:00100000:2.0:1788835098.691549:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+32:11295:x1875729242443520:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 6724us (6896us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1788835098.691558:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 103 00000100:00100000:0.0:1788835098.695183:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835098.695247:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242443648 00000100:00100000:1.0:1788835098.695258:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242443648 00000100:00100000:1.0:1788835098.695362:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 104 00000100:00100000:1.0:1788835098.695374:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+32:11295:x1875729242443648:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:1.0:1788835098.695447:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d227b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.695464:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2212 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05d3 expref: 32 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.695474:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d227b lrc: 4/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.695507:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2212 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05d3 expref: 32 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.695521:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2212 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05d3 expref: 32 pid: 9806 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835098.695534:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfacea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1875729254054272:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788835098.695649:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc836eb240 going to sleep for 11 seconds 00000100:00100000:0.0:1788835098.713747:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835098.714814:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfacea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1875729254054272:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788835098.714842:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d227b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835098.715037:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242443904 00000100:00100000:3.0:1788835098.715044:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242443904 00000100:00100000:3.0:1788835098.715112:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:3.0:1788835098.715123:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+33:6157:x1875729242443904:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788835098.716029:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+34:6157:x1875729242443904:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 903us (2290us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1788835098.716038:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:0.0:1788835098.723544:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835098.723703:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242444032 00000100:00100000:2.0:1788835098.723714:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242444032 00010000:00010000:2.0:1788835098.723757:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2212 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05d3 expref: 34 pid: 9806 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835098.723802:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:2.0:1788835098.723813:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+34:2385:x1875729242444032:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835098.723829:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835098.723836:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2212 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05d3 expref: 34 pid: 9806 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.723871:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2212 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05d3 expref: 34 pid: 9806 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.723893:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2212 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x4:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05d3 expref: 34 pid: 9806 timeout: 440 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.723909:0:9491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ecb00) 00010000:00010000:2.0:1788835098.723914:0:9491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d227b lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.723924:0:9491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d227b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.723932:0:9491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d227b lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.723971:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835098.724039:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f34a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+33:2385:x1875729242444032:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 227us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835098.724047:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 66 00010000:00010000:1.0:1788835098.724126:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d227b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.724135:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d227b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.724174:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d227b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.724181:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d227b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.724188:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d227b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.724193:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60c00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835098.724197:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d227b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.724204:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d227b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.724212:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ecb00) 00010000:00010000:1.0:1788835098.724215:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788835098.724218:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d227b lrc: 2/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.724245:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d227b lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835098.724284:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+32:11295:x1875729242443648:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 28913us (29111us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835098.724292:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 104 00000100:00100000:0.0:1788835098.733438:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835098.733749:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242444288 00000100:00100000:2.0:1788835098.733758:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242444288 00000100:00100000:2.0:1788835098.733812:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:2.0:1788835098.733822:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+32:11295:x1875729242444288:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1788835098.734056:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+33:11295:x1875729242444288:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 234us (628us total) trans 4294967374 rc 0/0 00000100:00100000:2.0:1788835098.734081:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:3.0:1788835098.873420:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835098.875646:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242444544 00000100:00100000:2.0:1788835098.875663:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242444544 00000100:00100000:2.0:1788835098.875825:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 105 00000100:00100000:2.0:1788835098.875837:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd8543a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+33:11306:x1875729242444544:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:2.0:1788835098.875862:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835098.875884:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2282 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae05f6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.875961:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2289 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.875975:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2289 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.875987:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2289 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876002:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2290 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876022:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2290 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876029:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2290 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876384:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2297 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876395:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2297 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876421:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2297 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835098.876431:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x4:0x0]: returning size 8 00010000:00010000:2.0:1788835098.876675:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2289 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876683:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2289 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876690:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2289 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876696:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374da00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835098.876702:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2289 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876709:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2289 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876722:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:2.0:1788835098.876725:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835098.876730:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2289 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876736:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2289 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876750:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2290 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876755:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2290 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876771:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2290 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876776:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835098.876779:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2290 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876784:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2290 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876792:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afda01ec000) 00010000:00010000:2.0:1788835098.876794:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835098.876797:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2290 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876803:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2290 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876851:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2282 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05f6 expref: 36 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876865:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2297 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05f6 expref: 35 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.876872:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ecb00) 00010000:00010000:2.0:1788835098.876874:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788835098.876877:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374d000, rc 0) 00000100:00100000:2.0:1788835098.876958:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd8543a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+35:11306:x1875729242444544:12345-192.168.203.22@tcp:101:cat.0 Request processed in 1124us (3547us total) trans 4294967375 rc 0/0 00000100:00100000:2.0:1788835098.876974:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 105 00000100:00100000:0.0:1788835098.881905:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835098.882524:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242444800 00000100:00100000:2.0:1788835098.882537:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242444800 00000100:00100000:2.0:1788835098.882590:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:2.0:1788835098.882597:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+35:11306:x1875729242444800:12345-192.168.203.22@tcp:35:cat.0 00000100:00100000:2.0:1788835098.882852:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+36:11306:x1875729242444800:12345-192.168.203.22@tcp:35:cat.0 Request processed in 255us (959us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1788835098.882857:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:3.0:1788835098.912820:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835098.913359:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242445056 00000100:00100000:2.0:1788835098.913371:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242445056 00000100:00100000:2.0:1788835098.913477:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 106 00000100:00100000:2.0:1788835098.913488:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd85438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+36:11307:x1875729242445056:12345-192.168.203.22@tcp:36:rm.0 00010000:00010000:2.0:1788835098.913549:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:2.0:1788835098.913579:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2235 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x4:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05e1 expref: 36 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.913605:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2297 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05f6 expref: 35 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.913618:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d226d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05ef expref: 34 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.913631:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2227 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05da expref: 33 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.913641:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ecb00) 00010000:00010000:2.0:1788835098.913662:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788835098.913690:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d22a5 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.913704:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d22a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.913715:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d22a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.913731:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d22ac lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.913737:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d22ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.913744:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d22ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.913823:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d22b3 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.913831:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d22b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.913853:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d22b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788835098.914115:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:2.0:1788835098.914127:0:6487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 340955811038ns, next at 341955808453ns, rc = 0 00010000:00010000:2.0:1788835098.914183:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d22ba lrc: 3/0,1 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914202:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d22ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914210:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d22ba lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914217:0:6487:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d22ba lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914223:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d22ba lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914230:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d22ba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914254:0:6487:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788835098.914274:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d22b3 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914280:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d22b3 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914286:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d22b3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914292:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374da00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835098.914296:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d22b3 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914303:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d22b3 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914372:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ecb00) 00010000:00010000:2.0:1788835098.914374:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788835098.914379:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d22b3 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914384:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d22b3 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914400:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d22a5 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914406:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d22a5 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914411:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d22a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914416:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374ce00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835098.914419:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d22a5 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914425:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d22a5 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914432:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:2.0:1788835098.914435:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835098.914437:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d22a5 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914444:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d22a5 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788835098.914464:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008473c3b2 reply state 000000000eb1ca2f transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d22ac lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914474:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d22ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835098.914481:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afda01ec000) 00010000:00010000:2.0:1788835098.914483:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788835098.914485:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788835098.914556:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd85438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+34:11307:x1875729242445056:12345-192.168.203.22@tcp:36:rm.0 Request processed in 1068us (1744us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1788835098.914564:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 106 00010000:00010000:1.0:1788835098.914963:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788835098.914970:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d22ba lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.914978:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374c000 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:1.0:1788835098.914981:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d22ba lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.914987:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d22ba lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.914998:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ecb00) 00010000:00010000:1.0:1788835098.915000:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1788835098.915003:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d22ba lrc: 1/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.915008:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d22ba lrc: 0/0,0 mode: --/PW res: [0x200000402:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.915019:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835098.915021:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835098.915022:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835098.995578:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835098.995690:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242445312 00000100:00100000:1.0:1788835098.995700:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242445312 00000100:00100000:1.0:1788835098.995774:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 107 00000100:00100000:1.0:1788835098.995785:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+34:11313:x1875729242445312:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1788835098.995809:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835098.995829:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d22c1 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae05fd expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.995927:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d22c8 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.995942:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d22c8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.995956:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d22c8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.995966:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d22cf lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.995974:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d22cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.995981:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d22cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788835098.996345:0:6488:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x3:0x0], index 0: 0 00010000:00010000:1.0:1788835098.996477:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d22d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.996487:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d22d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.996495:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d22d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.996537:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d22c8 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.996544:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d22c8 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.996550:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d22c8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.996557:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835098.996561:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d22c8 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.996568:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d22c8 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.996579:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:1.0:1788835098.996582:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835098.996587:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d22c8 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.996593:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d22c8 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788835098.996604:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000038583aab reply state 00000000b86657fd transno 4294967378 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d22cf lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.996614:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d22cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.996620:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afda01ec000) 00010000:00010000:1.0:1788835098.996627:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788835098.996630:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1788835098.996657:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d22c1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05fd expref: 37 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.996669:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d22d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05fd expref: 36 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835098.996676:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afdba168e00) 00010000:00010000:1.0:1788835098.996678:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788835098.996680:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60800, rc 0) 00000100:00100000:1.0:1788835098.996743:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+37:11313:x1875729242445312:12345-192.168.203.22@tcp:101:bash.0 Request processed in 960us (1175us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1788835098.996751:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 107 00000100:00100000:0.0:1788835099.002933:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835099.003005:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242445440 00000100:00100000:1.0:1788835099.003014:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242445440 00000100:00100000:1.0:1788835099.003174:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:1.0:1788835099.003185:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+7:2385:x1875729242445440:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1788835099.003203:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835099.003222:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004c64307f/0xdf60171e5a5d22e4 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0604 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788835099.003248:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788835099.003267:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=341s v=(0 0) 00010000:00010000:1.0:1788835099.003272:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835099.003282:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004c64307f/0xdf60171e5a5d22e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0604 expref: 8 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835099.003617:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004c64307f/0xdf60171e5a5d22e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0604 expref: 8 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835099.003631:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61e00, rc 0) 00000100:00100000:1.0:1788835099.003691:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+8:2385:x1875729242445440:12345-192.168.203.22@tcp:101:bash.0 Request processed in 508us (767us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835099.003698:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00080000:0.0:1788835099.003855:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788835099.009676:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835099.009841:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242445568 00000100:00100000:2.0:1788835099.009852:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242445568 00000100:00100000:2.0:1788835099.009910:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:2.0:1788835099.009919:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd85438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+8:11313:x1875729242445568:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1788835099.009937:0:9814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835099.009956:0:9814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d22eb lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae060b expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.009987:0:9814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004c64307f/0xdf60171e5a5d22e4 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0604 expref: 9 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.009997:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835099.010001:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835099.010007:0:9814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d22eb lrc: 4/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae060b expref: 9 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.010082:0:9814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004c64307f/0xdf60171e5a5d22e4 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0604 expref: 9 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.010096:0:9814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004c64307f/0xdf60171e5a5d22e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0604 expref: 9 pid: 8402 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835099.010111:0:9814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd8662a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9814:1875729254054400:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788835099.010207:0:9814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc82689cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788835099.019488:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835099.019765:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242445696 00000100:00100000:0.0:1788835099.019775:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242445696 00010000:00010000:0.0:1788835099.019812:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004c64307f/0xdf60171e5a5d22e4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0604 expref: 10 pid: 8402 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835099.019853:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:0.0:1788835099.019863:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd85438e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+10:2385:x1875729242445696:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788835099.019878:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835099.019898:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004c64307f/0xdf60171e5a5d22e4 lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0604 expref: 10 pid: 8402 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.019912:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004c64307f/0xdf60171e5a5d22e4 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0604 expref: 10 pid: 8402 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.019938:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835099.019943:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835099.019951:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d22eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae060b expref: 10 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.019962:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d22eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae060b expref: 10 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.020026:0:6474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d22eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae060b expref: 10 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835099.020041:0:6474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd87f36300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6474:1875729254054528:192.168.203.22@tcp:105: 00000100:00100000:0.0:1788835099.020145:0:6474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b23c0 going to sleep for 11 seconds 00010000:00010000:2.0:1788835099.020850:0:9814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004c64307f/0xdf60171e5a5d22e4 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0604 expref: 10 pid: 8402 timeout: 441 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835099.020867:0:9814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd8662a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9814:1875729254054400:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788835099.020890:0:9814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d22eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae060b expref: 9 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.020903:0:9814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374ce00, rc 0) 00000100:00100000:2.0:1788835099.020950:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd85438380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+9:11313:x1875729242445568:12345-192.168.203.22@tcp:101:bash.0 Request processed in 11032us (11286us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835099.020958:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:0.0:1788835099.024586:0:6474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd87f36300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6474:1875729254054528:192.168.203.22@tcp:105: 00010000:00010000:0.0:1788835099.024612:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835099.024673:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd85438e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+8:2385:x1875729242445696:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 4811us (5195us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835099.024683:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:1.0:1788835099.058227:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835099.058372:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242445952 00000100:00100000:2.0:1788835099.058384:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242445952 00000100:00100000:2.0:1788835099.058445:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:2.0:1788835099.058456:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+37:11313:x1875729242445952:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:2.0:1788835099.058778:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+38:11313:x1875729242445952:12345-192.168.203.22@tcp:35:bash.0 Request processed in 323us (559us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1788835099.058785:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00080000:0.0:1788835099.058861:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1788835099.109998:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835099.232827:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835099.232877:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835099.233036:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242446208 00000100:00100000:2.0:1788835099.233045:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242446208 00000100:00100000:2.0:1788835099.233115:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:2.0:1788835099.233124:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+8:2387:x1875729242446208:12345-192.168.203.22@tcp:16:kworker.0 00000100:00100000:2.0:1788835099.233280:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+8:2387:x1875729242446208:12345-192.168.203.22@tcp:16:kworker.0 Request processed in 157us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835099.233288:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:3.0:1788835099.233632:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242446080 00000100:00100000:3.0:1788835099.233637:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242446080 00002000:00100000:3.0:1788835099.233665:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9afdbfacf800 x1875729242446080/t0(0) o4->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:20/0 lens 504/0 e 0 to 0 dl 1788835110 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788835099.233688:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afdbfacf800 with x1875729242446080 ext(0->8) 00002000:00010000:3.0:1788835099.233694:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9afdbfacf800 00000100:00100000:3.0:1788835099.233719:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:3.0:1788835099.233727:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b8987b33-76f7-43a0-9448-1013c4af787f+8:2387:x1875729242446080:12345-192.168.203.22@tcp:4:bash.0 00000100:00100000:3.0:1788835099.241503:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b8987b33-76f7-43a0-9448-1013c4af787f+10:2387:x1875729242446080:12345-192.168.203.22@tcp:4:bash.0 Request processed in 7766us (8614us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1788835099.241517:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00002000:00100000:3.0:1788835099.241531:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x3:0x0] (0->8) req@ffff9afdbfacf800 x1875729242446080/t4294967303(0) o4->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:20/0 lens 504/448 e 0 to 0 dl 1788835110 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788835099.241542:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afdbfacf800 with x1875729242446080 ext(0->8) 00002000:00010000:3.0:1788835099.241548:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff9afdbfacf800 00000001:00080000:0.0:1788835099.265616:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:0.0:1788835099.265641:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:1.0:1788835099.372567:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835099.372726:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242446336 00000100:00100000:2.0:1788835099.372735:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242446336 00000100:00100000:2.0:1788835099.372797:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 108 00000100:00100000:2.0:1788835099.372807:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbface680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+38:11329:x1875729242446336:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788835099.372831:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835099.372851:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d22f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0612 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.372917:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d22f9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.372931:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d22f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.372942:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d22f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835099.372985:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:2.0:1788835099.372998:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788835099.373031:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d22f9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.373056:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d22f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0612 expref: 40 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.373089:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d22f9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0612 expref: 39 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.373098:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:2.0:1788835099.373101:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788835099.373104:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374dc00, rc 0) 00000100:00100000:2.0:1788835099.373165:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbface680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+39:11329:x1875729242446336:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 360us (609us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835099.373172:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 108 00000100:00100000:1.0:1788835099.383795:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835099.383911:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242446592 00000100:00100000:2.0:1788835099.383920:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242446592 00000100:00100000:2.0:1788835099.383978:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 109 00000100:00100000:2.0:1788835099.383988:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+39:11329:x1875729242446592:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788835099.384008:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835099.384027:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2300 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0619 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.384148:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2307 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.384163:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2307 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.384193:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2307 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835099.384206:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788835099.384344:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2300 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0619 expref: 42 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.384363:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2307 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0619 expref: 41 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.384372:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afdba168e00) 00010000:00010000:2.0:1788835099.384375:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788835099.384379:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374d000, rc 0) 00000100:00100000:2.0:1788835099.384444:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+41:11329:x1875729242446592:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 457us (657us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1788835099.384451:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 109 00000100:00100000:0.0:1788835099.388814:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835099.388867:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835099.388980:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242446976 00000100:00100000:2.0:1788835099.388989:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242446976 00000100:00100000:3.0:1788835099.389110:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242446848 00000100:00100000:3.0:1788835099.389114:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242446848 00000100:00100000:3.0:1788835099.389157:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 110 00000100:00100000:3.0:1788835099.389168:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+42:11329:x1875729242446848:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788835099.389189:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835099.389208:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d2315 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0620 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.389339:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d231c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.389353:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d231c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.389385:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d231c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835099.389399:0:9806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788835099.389511:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d2315 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0620 expref: 45 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.389529:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d231c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0620 expref: 44 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.389537:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afdba168e00) 00010000:00010000:3.0:1788835099.389540:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1788835099.389543:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204b800, rc 0) 00000100:00100000:3.0:1788835099.389593:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+44:11329:x1875729242446848:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 428us (788us total) trans 4294967381 rc 0/0 00000100:00100000:3.0:1788835099.389600:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 110 00000100:00100000:2.0:1788835099.390618:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:2.0:1788835099.390632:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+43:2386:x1875729242446976:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835099.390645:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835099.390665:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2307 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0619 expref: 43 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.390679:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afdba168e00) 00010000:00010000:2.0:1788835099.390682:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835099.390730:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+42:2386:x1875729242446976:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 101us (1860us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835099.390737:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:0.0:1788835099.404185:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835099.404602:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242447104 00000100:00100000:2.0:1788835099.404612:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242447104 00000100:00100000:2.0:1788835099.404670:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:2.0:1788835099.404680:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+6:2386:x1875729242447104:12345-192.168.203.22@tcp:1:lfs.0 00010000:00010000:2.0:1788835099.404721:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009efac1d7/0xdf60171e5a5d232a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.404741:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d22eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae060b expref: 6 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.404749:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835099.404753:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788835099.404757:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009efac1d7/0xdf60171e5a5d232a lrc: 4/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.404792:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d22eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae060b expref: 6 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.404806:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d22eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae060b expref: 6 pid: 9814 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835099.404820:0:8405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd8662a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1875729254054656:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788835099.405196:0:8405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc82689180 going to sleep for 11 seconds 00000100:00100000:2.0:1788835099.410978:0:8405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd8662a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1875729254054656:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788835099.411039:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009efac1d7/0xdf60171e5a5d232a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835099.411850:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835099.412744:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242447232 00000100:00100000:2.0:1788835099.412754:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242447232 00010000:00010000:2.0:1788835099.412791:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d22eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae060b expref: 7 pid: 9814 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835099.412835:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:2.0:1788835099.412857:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaae68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+7:2385:x1875729242447232:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835099.412871:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1788835099.412896:0:7430:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1788835099.412899:0:7430:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb mtime from disk: 0 -> 1788835100 00002000:00010000:2.0:1788835099.412901:0:7430:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb ctime from disk: 0 -> 1788835100 00002000:00010000:2.0:1788835099.412903:0:7430:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x3:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:2.0:1788835099.412910:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d22eb lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae060b expref: 7 pid: 9814 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.412923:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d22eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae060b expref: 7 pid: 9814 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.412944:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d22eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae060b expref: 7 pid: 9814 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.412959:0:7430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788835099.412963:0:7430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788835099.412980:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009efac1d7/0xdf60171e5a5d232a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.412990:0:7430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009efac1d7/0xdf60171e5a5d232a lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.413027:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835099.413240:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaae68050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+6:2385:x1875729242447232:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 384us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835099.413247:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 68 00010000:00010000:0.0:1788835099.413799:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009efac1d7/0xdf60171e5a5d232a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.413811:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009efac1d7/0xdf60171e5a5d232a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.413832:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009efac1d7/0xdf60171e5a5d232a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.413859:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009efac1d7/0xdf60171e5a5d232a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.413867:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009efac1d7/0xdf60171e5a5d232a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.413875:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d000 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835099.413888:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009efac1d7/0xdf60171e5a5d232a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.413897:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009efac1d7/0xdf60171e5a5d232a lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.413911:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009efac1d7/0xdf60171e5a5d232a lrc: 2/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.413918:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009efac1d7/0xdf60171e5a5d232a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835099.413979:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f34380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242447104:12345-192.168.203.22@tcp:1:lfs.0 Request processed in 9301us (9802us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835099.413987:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:0.0:1788835099.417358:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835099.417630:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242447488 00000100:00100000:2.0:1788835099.417652:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242447488 00000100:00100000:2.0:1788835099.417707:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:2.0:1788835099.417717:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84e66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+42:11329:x1875729242447488:12345-192.168.203.22@tcp:35:lfs.0 00000004:00010000:2.0:1788835099.417779:0:6490:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d231c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0620 expref: 42 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788835099.419200:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:2.0:1788835099.419279:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:2.0:1788835099.421985:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00010000:00010000:2.0:1788835099.422607:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2331 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.422631:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d22d6 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05fd expref: 46 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.423180:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2331 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.423243:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d22d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05fd expref: 46 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.423261:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d22d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05fd expref: 46 pid: 6488 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835099.423277:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd8662a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6490:1875729254054784:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788835099.425613:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc826893c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788835099.435985:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835099.439207:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242447616 00000100:00100000:0.0:1788835099.439224:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242447616 00010000:00010000:0.0:1788835099.439292:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d22d6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05fd expref: 47 pid: 6488 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835099.439378:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:0.0:1788835099.439720:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+47:2385:x1875729242447616:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788835099.439743:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835099.439752:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d22d6 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05fd expref: 47 pid: 6488 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.439767:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d22d6 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05fd expref: 47 pid: 6488 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.439792:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afdba168e00) 00010000:00010000:0.0:1788835099.439798:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2331 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.439810:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2331 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.439819:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2331 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.439842:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835099.439916:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+47:2385:x1875729242447616:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 527us (3939us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835099.439925:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 69 00010000:00010000:2.0:1788835099.441380:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d22d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05fd expref: 46 pid: 6488 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835099.441415:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd8662a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6490:1875729254054784:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788835099.441440:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2331 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.441450:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2331 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.441456:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2331 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788835099.441707:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000001:00080000:2.0:1788835099.441937:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:2.0:1788835099.442240:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd8662a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6490:1875729254054912:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788835099.442301:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835099.442432:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc826896c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788835099.443764:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254054912 00000100:00100000:1.0:1788835099.443777:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254054912 00000100:00100000:1.0:1788835099.444005:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1788835099.444229:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6490:x1875729254054912:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788835099.444460:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86629f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6490:x1875729254054912:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 379us (2090us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835099.444469:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788835099.444629:0:6490:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967302 gen 2 00000004:00080000:2.0:1788835099.444652:0:6490:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967301 committed transno 4294967302 00000004:00080000:2.0:1788835099.444673:0:6490:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afc83741500, transno 4294967302 00000100:00100000:2.0:1788835099.444694:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd8662a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6490:1875729254054912:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788835099.444835:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00000100:00100000:2.0:1788835099.444996:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd8662a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6490:1875729254055040:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1788835099.445254:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835099.449124:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc82689840 going to sleep for 11 seconds 00000100:00080000:0.0:1788835099.449601:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788835099.451616:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254055040 00000100:00100000:3.0:1788835099.451631:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254055040 00000100:00100000:3.0:1788835099.451698:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1788835099.451709:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6490:x1875729254055040:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1788835099.452351:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6490:x1875729254055040:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 643us (7095us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1788835099.452360:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788835099.452653:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd8662a680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6490:1875729254055040:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788835099.452720:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:2.0:1788835099.452765:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2331 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.452777:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2331 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.452785:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2331 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.452793:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374ce00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835099.452798:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2331 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.452806:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2331 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.452822:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afdba168e00) 00010000:00010000:2.0:1788835099.452825:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788835099.452830:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2331 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.452942:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2331 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788835099.453056:0:6490:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788835099.453262:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:2.0:1788835099.453273:0:6490:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 341494957509ns, next at 342494955279ns, rc = 0 00000001:00080000:2.0:1788835099.453280:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967389 00010000:00010000:2.0:1788835099.453611:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afdba168e00) 00010000:00010000:2.0:1788835099.453615:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788835099.453623:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d231c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0620 expref: 50 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835099.453797:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84e66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+49:11329:x1875729242447488:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 36080us (36447us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1788835099.453807:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 26 00000020:00080000:2.0:1788835099.453812:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1788835099.462603:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835099.463259:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242447744 00000100:00100000:3.0:1788835099.463275:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242447744 00000100:00100000:3.0:1788835099.463412:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 111 00000100:00100000:3.0:1788835099.463422:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+49:11329:x1875729242447744:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788835099.463462:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835099.463496:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d2338 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0627 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.464536:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d2338 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0627 expref: 50 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.464563:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d2338 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0627 expref: 50 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.464594:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:3.0:1788835099.464597:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788835099.464601:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204ae00, rc 0) 00000100:00100000:3.0:1788835099.464691:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+50:11329:x1875729242447744:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1270us (2383us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835099.464699:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 111 00000100:00100000:1.0:1788835099.472273:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835099.472476:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242448000 00000100:00100000:3.0:1788835099.472485:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242448000 00000100:00100000:3.0:1788835099.472614:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:3.0:1788835099.472624:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+50:11329:x1875729242448000:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1788835099.473058:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+51:11329:x1875729242448000:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 433us (794us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1788835099.473078:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:1.0:1788835099.621891:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835099.622003:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242448128 00000100:00100000:2.0:1788835099.622021:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242448128 00000100:00100000:2.0:1788835099.622085:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 112 00000100:00100000:2.0:1788835099.622095:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+51:11339:x1875729242448128:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:2.0:1788835099.622190:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d233f lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622210:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d233f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622223:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d233f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622255:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2346 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622263:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2346 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622270:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2346 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622390:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d234d lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622400:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d234d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622408:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d234d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788835099.622456:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d234d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622468:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d233f lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622475:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d233f lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622482:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d233f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622504:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374ce00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835099.622509:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d233f lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622524:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d233f lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622537:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:2.0:1788835099.622540:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835099.622545:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d233f lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622552:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d233f lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622566:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2346 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622572:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2346 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622578:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2346 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622584:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374da00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835099.622587:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2346 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622593:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2346 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622601:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afda01ec000) 00010000:00010000:2.0:1788835099.622603:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835099.622606:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2346 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622622:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2346 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622633:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d234d lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622639:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d234d lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622645:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d234d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622650:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835099.622653:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d234d lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622660:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d234d lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622668:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:2.0:1788835099.622670:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835099.622673:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d234d lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.622679:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d234d lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835099.622753:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+51:11339:x1875729242448128:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 658us (871us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835099.622762:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 112 00000100:00100000:1.0:1788835099.679854:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835099.679960:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242448384 00000100:00100000:2.0:1788835099.679970:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242448384 00000100:00100000:2.0:1788835099.680038:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 113 00000100:00100000:2.0:1788835099.680048:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+51:11342:x1875729242448384:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788835099.680077:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835099.680100:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2354 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae062e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680182:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d235b lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680197:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d235b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680207:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d235b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680219:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2362 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680227:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2362 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680232:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2362 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680381:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2369 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680389:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2369 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680415:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2369 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835099.680426:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:2.0:1788835099.680501:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d235b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680509:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d235b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680516:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d235b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680522:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374da00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835099.680526:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d235b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680533:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d235b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680546:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:2.0:1788835099.680549:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835099.680552:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d235b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680557:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d235b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680569:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2362 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680575:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2362 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680590:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2362 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680595:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374ce00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835099.680597:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2362 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680604:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2362 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680612:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afda01ec000) 00010000:00010000:2.0:1788835099.680614:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835099.680617:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2362 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680622:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2362 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680660:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2354 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae062e expref: 54 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680674:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2369 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae062e expref: 53 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.680681:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:2.0:1788835099.680683:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788835099.680686:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374c000, rc 0) 00000100:00100000:2.0:1788835099.680744:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+53:11342:x1875729242448384:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 698us (900us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1788835099.680760:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 113 00000100:00100000:0.0:1788835099.683399:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835099.683494:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242448512 00000100:00100000:3.0:1788835099.683503:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242448512 00000100:00100000:3.0:1788835099.683557:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:3.0:1788835099.683568:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+53:11342:x1875729242448512:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:3.0:1788835099.683647:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2377 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.683663:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2377 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.683675:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2377 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.683711:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2377 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.683717:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2377 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.683723:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2377 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.683729:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204a600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835099.683733:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2377 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.683740:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2377 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.683752:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:3.0:1788835099.683755:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788835099.683760:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2377 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.683766:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d2377 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835099.683843:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+53:11342:x1875729242448512:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 277us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835099.683852:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:1.0:1788835099.686381:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835099.686505:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242448768 00000100:00100000:2.0:1788835099.686516:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242448768 00000100:00100000:2.0:1788835099.686564:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:2.0:1788835099.686573:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbface300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+53:11342:x1875729242448768:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1788835099.686793:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbface300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+54:11342:x1875729242448768:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 220us (421us total) trans 4294967393 rc 0/0 00000100:00100000:2.0:1788835099.686801:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:1.0:1788835099.745791:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835099.745844:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835099.745880:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835099.745970:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835099.746030:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242449152 00000100:00100000:2.0:1788835099.746039:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242449152 00000100:00100000:2.0:1788835099.746127:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 100 00000100:00100000:2.0:1788835099.746138:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+8:2385:x1875729242449152:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835099.746216:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+8:2385:x1875729242449152:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 80us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835099.746223:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 100 00000100:00080000:2.0:1788835099.746391:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788835099.749592:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242448896 00000100:00100000:3.0:1788835099.749609:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242448896 00000100:00100000:3.0:1788835099.749671:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 381 00000100:00100000:3.0:1788835099.749680:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:2385:x1875729242448896:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835099.749764:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fccc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:2385:x1875729242448896:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 84us (3984us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835099.749772:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 381 00000100:00100000:1.0:1788835099.751336:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835099.762643:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242449408 00000100:00100000:0.0:1788835099.762677:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242449408 00000100:00100000:0.0:1788835099.762814:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242449024 00000100:00100000:0.0:1788835099.762818:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242449024 00000100:00100000:0.0:1788835099.762854:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 279 00000100:00100000:0.0:1788835099.762866:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242449408:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835099.762957:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242449408:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 92us (17074us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835099.762965:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 279 00000100:00100000:0.0:1788835099.762984:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 280 00000100:00100000:0.0:1788835099.762991:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242449024:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835099.763032:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242449024:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 41us (17062us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835099.763038:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 280 00000100:00080000:3.0:1788835099.763263:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788835099.763443:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242449280 00000100:00100000:1.0:1788835099.763449:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242449280 00000100:00100000:1.0:1788835099.763498:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 281 00000100:00100000:1.0:1788835099.763507:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242449280:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835099.763547:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242449280:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 41us (12231us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835099.763553:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 281 00000100:00080000:3.0:1788835099.763652:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788835099.773020:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835099.773225:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242449664 00000100:00100000:0.0:1788835099.773237:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242449664 00000100:00100000:0.0:1788835099.773312:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 115 00000100:00100000:0.0:1788835099.773358:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd8543b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+54:11352:x1875729242449664:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1788835099.773383:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835099.773386:0:9806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788835099.773412:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d22f9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0612 expref: 54 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.773431:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:0.0:1788835099.773435:0:9806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788835099.773449:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d237e lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0635 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.773583:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2385 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.773597:0:9806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2369 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae062e expref: 54 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.773606:0:9806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2385 lrc: 4/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.773639:0:9806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2369 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae062e expref: 54 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.773653:0:9806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2369 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae062e expref: 54 pid: 6489 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835099.773667:0:9806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd87f37480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9806:1875729254055168:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788835099.773759:0:9806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788835099.777807:0:9806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd87f37480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9806:1875729254055168:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788835099.777843:0:9806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2385 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835099.779792:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835099.779986:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242449792 00000100:00100000:2.0:1788835099.779995:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242449792 00010000:00010000:2.0:1788835099.780051:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2369 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae062e expref: 55 pid: 6489 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835099.780104:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:2.0:1788835099.780114:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd85439c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+55:2386:x1875729242449792:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835099.780134:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835099.780141:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2369 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae062e expref: 55 pid: 6489 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.780168:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2369 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae062e expref: 55 pid: 6489 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.780192:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2369 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae062e expref: 55 pid: 6489 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.780206:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:2.0:1788835099.780211:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2385 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.780220:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2385 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.780227:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2385 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.780252:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835099.780351:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd85439c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+54:2386:x1875729242449792:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 237us (568us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835099.780358:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 70 00010000:00010000:3.0:1788835099.780872:0:9806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2385 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.780882:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2385 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835099.780901:0:9806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 9 00010000:00010000:3.0:1788835099.781031:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d237e lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0635 expref: 55 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.781050:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2385 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0635 expref: 54 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.781093:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:3.0:1788835099.781096:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788835099.781099:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f4600, rc 0) 00000100:00100000:3.0:1788835099.781154:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd8543b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+54:11352:x1875729242449664:12345-192.168.203.22@tcp:101:bash.0 Request processed in 7797us (8151us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1788835099.781161:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 115 00000100:00100000:3.0:1788835099.785400:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835099.785585:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242449920 00000100:00100000:1.0:1788835099.785596:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242449920 00000100:00100000:1.0:1788835099.785669:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 116 00000100:00100000:1.0:1788835099.785680:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd85438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+54:11352:x1875729242449920:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1788835099.785710:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835099.785735:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2393 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae063c expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835099.785770:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d239a lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835099.785784:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d239a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835099.785796:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d239a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835099.785931:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2393 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae063c expref: 56 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835099.785947:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d239a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae063c expref: 55 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835099.785955:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:1.0:1788835099.785957:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788835099.785961:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60c00, rc 0) 00000100:00100000:1.0:1788835099.786029:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd85438000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+55:11352:x1875729242449920:12345-192.168.203.22@tcp:101:bash.0 Request processed in 350us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835099.786037:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 116 00000100:00100000:1.0:1788835099.789993:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835099.790098:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242450176 00000100:00100000:2.0:1788835099.790107:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242450176 00000100:00100000:2.0:1788835099.790171:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:2.0:1788835099.790181:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+55:11352:x1875729242450176:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:2.0:1788835099.790446:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d23a1 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.790464:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d23a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.790493:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d23a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788835099.790542:0:6489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967395 00000004:00010000:2.0:1788835099.790566:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001bb9f8bb reply state 000000004647b4ee transno 4294967396 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d23a1 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.790580:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d23a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.790587:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:2.0:1788835099.790589:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788835099.790593:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788835099.790745:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83741500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+58:11352:x1875729242450176:12345-192.168.203.22@tcp:36:bash.0 Request processed in 564us (758us total) trans 4294967396 rc 0/0 00000100:00100000:2.0:1788835099.790753:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 117 00000020:00080000:2.0:1788835099.790758:0:6489:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788835099.793990:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835099.794244:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242450304 00000100:00100000:0.0:1788835099.794255:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242450304 00000100:00100000:0.0:1788835099.794387:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:0.0:1788835099.794398:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd85439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+58:11352:x1875729242450304:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1788835099.794420:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835099.794452:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d23a8 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0643 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.794537:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d23af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.794551:0:9806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2385 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0635 expref: 59 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.794560:0:9806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d23af lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.794595:0:9806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2385 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0635 expref: 59 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.794608:0:9806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2385 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0635 expref: 59 pid: 9806 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835099.794622:0:9806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd87f37480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9806:1875729254055296:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788835099.794707:0:9806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788835099.797490:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835099.797582:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242450432 00000100:00100000:2.0:1788835099.797591:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242450432 00010000:00010000:2.0:1788835099.797633:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2385 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0635 expref: 60 pid: 9806 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835099.797676:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:2.0:1788835099.797685:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+60:2385:x1875729242450432:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835099.797698:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835099.797704:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2385 lrc: 5/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0635 expref: 60 pid: 9806 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.797734:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2385 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0635 expref: 60 pid: 9806 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.797758:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:2.0:1788835099.797763:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d23af lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x8 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.797772:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d23af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.797779:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d23af lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.797797:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835099.797843:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+60:2385:x1875729242450432:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 159us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835099.797851:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 71 00010000:00010000:3.0:1788835099.798036:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2385 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0635 expref: 59 pid: 9806 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835099.798054:0:9806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd87f37480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9806:1875729254055296:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788835099.798212:0:9806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d23af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.798222:0:9806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d23af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.798228:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d23af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835099.798482:0:9806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788835099.798486:0:9806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788835099.798508:0:9806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d23af lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.798539:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d23a8 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0643 expref: 59 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.798565:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d23af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0643 expref: 58 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.798572:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:3.0:1788835099.798575:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788835099.798577:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5400, rc 0) 00000100:00100000:3.0:1788835099.798624:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd85439f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+58:11352:x1875729242450304:12345-192.168.203.22@tcp:101:bash.0 Request processed in 4228us (4643us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835099.798632:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:0.0:1788835099.804292:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835099.804575:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242450688 00000100:00100000:2.0:1788835099.804585:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242450688 00000100:00100000:2.0:1788835099.804645:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:2.0:1788835099.804656:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+58:11352:x1875729242450688:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:2.0:1788835099.804910:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+59:11352:x1875729242450688:12345-192.168.203.22@tcp:35:bash.0 Request processed in 255us (627us total) trans 4294967397 rc 0/0 00000100:00100000:2.0:1788835099.804918:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:0.0:1788835099.868004:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835099.868177:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242450816 00000100:00100000:1.0:1788835099.868191:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242450816 00000100:00100000:1.0:1788835099.868286:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 119 00000100:00100000:1.0:1788835099.868299:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+59:11358:x1875729242450816:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788835099.868361:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835099.868389:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d23b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae064a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835099.868472:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d23bd lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835099.868490:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d23bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835099.868527:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d23bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835099.868585:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x3:0x0]: returning size 4096 00000004:00200000:1.0:1788835099.868589:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835099.868609:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d23bd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835099.868635:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d23b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae064a expref: 61 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835099.868653:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d23bd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae064a expref: 60 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835099.868662:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:1.0:1788835099.868664:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788835099.868668:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60600, rc 0) 00000100:00100000:1.0:1788835099.868745:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+60:11358:x1875729242450816:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 448us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835099.868752:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 119 00000100:00100000:0.0:1788835099.872098:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835099.872653:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242450944 00000100:00100000:3.0:1788835099.872664:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242450944 00000100:00100000:3.0:1788835099.872769:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 120 00000100:00100000:3.0:1788835099.872782:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+60:11358:x1875729242450944:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788835099.872803:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835099.872825:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d23c4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0651 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.872888:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d23cb lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.872903:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d23cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.872916:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d23cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.872928:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d23d2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.872951:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d23d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.872958:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d23d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873215:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d23d9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873226:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d23d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873235:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d23d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835099.873381:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788835099.873386:0:9047:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788835099.873405:0:9047:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d23d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873418:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d23d9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873427:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d23cb lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873434:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d23cb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873441:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d23cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873459:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204b800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835099.873464:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d23cb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873472:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d23cb lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873485:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:3.0:1788835099.873488:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835099.873493:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d23cb lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873500:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d23cb lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873515:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d23d2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873521:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d23d2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873528:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d23d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873533:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204a200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835099.873536:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d23d2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873542:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d23d2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873560:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afda01ec000) 00010000:00010000:3.0:1788835099.873562:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835099.873565:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d23d2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873572:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d23d2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873599:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d23c4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0651 expref: 62 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873612:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d23d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0651 expref: 61 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.873620:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:3.0:1788835099.873623:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788835099.873625:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204b000, rc 0) 00000100:00100000:3.0:1788835099.873739:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+61:11358:x1875729242450944:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 959us (1650us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835099.873746:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 120 00000100:00100000:0.0:1788835099.878508:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835099.878554:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835099.878612:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242451200 00000100:00100000:3.0:1788835099.878621:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242451200 00000100:00100000:3.0:1788835099.878671:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:3.0:1788835099.878680:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+61:11358:x1875729242451200:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788835099.878699:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835099.878717:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d23e0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0658 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.878878:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d23e7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.878898:0:9806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d23af lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0643 expref: 62 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.878907:0:9806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d23d9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0651 expref: 62 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.878915:0:9806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d23e7 lrc: 5/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.878951:0:9806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d23d9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0651 expref: 62 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.878964:0:9806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d23d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0651 expref: 62 pid: 9047 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835099.878977:0:9806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd8543aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9806:1875729254055424:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788835099.879214:0:9806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d23af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0643 expref: 62 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.879223:0:9806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d23af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0643 expref: 62 pid: 9806 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835099.879232:0:9806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd85439180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9806:1875729254055552:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788835099.879479:0:9806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd83e4e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788835099.879589:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242451328 00000100:00100000:2.0:1788835099.879595:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242451328 00010000:00010000:2.0:1788835099.879623:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d23d9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0651 expref: 63 pid: 9047 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835099.879670:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:2.0:1788835099.879679:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+63:2386:x1875729242451328:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835099.879691:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835099.879697:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d23d9 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0651 expref: 63 pid: 9047 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.879710:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d23d9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0651 expref: 63 pid: 9047 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.879731:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:2.0:1788835099.879736:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d23e7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.879744:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d23e7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.879750:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835099.879777:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f35180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+63:2386:x1875729242451328:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 100us (1284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835099.879784:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 72 00010000:00010000:3.0:1788835099.883747:0:9806:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.22@tcp) returned -22 from blocking AST (req@00000000c27b7c2f x1875729254055424) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d23d9 lrc: 1/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0651 expref: 62 pid: 9047 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.883772:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d23d9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0651 expref: 62 pid: 9047 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835099.883790:0:9806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd8543aa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9806:1875729254055424:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788835099.893514:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835099.893628:0:9806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd85439180 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9806:1875729254055552:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788835099.893657:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:3.0:1788835099.893664:0:9806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d23e7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.893675:0:9806:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d23e7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.893684:0:9806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d23e7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835099.893988:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242451456 00000100:00100000:2.0:1788835099.893995:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242451456 00010000:00010000:2.0:1788835099.894038:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d23af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0643 expref: 62 pid: 9806 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835099.894081:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:2.0:1788835099.894090:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+62:2387:x1875729242451456:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835099.894117:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835099.894134:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d23af lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0643 expref: 62 pid: 9806 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.894147:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d23af lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0643 expref: 62 pid: 9806 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.894167:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d23af lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0643 expref: 62 pid: 9806 timeout: 441 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.894182:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:2.0:1788835099.894185:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d23e7 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.894192:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d23e7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.894199:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d23e7 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.894226:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835099.894284:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f36680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+61:2387:x1875729242451456:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 193us (778us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835099.894291:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 73 00010000:00010000:0.0:1788835099.894451:0:9806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d23e7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.894469:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d23e7 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788835099.894488:0:9806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:0.0:1788835099.894618:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d23e0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0658 expref: 62 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.894634:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d23e7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0658 expref: 61 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835099.894641:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:0.0:1788835099.894644:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788835099.894647:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884aa200, rc 0) 00000100:00100000:0.0:1788835099.894675:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+61:11358:x1875729242451200:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 15995us (16120us total) trans 4294967398 rc 0/0 00000100:00100000:0.0:1788835099.894682:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:0.0:1788835099.899575:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835099.899673:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242451712 00000100:00100000:1.0:1788835099.899685:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242451712 00000100:00100000:1.0:1788835099.899751:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:1.0:1788835099.899763:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+61:11358:x1875729242451712:12345-192.168.203.22@tcp:103:lfs.0 00010000:00010000:1.0:1788835099.899781:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835099.899808:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204ae00/0xdf60171e5a5d2338 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0627 expref: 61 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835099.899846:0:9491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:1.0:1788835099.899851:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788835099.899916:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f37480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+60:11358:x1875729242451712:12345-192.168.203.22@tcp:103:lfs.0 Request processed in 155us (350us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835099.899925:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:1.0:1788835099.903750:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835099.903836:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242451840 00000100:00100000:2.0:1788835099.903847:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242451840 00000100:00100000:2.0:1788835099.903908:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:2.0:1788835099.903918:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+60:11358:x1875729242451840:12345-192.168.203.22@tcp:58:lfs.0 00010000:00010000:2.0:1788835099.904050:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d23f5 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.904080:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d23f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835099.904092:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d23f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788835099.904207:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:2.0:1788835099.904304:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+60:11358:x1875729242451840:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 387us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835099.904346:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:0.0:1788835099.907717:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835099.907799:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242451968 00000100:00100000:3.0:1788835099.907811:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242451968 00000100:00100000:3.0:1788835099.907877:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00100000:3.0:1788835099.907887:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+60:11358:x1875729242451968:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788835099.907907:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835099.907927:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab800/0xdf60171e5a5d23fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae065f expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.908006:0:9047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d23f5 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.908024:0:9047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab800/0xdf60171e5a5d23fc lrc: 4/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae065f expref: 61 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.908044:0:9047:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d23f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.908076:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab800/0xdf60171e5a5d23fc lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae065f expref: 61 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.908090:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:3.0:1788835099.908093:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788835099.908098:0:9047:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab800/0xdf60171e5a5d23fc lrc: 3/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae065f expref: 61 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835099.908106:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884ab800, rc 0) 00000100:00100000:3.0:1788835099.908426:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+61:11358:x1875729242451968:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 537us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835099.908434:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 123 00010000:00010000:3.0:1788835100.133804:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788835100.645528:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788835100.645539:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788835100.645584:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1788835100.645601:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788835100.645761:0:13768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd87f36d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875729254055680:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788835100.646509:0:13768:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788835100.652688:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835100.652848:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242452096 00000100:00100000:3.0:1788835100.652857:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242452096 00000100:00100000:3.0:1788835100.652921:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 124 00000100:00100000:3.0:1788835100.652931:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+62:11359:x1875729242452096:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788835100.652960:0:9806:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788835100.653122:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+62:11359:x1875729242452096:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 192us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835100.653130:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 124 00000100:00100000:2.0:1788835100.653622:0:13768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd87f36d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875729254055680:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788835100.669539:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835100.669664:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242452224 00000100:00100000:1.0:1788835100.669674:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242452224 00000100:00100000:1.0:1788835100.669733:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 125 00000100:00100000:1.0:1788835100.669744:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd85439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+61:11359:x1875729242452224:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788835100.669813:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2403 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.669831:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2403 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.669844:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2403 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.669860:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d240a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.669867:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d240a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.669873:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d240a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.669894:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2411 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.669911:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.669918:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835100.669962:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:1.0:1788835100.669966:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835100.669979:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.669989:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2403 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.669995:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2403 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.670008:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2403 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.670014:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835100.670018:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2403 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.670026:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2403 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.670038:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afc835ccc00) 00010000:00010000:1.0:1788835100.670041:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835100.670045:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2403 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.670080:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2403 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.670094:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d240a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.670100:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d240a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.670106:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d240a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.670111:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835100.670114:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d240a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.670119:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d240a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.670127:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x444bc3cd (ffff9afdba168900) 00010000:00010000:1.0:1788835100.670130:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835100.670132:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d240a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.670138:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d240a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x444bc3cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.670152:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2411 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.670157:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2411 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.670168:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2411 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.670174:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835100.670177:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2411 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.670182:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2411 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.670190:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:1.0:1788835100.670193:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835100.670196:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2411 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.670201:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2411 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835100.670279:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd85439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+61:11359:x1875729242452224:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 Request processed in 537us (748us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835100.670287:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 125 00000100:00100000:0.0:1788835100.688433:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835100.688539:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242452480 00000100:00100000:1.0:1788835100.688549:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242452480 00000100:00100000:1.0:1788835100.688624:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 126 00000100:00100000:1.0:1788835100.688635:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+61:11359:x1875729242452480:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788835100.688657:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835100.688680:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2418 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0666 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.688806:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d241f lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.688821:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d241f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.688833:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d241f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835100.688845:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788835100.688922:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d241f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.688930:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d241f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.688936:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d241f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.688942:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835100.688946:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d241f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.688954:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d241f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.688966:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:1.0:1788835100.688969:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788835100.688974:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d241f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.688991:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d241f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.689035:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2418 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0666 expref: 63 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.689066:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afc835ccc00) 00010000:00010000:1.0:1788835100.689069:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788835100.689073:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2418 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0666 expref: 63 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.689082:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61000, rc 0) 00000100:00100000:1.0:1788835100.689162:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+62:11359:x1875729242452480:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 529us (739us total) trans 4294967399 rc 301/301 00000100:00100000:1.0:1788835100.689170:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 126 00000100:00100000:3.0:1788835100.694641:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835100.694760:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242452608 00000100:00100000:1.0:1788835100.694769:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242452608 00000100:00100000:1.0:1788835100.694820:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 127 00000100:00100000:1.0:1788835100.694829:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd8543aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+62:11359:x1875729242452608:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788835100.694878:0:6489:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788835100.694985:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd8543aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+62:11359:x1875729242452608:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 156us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835100.694993:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 127 00000100:00100000:2.0:1788835100.710720:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835100.711537:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242452864 00000100:00100000:0.0:1788835100.711561:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242452864 00000100:00100000:0.0:1788835100.711635:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 128 00000100:00100000:0.0:1788835100.711647:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+62:11359:x1875729242452864:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788835100.711666:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835100.711669:0:6487:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788835100.711695:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d23bd lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae064a expref: 62 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.711718:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:0.0:1788835100.711722:0:6487:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788835100.711737:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d242d lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae066d expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788835100.713518:0:6487:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x4:0x0], index 1: 0 00010000:00010000:0.0:1788835100.713860:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2434 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.713877:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.713890:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2434 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.713955:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d242d lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae066d expref: 64 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.713977:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2434 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae066d expref: 63 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.715532:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9afc835cce00) 00010000:00010000:0.0:1788835100.715536:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788835100.715540:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5000, rc 0) 00000100:00100000:0.0:1788835100.715807:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ef100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+63:11359:x1875729242452864:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 4157us (5091us total) trans 4294967400 rc 0/0 00000100:00100000:0.0:1788835100.715817:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 128 00000100:00100000:0.0:1788835100.731532:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835100.731800:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242453120 00000100:00100000:3.0:1788835100.731810:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242453120 00000100:00100000:3.0:1788835100.731870:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 129 00000100:00100000:3.0:1788835100.731879:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+63:11359:x1875729242453120:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788835100.731934:0:9806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835100.731961:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2434 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae066d expref: 63 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.731979:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9afc835cce00) 00010000:00010000:3.0:1788835100.731989:0:9806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788835100.732021:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d2442 lrc: 3/0,1 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.732035:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d2442 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.732046:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d2442 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.732074:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2449 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x3:0x0].0xb55482b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.732082:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2449 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb55482b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.732107:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2449 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb55482b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.732419:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d2442 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.732427:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d2442 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.732434:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d2442 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.732440:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aaa00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835100.732444:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d2442 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.732451:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d2442 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.732460:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:3.0:1788835100.732462:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835100.732466:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d2442 lrc: 2/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.732472:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d2442 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.732481:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2449 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x3:0x0].0xb55482b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.732486:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2449 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb55482b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.732498:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2449 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb55482b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.732502:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aa400 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835100.732505:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2449 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb55482b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.732511:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2449 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x3:0x0].0xb55482b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.732518:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0xb55482b (ffff9afc810b8200) 00010000:00010000:3.0:1788835100.732520:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835100.732522:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2449 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb55482b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.732528:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2449 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x3:0x0].0xb55482b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835100.732796:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+62:11359:x1875729242453120:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 732us (1089us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788835100.732804:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 129 00000100:00100000:2.0:1788835100.745393:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835100.745493:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242453248 00000100:00100000:3.0:1788835100.745503:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242453248 00000100:00100000:3.0:1788835100.745554:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 130 00000100:00100000:3.0:1788835100.745563:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+62:11359:x1875729242453248:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788835100.745584:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835100.745606:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2450 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0674 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.745675:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2457 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.745689:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2457 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.745699:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2457 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.745803:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2450 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0674 expref: 64 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.745822:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2457 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0674 expref: 63 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.745830:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9afc810b8500) 00010000:00010000:3.0:1788835100.745833:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788835100.745836:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884ab000, rc 0) 00000100:00100000:3.0:1788835100.745899:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ef800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+63:11359:x1875729242453248:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 336us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835100.745906:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 130 00000100:00100000:2.0:1788835100.753107:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835100.753643:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242453504 00000100:00100000:0.0:1788835100.753653:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242453504 00000100:00100000:0.0:1788835100.753716:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 131 00000100:00100000:0.0:1788835100.753726:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+63:11359:x1875729242453504:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788835100.753797:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d245e lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.753813:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d245e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.753825:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d245e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788835100.753954:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00080000:0.0:1788835100.753962:0:6487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 342795646791ns, next at 343795644996ns, rc = 0 00000004:00010000:0.0:1788835100.754009:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ff832175 reply state 0000000005ec33d3 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d245e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.754021:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d245e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.754065:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9afc810b8500) 00010000:00010000:0.0:1788835100.754069:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:0.0:1788835100.754072:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788835100.756360:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+65:11359:x1875729242453504:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 2626us (3252us total) trans 4294967401 rc 0/0 00000100:00100000:1.0:1788835100.756372:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 131 00000100:00100000:2.0:1788835100.764567:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835100.764640:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242453632 00000100:00100000:3.0:1788835100.764649:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242453632 00000100:00100000:3.0:1788835100.764708:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 132 00000100:00100000:3.0:1788835100.764718:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+65:11359:x1875729242453632:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788835100.764741:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835100.764760:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2465 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae067b expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.764829:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2465 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae067b expref: 66 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.764844:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2465 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae067b expref: 66 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.764861:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9afc810b8500) 00010000:00010000:3.0:1788835100.764864:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788835100.764868:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884abc00, rc 0) 00000100:00100000:3.0:1788835100.764931:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+66:11359:x1875729242453632:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 214us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835100.764937:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 132 00000100:00100000:2.0:1788835100.774818:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835100.775000:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242453760 00000100:00100000:0.0:1788835100.775018:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242453760 00000100:00100000:0.0:1788835100.775103:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:0.0:1788835100.775115:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+8:2386:x1875729242453760:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1788835100.775383:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba368a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+9:2386:x1875729242453760:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 268us (572us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1788835100.775392:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:0.0:1788835100.782803:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835100.782914:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242454016 00000100:00100000:2.0:1788835100.782924:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242454016 00000100:00100000:2.0:1788835100.782982:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:2.0:1788835100.782992:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+66:11359:x1875729242454016:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788835100.783261:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+67:11359:x1875729242454016:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 268us (466us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1788835100.783269:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:1.0:1788835100.788106:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835100.788372:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242454272 00000100:00100000:0.0:1788835100.788384:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242454272 00000100:00100000:0.0:1788835100.788439:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 133 00000100:00100000:0.0:1788835100.788450:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+67:11359:x1875729242454272:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1788835100.788561:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+67:11359:x1875729242454272:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 112us (464us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835100.788569:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 133 00000100:00100000:0.0:1788835100.793133:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835100.793231:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242454400 00000100:00100000:1.0:1788835100.793240:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242454400 00000100:00100000:1.0:1788835100.793301:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 134 00000100:00100000:1.0:1788835100.793310:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+67:11359:x1875729242454400:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788835100.793367:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835100.793388:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d246c lrc: 2/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0682 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.793455:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2473 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.793470:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2473 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.793482:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2473 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835100.793528:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835100.793547:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2473 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.793574:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d246c lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0682 expref: 69 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.793591:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2473 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0682 expref: 68 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.793600:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9afc810b8500) 00010000:00010000:1.0:1788835100.793603:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788835100.793627:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61e00, rc 0) 00000100:00100000:1.0:1788835100.793698:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+68:11359:x1875729242454400:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 388us (581us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835100.793706:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 134 00000100:00100000:2.0:1788835100.804113:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835100.806725:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242454528 00000100:00100000:1.0:1788835100.806739:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242454528 00000100:00100000:1.0:1788835100.806814:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:1.0:1788835100.806824:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+9:2385:x1875729242454528:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788835100.806841:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835100.806862:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000069d28be/0xdf60171e5a5d247a lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0689 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788835100.806887:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f751d, blocks: 0x0 00010000:00010000:1.0:1788835100.806907:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=342s v=(0 0) 00010000:00010000:1.0:1788835100.806912:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835100.806921:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000069d28be/0xdf60171e5a5d247a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0689 expref: 10 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.806939:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000069d28be/0xdf60171e5a5d247a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0689 expref: 10 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.806953:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61000, rc 0) 00000100:00100000:1.0:1788835100.807028:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+10:2385:x1875729242454528:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 206us (2927us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835100.807035:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:2.0:1788835100.811384:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835100.811475:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242454784 00000100:00100000:3.0:1788835100.811485:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242454784 00000100:00100000:3.0:1788835100.811537:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 135 00000100:00100000:3.0:1788835100.811547:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+68:11359:x1875729242454784:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788835100.811694:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+68:11359:x1875729242454784:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 148us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835100.811704:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 135 00000100:00100000:0.0:1788835100.819222:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835100.820185:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242454912 00000100:00100000:2.0:1788835100.820200:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242454912 00000100:00100000:2.0:1788835100.820278:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:2.0:1788835100.820287:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+10:11359:x1875729242454912:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788835100.820359:0:9814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835100.820377:0:9814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d5f52162/0xdf60171e5a5d2481 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0690 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.820410:0:9814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000069d28be/0xdf60171e5a5d247a lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0689 expref: 11 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.820419:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835100.820423:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835100.820647:0:9814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5f52162/0xdf60171e5a5d2481 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0690 expref: 11 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.820690:0:9814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000069d28be/0xdf60171e5a5d247a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0689 expref: 11 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.820705:0:9814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000069d28be/0xdf60171e5a5d247a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0689 expref: 11 pid: 8403 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835100.820720:0:9814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9814:1875729254055808:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788835100.820825:0:9814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc82689600 going to sleep for 11 seconds 00000100:00100000:0.0:1788835100.826911:0:9814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed0000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9814:1875729254055808:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788835100.826952:0:9814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d5f52162/0xdf60171e5a5d2481 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0690 expref: 11 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.826974:0:9814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374da00, rc 0) 00000100:00100000:0.0:1788835100.827077:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+11:11359:x1875729242454912:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 6790us (7865us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835100.827085:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:1.0:1788835100.829769:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835100.829910:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242455040 00000100:00100000:3.0:1788835100.829919:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242455040 00010000:00010000:3.0:1788835100.829956:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000069d28be/0xdf60171e5a5d247a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0689 expref: 11 pid: 8403 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835100.830010:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 74 00000100:00100000:3.0:1788835100.830027:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaae69850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+11:2386:x1875729242455040:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788835100.830063:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835100.830086:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000069d28be/0xdf60171e5a5d247a lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0689 expref: 11 pid: 8403 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.830100:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000069d28be/0xdf60171e5a5d247a lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0689 expref: 11 pid: 8403 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.830122:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000069d28be/0xdf60171e5a5d247a lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0689 expref: 11 pid: 8403 timeout: 442 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.830139:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835100.830143:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835100.830151:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5f52162/0xdf60171e5a5d2481 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0690 expref: 10 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.830160:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d5f52162/0xdf60171e5a5d2481 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0690 expref: 10 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.830196:0:6475:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000d5f52162/0xdf60171e5a5d2481 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0690 expref: 10 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835100.830210:0:6475:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd8543b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6475:1875729254055936:192.168.203.22@tcp:105: 00000100:00100000:3.0:1788835100.830299:0:6475:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd83e4e840 going to sleep for 11 seconds 00000100:00100000:3.0:1788835100.848138:0:6475:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd8543b800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:6475:1875729254055936:192.168.203.22@tcp:105: 00010000:00010000:3.0:1788835100.848184:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835100.848251:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaae69850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+10:2386:x1875729242455040:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 18224us (18489us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835100.848264:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 74 00000100:00100000:0.0:1788835100.850210:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835100.850466:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242455168 00000100:00100000:1.0:1788835100.850475:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242455168 00002000:00100000:1.0:1788835100.850519:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9afc83efd880 x1875729242455168/t0(0) o4->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:21/0 lens 504/0 e 0 to 0 dl 1788835111 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788835100.850531:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afc83efd880 with x1875729242455168 ext(0->12) 00002000:00010000:1.0:1788835100.850537:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afc83efd880 00000100:00100000:1.0:1788835100.850569:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:1.0:1788835100.850579:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b8987b33-76f7-43a0-9448-1013c4af787f+10:2386:x1875729242455168:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1788835100.856478:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b8987b33-76f7-43a0-9448-1013c4af787f+12:2386:x1875729242455168:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 Request processed in 5888us (6265us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1788835100.856492:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00002000:00100000:1.0:1788835100.856505:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x4:0x0] (0->12) req@ffff9afc83efd880 x1875729242455168/t4294967309(0) o4->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:21/0 lens 504/448 e 0 to 0 dl 1788835111 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1788835100.856516:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afc83efd880 with x1875729242455168 ext(0->12) 00002000:00010000:1.0:1788835100.856522:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afc83efd880 00000100:00100000:1.0:1788835100.865092:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835100.865209:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242455296 00000100:00100000:2.0:1788835100.865233:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242455296 00000100:00100000:2.0:1788835100.865298:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 136 00000100:00100000:2.0:1788835100.865307:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+68:11359:x1875729242455296:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1788835100.869024:0:6467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967402 is committed 00000004:00080000:3.0:1788835100.869049:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:3.0:1788835100.869101:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788835100.869132:0:6467:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9afc826896c0 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1788835100.869137:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afdaf500900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9afc82689f00 00000020:00080000:3.0:1788835100.869140:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afdaf500c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9afc83363600 00000004:00080000:3.0:1788835100.869172:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:3.0:1788835100.869200:0:6467:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9afc836eb480 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1788835100.869204:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afc83d85300 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9afc836ebf00 00000020:00080000:3.0:1788835100.869207:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afc83d85000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9afc83381c00 00000020:00080000:3.0:1788835100.869229:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1788835100.869289:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1788835100.869718:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788835100.869738:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254056064:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788835100.869800:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835100.869854:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254056064 00000100:00100000:1.0:1788835100.869861:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254056064 00000100:00100000:1.0:1788835100.869905:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788835100.869914:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729254056064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1788835100.869939:0:8403:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:3 count 1 00002000:00010000:1.0:1788835100.869970:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x3:0x0] initial LVB size: 9, mtime: 0x6a9f751c, atime: 0x0, ctime: 0x6a9f751c, blocks: 0x8 00010000:00010000:1.0:1788835100.869985:0:8403:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b22a4928/0xdf60171e5a5d2488 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.870018:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=342s v=(0 0) 00010000:00010000:1.0:1788835100.870023:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835100.870029:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b22a4928/0xdf60171e5a5d2488 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.870047:0:8403:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b22a4928/0xdf60171e5a5d2488 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.870065:0:8403:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b22a4928/0xdf60171e5a5d2488 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.870073:0:8403:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b22a4928/0xdf60171e5a5d2488 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.870090:0:8403:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1788835100.870229:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3614:x1875729254056064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 315us (428us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1788835100.870236:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00010000:1.0:1788835100.870262:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788835100.870268:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b22a4928/0xdf60171e5a5d2488 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.870276:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60600 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:1.0:1788835100.870280:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b22a4928/0xdf60171e5a5d2488 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.870296:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b22a4928/0xdf60171e5a5d2488 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.870312:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b22a4928/0xdf60171e5a5d2488 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.870350:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b22a4928/0xdf60171e5a5d2488 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.870370:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835100.870372:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835100.870373:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1788835100.870402:0:3614:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afdbfaa1880/2, rc 0, transno 4294967305 00000100:00100000:1.0:1788835100.870409:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254056064:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1788835100.870828:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254056320:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1788835100.870863:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835100.870887:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788835100.870893:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254056192:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1788835100.870914:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835100.870941:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254056320 00000100:00100000:2.0:1788835100.870945:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254056320 00000100:00100000:2.0:1788835100.870980:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254056192 00000100:00100000:2.0:1788835100.870984:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254056192 00000100:00100000:2.0:1788835100.871012:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788835100.871020:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3617:x1875729254056320:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1788835100.871126:0:9814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1788835100.871129:0:9814:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788835101 00002000:00010000:2.0:1788835100.871132:0:9814:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1788835100.871134:0:9814:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788835101 -> 1788835101 00002000:00010000:2.0:1788835100.871136:0:9814:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:2.0:1788835100.871169:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3617:x1875729254056320:12345-0@lo:2:osp-syn-1-0.0 Request processed in 151us (305us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788835100.871176:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788835100.871192:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1788835100.871198:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3617:x1875729254056192:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1788835100.871226:0:9814:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:3 count 1 00010000:00010000:2.0:1788835100.871241:0:9814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074acff48/0xdf60171e5a5d248f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.871268:0:9814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000aa97d7b3/0xdf60171e5a5d223c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05e8 expref: 11 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.871275:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1788835100.871279:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788835100.871283:0:9814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074acff48/0xdf60171e5a5d248f lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.871308:0:9814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000aa97d7b3/0xdf60171e5a5d223c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05e8 expref: 11 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.871349:0:9814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000aa97d7b3/0xdf60171e5a5d223c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05e8 expref: 11 pid: 9814 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835100.871362:0:9814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9814:1875729254056448:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788835100.871421:0:9814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc82689600 going to sleep for 11 seconds 00000100:00080000:2.0:1788835100.871971:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788835100.873389:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+22:11359:x1875729242455296:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 Request processed in 8073us (8296us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835100.873401:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 136 00000004:00080000:2.0:1788835100.873762:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afc83ed2a00/2, rc 0, transno 4294967310 00000100:00100000:2.0:1788835100.873770:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254056320:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1788835100.885703:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2186 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885726:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2186 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885735:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2186 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885742:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835100.885747:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2186 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885756:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2186 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885780:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x6:0x0].0x0 (ffff9afdb2e6e900) 00010000:00010000:0.0:1788835100.885783:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835100.885789:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2186 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885795:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d2186 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x6:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885834:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d222e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885841:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d222e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885869:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d222e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885874:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835100.885878:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d222e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885884:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d222e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885894:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x4:0x0].0x0 (ffff9afda01ecb00) 00010000:00010000:0.0:1788835100.885897:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835100.885900:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d222e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885906:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d222e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885925:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d22ac lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885931:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d22ac lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885937:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d22ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885942:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835100.885945:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d22ac lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885962:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d22ac lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885972:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afda01ec000) 00010000:00010000:0.0:1788835100.885974:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835100.885977:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d22ac lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885983:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d22ac lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.885995:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d22cf lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.886010:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d22cf lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.886016:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d22cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.886021:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835100.886024:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d22cf lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.886030:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d22cf lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.886038:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afda01ec000) 00010000:00010000:0.0:1788835100.886041:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835100.886044:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d22cf lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.886066:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d22cf lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.886085:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d23a1 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.886091:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d23a1 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.886096:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d23a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.886100:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374c000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835100.886103:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d23a1 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.886108:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d23a1 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.886126:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:0.0:1788835100.886129:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835100.886132:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d23a1 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.886137:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d23a1 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.886148:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d245e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.886153:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d245e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.886164:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d245e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.886169:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835100.886171:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d245e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.886177:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d245e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.886186:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9afc810b8500) 00010000:00010000:0.0:1788835100.886188:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1788835100.886191:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d245e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.886196:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d245e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835100.888293:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835100.888397:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835100.888539:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242455552 00000100:00100000:1.0:1788835100.888548:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242455552 00000100:00100000:1.0:1788835100.888602:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:1.0:1788835100.888624:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+12:2385:x1875729242455552:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1788835100.888778:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242455424 00000100:00100000:3.0:1788835100.888783:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242455424 00010000:00010000:3.0:1788835100.888804:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000aa97d7b3/0xdf60171e5a5d223c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05e8 expref: 13 pid: 9814 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835100.888836:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 75 00000100:00100000:3.0:1788835100.888843:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+13:2385:x1875729242455424:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788835100.888853:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835100.888858:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000aa97d7b3/0xdf60171e5a5d223c lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05e8 expref: 13 pid: 9814 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.888883:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000aa97d7b3/0xdf60171e5a5d223c lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05e8 expref: 13 pid: 9814 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.888907:0:6473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788835100.888911:0:6473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788835100.888917:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000074acff48/0xdf60171e5a5d248f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.888926:0:6473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074acff48/0xdf60171e5a5d248f lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.888945:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835100.888986:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+13:2385:x1875729242455424:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 143us (701us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835100.888994:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 75 00010000:00010000:0.0:1788835100.889526:0:9814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa97d7b3/0xdf60171e5a5d223c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05e8 expref: 12 pid: 9814 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835100.889541:0:9814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9814:1875729254056448:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788835100.889560:0:9814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000074acff48/0xdf60171e5a5d248f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.889569:0:9814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000074acff48/0xdf60171e5a5d248f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.889586:0:9814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074acff48/0xdf60171e5a5d248f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.889595:0:9814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074acff48/0xdf60171e5a5d248f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.889602:0:9814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074acff48/0xdf60171e5a5d248f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.889634:0:9814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788835100.889836:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788835100.889843:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074acff48/0xdf60171e5a5d248f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.889851:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374dc00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:3.0:1788835100.889855:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074acff48/0xdf60171e5a5d248f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.889865:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074acff48/0xdf60171e5a5d248f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.889892:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074acff48/0xdf60171e5a5d248f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.889899:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074acff48/0xdf60171e5a5d248f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.889919:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835100.889921:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835100.889923:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835100.892127:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3617:x1875729254056192:12345-0@lo:6:osp-syn-1-0.0 Request processed in 20912us (21195us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1788835100.892140:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:1.0:1788835100.892240:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afc83ed1f80/2, rc 0, transno 4294967311 00000100:00100000:1.0:1788835100.892248:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254056192:0@lo:6:osp-syn-1-0.0 00000001:00080000:2.0:1788835100.894272:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1788835100.894288:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000100:00100000:1.0:1788835100.908189:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+6:2385:x1875729242455552:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 Request processed in 19503us (19716us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835100.908222:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:0.0:1788835100.920631:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835100.920829:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242455808 00000100:00100000:2.0:1788835100.920840:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242455808 00000100:00100000:2.0:1788835100.920917:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 137 00000100:00100000:2.0:1788835100.920928:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+16:11359:x1875729242455808:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788835100.920994:0:9806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835100.921033:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2473 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0682 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.921051:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9afc810b8500) 00010000:00010000:2.0:1788835100.921065:0:9806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788835100.921094:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2496 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.921108:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2496 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.921245:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2496 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788835100.921404:0:9806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e6c4e05 reply state 0000000009827396 transno 4294967403 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2496 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.921417:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2496 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.921424:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9afc810b8500) 00010000:00010000:2.0:1788835100.921427:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788835100.921593:0:9806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788835100.921705:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+17:11359:x1875729242455808:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 776us (1082us total) trans 4294967403 rc 0/0 00000100:00100000:2.0:1788835100.921713:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 137 00000100:00100000:2.0:1788835100.924797:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835100.924894:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242455936 00000100:00100000:3.0:1788835100.924903:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242455936 00000100:00100000:3.0:1788835100.924952:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:3.0:1788835100.924962:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+6:2386:x1875729242455936:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788835100.925152:0:8402:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788835100.925156:0:8402:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb mtime from disk: 1788835101 -> 1788835100 00002000:00010000:3.0:1788835100.925159:0:8402:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788835100 00002000:00010000:3.0:1788835100.925161:0:8402:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb ctime from disk: 1788835101 -> 1788835100 00002000:00010000:3.0:1788835100.925163:0:8402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x4:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788835100.925221:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+7:2386:x1875729242455936:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 261us (432us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1788835100.925229:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:0.0:1788835100.933021:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835100.933112:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242456192 00000100:00100000:2.0:1788835100.933133:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242456192 00000100:00100000:2.0:1788835100.933196:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 138 00000100:00100000:2.0:1788835100.933206:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+17:11359:x1875729242456192:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788835100.933278:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d249d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.933295:0:9047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2457 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0674 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.933305:0:9047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d249d lrc: 4/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.933367:0:9047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2457 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0674 expref: 17 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.933380:0:9047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2457 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0674 expref: 17 pid: 6488 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835100.933395:0:9047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9047:1875729254056576:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788835100.933496:0:9047:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc82689d80 going to sleep for 11 seconds 00000100:00100000:2.0:1788835100.940961:0:9047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9047:1875729254056576:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788835100.940992:0:9047:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d249d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835100.944446:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835100.944634:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242456320 00000100:00100000:2.0:1788835100.944643:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242456320 00010000:00010000:2.0:1788835100.944678:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2457 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0674 expref: 18 pid: 6488 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835100.944727:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 76 00000100:00100000:2.0:1788835100.944736:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+18:2386:x1875729242456320:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835100.944750:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835100.944756:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2457 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0674 expref: 18 pid: 6488 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.944768:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2457 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0674 expref: 18 pid: 6488 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.944789:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2457 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x9:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0674 expref: 18 pid: 6488 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.944804:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9afc810b8500) 00010000:00010000:2.0:1788835100.944809:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d249d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.944819:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d249d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.944826:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d249d lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.944855:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835100.944900:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+17:2386:x1875729242456320:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 164us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835100.944907:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 76 00010000:00010000:3.0:1788835100.945147:0:9047:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d249d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.945155:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d249d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.945207:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d249d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.945215:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d249d lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.945221:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d249d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.945226:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835100.945230:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d249d lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.945237:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d249d lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.945246:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9afc810b8500) 00010000:00010000:3.0:1788835100.945249:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788835100.945252:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d249d lrc: 2/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.945257:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d249d lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835100.945297:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+16:11359:x1875729242456192:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 Request processed in 12093us (12293us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788835100.945354:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 138 00000100:00100000:2.0:1788835100.948248:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835100.948569:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242456448 00000100:00100000:1.0:1788835100.948581:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242456448 00000100:00100000:1.0:1788835100.948646:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:1.0:1788835100.948659:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+7:2385:x1875729242456448:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1788835100.948710:0:9814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d24a4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.948734:0:9814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d5f52162/0xdf60171e5a5d2481 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0690 expref: 7 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.948744:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835100.948749:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788835100.948754:0:9814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d24a4 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.948796:0:9814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d5f52162/0xdf60171e5a5d2481 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0690 expref: 7 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.948813:0:9814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d5f52162/0xdf60171e5a5d2481 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0690 expref: 7 pid: 9814 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835100.948829:0:9814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9814:1875729254056704:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788835100.948936:0:9814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc836eb900 going to sleep for 11 seconds 00000100:00100000:0.0:1788835100.952281:0:9814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9814:1875729254056704:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788835100.952343:0:9814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d24a4 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835100.957559:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835100.958202:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242456576 00000100:00100000:3.0:1788835100.958211:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242456576 00010000:00010000:3.0:1788835100.958249:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d5f52162/0xdf60171e5a5d2481 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0690 expref: 8 pid: 9814 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835100.958312:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 77 00000100:00100000:3.0:1788835100.958350:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+8:2386:x1875729242456576:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788835100.958365:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835100.958385:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d5f52162/0xdf60171e5a5d2481 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0690 expref: 8 pid: 9814 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.958399:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d5f52162/0xdf60171e5a5d2481 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0690 expref: 8 pid: 9814 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.958421:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d5f52162/0xdf60171e5a5d2481 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0690 expref: 8 pid: 9814 timeout: 442 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.958446:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788835100.958451:0:6475:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788835100.958457:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d24a4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.958466:0:6475:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d24a4 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.958489:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835100.958534:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+7:2386:x1875729242456576:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 187us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835100.958541:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 77 00010000:00010000:1.0:1788835100.961152:0:9814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d24a4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.961186:0:9814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d24a4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.961219:0:9814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d24a4 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.961227:0:9814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d24a4 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.961236:0:9814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d24a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.961243:0:9814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:1.0:1788835100.961247:0:9814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d24a4 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.961255:0:9814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d24a4 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.961275:0:9814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d24a4 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.961283:0:9814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d24a4 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835100.961422:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+6:2385:x1875729242456448:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 Request processed in 12761us (13178us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835100.961442:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:3.0:1788835100.965711:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788835100.965739:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd85439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254056832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835100.965829:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835100.965891:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254056832 00000100:00100000:3.0:1788835100.965899:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254056832 00000100:00100000:3.0:1788835100.965948:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788835100.965957:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd8543b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254056832:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788835100.965991:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788835100.966036:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd8543b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254056832:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835100.966044:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1788835100.966101:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd85439c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254056832:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835100.966249:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254056960:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788835100.966279:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835100.966884:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254057216:0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.966925:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835100.966945:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875729254057728:0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.966987:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835100.967027:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254058240:0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.967061:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835100.967085:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788835100.967091:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254057088:0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.967128:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835100.967153:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254057600:0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.967174:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835100.967191:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254058112:0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.967211:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835100.967238:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254058240 00000100:00100000:0.0:1788835100.967243:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254058240 00000100:00100000:0.0:1788835100.967290:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1788835100.967297:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254058240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.967383:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254058240:12345-0@lo:400:kworker.0 Request processed in 85us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835100.967391:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00080000:0.0:1788835100.967412:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788835100.967592:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254057472:0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.967620:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835100.967641:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254057984:0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.967661:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835100.967674:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788835100.967679:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254057344:0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.967702:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835100.967720:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254057856:0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.967754:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835100.967773:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254058368:0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.967794:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835100.967822:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254057344 00000100:00100000:0.0:1788835100.967826:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254057344 00000100:00100000:0.0:1788835100.967854:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788835100.967861:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254057344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.967896:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254057344:12345-0@lo:400:kworker.0 Request processed in 36us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835100.967903:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1788835100.967922:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254057856 00000100:00100000:0.0:1788835100.967925:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254057856 00000100:00100000:0.0:1788835100.967951:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254058368 00000100:00100000:0.0:1788835100.967954:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254058368 00000100:00100000:0.0:1788835100.967972:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788835100.967978:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254057856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.968007:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254057856:12345-0@lo:400:kworker.0 Request processed in 29us (252us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835100.968013:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1788835100.968025:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1788835100.968030:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3615:x1875729254058368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.968067:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3615:x1875729254058368:12345-0@lo:400:kworker.0 Request processed in 36us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835100.968072:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00080000:0.0:1788835100.968086:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788835100.968125:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254058240:0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.968170:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254057344:0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.968181:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83eff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254057856:0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.968190:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1788835100.968195:0:3615:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967310 00000004:00080000:0.0:1788835100.968207:0:3615:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afc83ed2a00, transno 4294967310 00000100:00100000:0.0:1788835100.968222:0:3615:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9afc83ed1f80 x1875729254056192/t4294967311(4294967311) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1788835116 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835100.968232:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254058368:0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.968388:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254057216 00000100:00100000:0.0:1788835100.968392:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254057216 00000100:00100000:0.0:1788835100.968412:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254057728 00000100:00100000:0.0:1788835100.968415:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254057728 00000100:00100000:1.0:1788835100.968582:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788835100.968591:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254058496:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835100.968625:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835100.968751:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254057088 00000100:00100000:3.0:1788835100.968755:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254057088 00000100:00100000:3.0:1788835100.968850:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 382 00000100:00100000:3.0:1788835100.968858:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729254057088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835100.968901:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fce050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729254057088:12345-0@lo:400:kworker.0 Request processed in 44us (1772us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835100.968908:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 382 00000100:00100000:0.0:1788835100.969658:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254057600 00000100:00100000:0.0:1788835100.969664:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254057600 00000100:00100000:0.0:1788835100.969680:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254058112 00000100:00100000:0.0:1788835100.969683:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254058112 00000100:00100000:0.0:1788835100.969696:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254057472 00000100:00100000:0.0:1788835100.969699:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254057472 00000100:00100000:0.0:1788835100.969710:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254057984 00000100:00100000:0.0:1788835100.969713:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254057984 00000100:00100000:0.0:1788835100.969728:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788835100.969736:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254057216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.969787:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254057216:12345-0@lo:400:kworker.0 Request processed in 52us (2862us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835100.969793:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:0.0:1788835100.969806:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788835100.969812:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875729254057728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.969867:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875729254057728:12345-0@lo:400:kworker.0 Request processed in 54us (2879us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835100.969872:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:0.0:1788835100.969883:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788835100.969889:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254057600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.969912:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254057600:12345-0@lo:400:kworker.0 Request processed in 24us (2738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835100.969917:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1788835100.969926:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788835100.969931:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875729254058112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.969953:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875729254058112:12345-0@lo:400:kworker.0 Request processed in 23us (2742us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835100.969959:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:0.0:1788835100.969971:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788835100.969976:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254057472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.970013:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254057472:12345-0@lo:400:kworker.0 Request processed in 37us (2391us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835100.970019:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:0.0:1788835100.970031:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:0.0:1788835100.970037:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729254057984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.970073:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729254057984:12345-0@lo:400:kworker.0 Request processed in 36us (2411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835100.970079:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:0.0:1788835100.970100:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788835100.970104:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788835100.974703:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83effb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254057088:0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.974729:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254057600:0@lo:400:kworker.0 00010000:00080000:0.0:1788835100.974745:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83efc000 x1875729254058112/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835100.974756:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254058112:0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.974769:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83eff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254057216:0@lo:400:kworker.0 00010000:00080000:0.0:1788835100.974780:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83efce00 x1875729254057728/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835116 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835100.974789:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875729254057728:0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.974840:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254057472:0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.974850:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254057984:0@lo:400:kworker.0 00000100:00100000:0.0:1788835100.975716:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835100.975792:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242456832 00000100:00100000:3.0:1788835100.975801:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242456832 00000100:00100000:3.0:1788835100.975857:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 139 00000100:00100000:3.0:1788835100.975867:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+16:11359:x1875729242456832:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788835100.975949:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d24ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.975979:0:9047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d239a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae063c expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.975992:0:9047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d24ab lrc: 4/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.976238:0:9047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d239a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae063c expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.976958:0:9047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d239a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae063c expref: 16 pid: 6488 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835100.976977:0:9047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd8543a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9047:1875729254058624:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788835100.977107:0:9047:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd83e4e6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788835100.979730:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254056960 00000100:00100000:2.0:1788835100.979744:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254056960 00000100:00100000:2.0:1788835100.979804:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254058496 00000100:00100000:2.0:1788835100.979807:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254058496 00000100:00100000:2.0:1788835100.979827:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788835100.979835:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd85439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1875729254056960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788835100.979868:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788835100.979949:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd85439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1875729254056960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 114us (13669us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835100.979956:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:2.0:1788835100.979974:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1788835100.979981:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254058496:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788835100.979990:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788835100.981038:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254056960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788835100.982935:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254058496:12345-0@lo:13:osp-pre-0-1.0 Request processed in 2948us (14302us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835100.982949:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1788835100.983138:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254058496:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788835100.986269:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835100.986468:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242456960 00000100:00100000:1.0:1788835100.986477:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242456960 00010000:00010000:1.0:1788835100.986513:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d239a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae063c expref: 17 pid: 6488 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835100.986550:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:1.0:1788835100.986560:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+17:2385:x1875729242456960:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788835100.986574:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835100.986582:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d239a lrc: 5/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae063c expref: 17 pid: 6488 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.986594:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d239a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae063c expref: 17 pid: 6488 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.986619:0:9491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:1.0:1788835100.986626:0:9491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab800/0xdf60171e5a5d23fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae065f expref: 17 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.986652:0:9491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d24ab lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.986661:0:9491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d24ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.986668:0:9491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d24ab lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835100.986690:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788835100.986738:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+17:2385:x1875729242456960:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 179us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835100.986745:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 78 00010000:00010000:3.0:1788835100.987786:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d239a lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae063c expref: 16 pid: 6488 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835100.987807:0:9047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd8543a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9047:1875729254058624:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788835100.987829:0:9047:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d24ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.987839:0:9047:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d24ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.987846:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d24ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.988031:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d24b2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.988060:0:9047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2465 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae067b expref: 16 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.988069:0:9047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d24b2 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.988099:0:9047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2465 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae067b expref: 16 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835100.988112:0:9047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2465 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae067b expref: 16 pid: 9806 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835100.988136:0:9047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd8543a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9047:1875729254058752:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788835100.988209:0:9047:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd83e4ec00 going to sleep for 11 seconds 00000100:00100000:3.0:1788835100.993051:0:9047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd8543a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9047:1875729254058752:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788835100.993094:0:9047:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d24b2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835100.995029:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835100.995765:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242457088 00000100:00100000:2.0:1788835100.995774:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242457088 00010000:00010000:2.0:1788835100.995812:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2465 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae067b expref: 17 pid: 9806 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835100.995850:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:2.0:1788835100.995858:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+17:2386:x1875729242457088:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835100.995872:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835100.995879:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2465 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae067b expref: 17 pid: 9806 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.995912:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2465 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae067b expref: 17 pid: 9806 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.995934:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2465 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae067b expref: 17 pid: 9806 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.995949:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9afc810b8500) 00010000:00010000:2.0:1788835100.995954:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d24b2 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.995964:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d24b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.995971:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d24b2 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835100.995999:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788835100.996133:0:9047:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d24b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835100.996142:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d24b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788835100.996272:0:9047:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:0.0:1788835100.996425:0:9047:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000001:00080000:0.0:1788835100.996757:0:9047:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1788835100.996837:0:9047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83fb6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9047:1875729254058880:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1788835100.996919:0:9047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835100.997075:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+19:2386:x1875729242457088:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 1216us (2054us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835100.997085:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:0.0:1788835100.997261:0:9047:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b2000 going to sleep for 11 seconds 00000100:00100000:3.0:1788835101.002672:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254058880 00000100:00100000:3.0:1788835101.002685:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254058880 00000100:00100000:2.0:1788835101.008523:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788835101.008537:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9047:x1875729254058880:12345-0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1788835101.008677:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:9047:x1875729254058880:12345-0@lo:1000:mdt00_003.0 Request processed in 142us (11756us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835101.008684:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1788835101.008853:0:9047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83fb6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9047:1875729254058880:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1788835101.009023:0:9047:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00000100:00100000:3.0:1788835101.009106:0:9047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd8543a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9047:1875729254059008:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1788835101.009158:0:9047:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835101.009192:0:9047:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd83e4ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1788835101.009401:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254059008 00000100:00100000:1.0:1788835101.009408:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254059008 00000100:00100000:1.0:1788835101.009454:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788835101.009462:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd85439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:9047:x1875729254059008:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1788835101.009585:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd85439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:9047:x1875729254059008:12345-0@lo:1000:mdt00_003.0 Request processed in 123us (426us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1788835101.009593:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1788835101.009626:0:9047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd8543a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:9047:1875729254059008:0@lo:1000:mdt00_003.0 00010000:00010000:1.0:1788835101.009667:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d24b2 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.009678:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d24b2 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.009686:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d24b2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.009706:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aaa00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835101.009712:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d24b2 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.009720:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d24b2 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.009736:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9afc810b8500) 00010000:00010000:1.0:1788835101.009740:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788835101.009744:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d24b2 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.009750:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d24b2 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.009774:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d23f5 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.009780:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d23f5 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.009786:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d23f5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.009792:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374ce00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835101.009795:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d23f5 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.009801:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d23f5 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.009821:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:1.0:1788835101.009823:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788835101.009830:0:9047:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab800/0xdf60171e5a5d23fc lrc: 2/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae065f expref: 19 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.009842:0:9047:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab800/0xdf60171e5a5d23fc lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae065f expref: 19 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.009851:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab800/0xdf60171e5a5d23fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae065f expref: 19 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.009875:0:9047:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab800/0xdf60171e5a5d23fc lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae065f expref: 19 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835101.009887:0:9047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9047:1875729254059136:192.168.203.22@tcp:105: 00000100:00100000:1.0:1788835101.010065:0:9047:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc836ebf00 going to sleep for 11 seconds 00000100:00100000:1.0:1788835101.014891:0:9047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa1500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9047:1875729254059136:192.168.203.22@tcp:105: 00010000:00010000:1.0:1788835101.014923:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d23f5 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.014933:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d23f5 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.014969:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d24b9 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.014982:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d24b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.015019:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d24b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.015030:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d24b9 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.015035:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d24b9 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.015041:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d24b9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.015047:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835101.015051:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d24b9 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.015066:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d24b9 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.015076:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:1.0:1788835101.015079:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835101.015083:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d24b9 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.015088:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d24b9 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.015098:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d24ab lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.015104:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d24ab lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.015126:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d24ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.015133:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aa400 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835101.015137:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d24ab lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.015143:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d24ab lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.015152:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:1.0:1788835101.015155:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788835101.015158:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d24ab lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835101.015163:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d24ab lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835101.015385:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+19:11359:x1875729242456832:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 39518us (39673us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1788835101.015396:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 139 00000020:00080000:1.0:1788835101.015402:0:9047:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788835101.016398:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788835101.016404:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788835101.016997:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1788835101.017017:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788835101.023825:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835101.023914:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242457216 00000100:00100000:2.0:1788835101.023927:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242457216 00000100:00100000:2.0:1788835101.024002:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:2.0:1788835101.024022:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+19:11358:x1875729242457216:12345-192.168.203.22@tcp:49:lfs.0 00000100:00080000:0.0:1788835101.024338:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788835101.024556:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+19:11358:x1875729242457216:12345-192.168.203.22@tcp:49:lfs.0 Request processed in 535us (739us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835101.024563:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:2.0:1788835101.049808:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835101.049938:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835101.050026:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242457728 00000100:00100000:0.0:1788835101.050035:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242457728 00000100:00100000:0.0:1788835101.050114:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 140 00000100:00100000:0.0:1788835101.050134:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+19:11358:x1875729242457728:12345-192.168.203.22@tcp:58:lfs.0 00000040:00080000:0.0:1788835101.050296:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1788835101.050413:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+19:11358:x1875729242457728:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 289us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835101.050421:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 140 00000100:00100000:3.0:1788835101.055988:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242457472 00000100:00100000:3.0:1788835101.056720:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242457472 00000100:00100000:0.0:1788835101.056857:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:0.0:1788835101.056867:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84e66050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+19:11359:x1875729242457472:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1788835101.057144:0:6491:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1788835101.057176:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967409 00010000:00010000:0.0:1788835101.057210:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24c0 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835101.057227:0:6491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835101.057239:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24c0 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835101.057262:0:6491:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24c0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835101.057268:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24c0 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835101.057289:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835101.057309:0:6491:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1788835101.057624:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84e66050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+21:11359:x1875729242457472:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 756us (7823us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1788835101.057633:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 32 00000020:00080000:0.0:1788835101.057638:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788835101.057796:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788835101.057804:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24c0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.057812:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4600 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:3.0:1788835101.057816:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24c0 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.057823:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24c0 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.057836:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9afc810b8500) 00010000:00010000:3.0:1788835101.057839:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788835101.057843:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24c0 lrc: 1/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.057849:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24c0 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x9:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.057861:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835101.057863:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835101.057865:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835101.096199:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835101.096363:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242457856 00000100:00100000:0.0:1788835101.096375:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242457856 00000100:00100000:0.0:1788835101.096440:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 141 00000100:00100000:0.0:1788835101.096451:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+21:11361:x1875729242457856:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788835101.096474:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835101.096493:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d24c7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0697 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835101.096559:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d24ce lrc: 3/1,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835101.096573:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d24ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835101.096585:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d24ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835101.096599:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24d5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835101.096607:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835101.096627:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835101.096698:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d24dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835101.096708:0:9806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d23e7 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0658 expref: 22 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835101.096716:0:9806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d24dc lrc: 4/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835101.096748:0:9806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d23e7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0658 expref: 22 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835101.096761:0:9806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d23e7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0658 expref: 22 pid: 9806 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835101.096774:0:9806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83fb4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9806:1875729254059264:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788835101.096857:0:9806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b2000 going to sleep for 11 seconds 00000100:00100000:0.0:1788835101.108166:0:9806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83fb4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9806:1875729254059264:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788835101.108200:0:9806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d24dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835101.108939:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835101.109019:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242458112 00000100:00100000:0.0:1788835101.109026:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242458112 00000100:00100000:0.0:1788835101.109091:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:0.0:1788835101.109101:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+23:6158:x1875729242458112:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788835101.113777:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+24:6158:x1875729242458112:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 4665us (4830us total) trans 4294967411 rc 0/0 00000100:00100000:1.0:1788835101.113800:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:0.0:1788835101.116470:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835101.120540:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242458240 00000100:00100000:2.0:1788835101.120556:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242458240 00010000:00010000:2.0:1788835101.120612:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d23e7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0658 expref: 24 pid: 9806 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835101.120718:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:2.0:1788835101.120731:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+24:2386:x1875729242458240:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835101.120750:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835101.120758:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d23e7 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0658 expref: 24 pid: 9806 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835101.120772:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d23e7 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0658 expref: 24 pid: 9806 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835101.120816:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d23e7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0658 expref: 24 pid: 9806 timeout: 443 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835101.120834:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:2.0:1788835101.120840:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d24dc lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835101.120849:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d24dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835101.120857:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d24dc lrc: 4/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835101.120893:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835101.120960:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+23:2386:x1875729242458240:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 231us (4498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835101.120967:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 80 00010000:00010000:3.0:1788835101.121045:0:9806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d24dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.121063:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d24dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835101.121131:0:9806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00000004:00200000:3.0:1788835101.121136:0:9806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788835101.121159:0:9806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d24dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.121184:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d24dc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.121194:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d24ce lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.121201:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d24ce lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.121207:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d24ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.121213:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835101.121217:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d24ce lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.121225:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d24ce lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.121234:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:3.0:1788835101.121237:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835101.121241:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d24ce lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.121247:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d24ce lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.121260:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24d5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.121266:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24d5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.121277:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.121281:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835101.121283:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24d5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.121289:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24d5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.121297:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x238769cd (ffff9afc835cc800) 00010000:00010000:3.0:1788835101.121300:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835101.121303:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24d5 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.121309:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d24d5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.121387:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d24c7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0697 expref: 23 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.121402:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d24dc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0697 expref: 22 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835101.121409:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:3.0:1788835101.121411:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788835101.121414:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f4400, rc 0) 00000100:00100000:3.0:1788835101.121443:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+22:11361:x1875729242457856:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 24993us (25253us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835101.121459:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 141 00010000:00010000:2.0:1788835101.158970:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835101.478464:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788835101.478487:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254059392:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788835101.478557:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835101.478707:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254059392 00000100:00100000:2.0:1788835101.478716:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254059392 00000100:00100000:2.0:1788835101.478776:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788835101.478786:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254059392:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788835101.478808:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:2.0:1788835101.478851:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254059392:12345-0@lo:13:osp-pre-1-1.0 Request processed in 66us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835101.478859:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1788835101.478880:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788835101.478903:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254059520:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788835101.478932:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835101.479065:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254059520 00000100:00100000:1.0:1788835101.479070:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254059520 00000100:00100000:1.0:1788835101.479107:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788835101.479123:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3616:x1875729254059520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788835101.479134:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923529728 avail 3691978752 00000100:00100000:1.0:1788835101.479172:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3616:x1875729254059520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 51us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835101.479179:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:0.0:1788835101.479261:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254059392:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788835101.479368:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254059520:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1788835102.054570:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788835102.054579:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788835102.054606:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788835102.054616:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788835102.054760:0:13768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875729254059648:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788835102.054874:0:13768:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc82689840 going to sleep for 11 seconds 00000100:00100000:2.0:1788835102.058223:0:13768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed3100 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875729254059648:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788835102.060506:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835102.061398:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242458368 00000100:00100000:2.0:1788835102.061407:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242458368 00000100:00100000:2.0:1788835102.061469:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 142 00000100:00100000:2.0:1788835102.061479:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd85438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+22:11372:x1875729242458368:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1788835102.061511:0:9047:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1788835102.061626:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd85438a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+22:11372:x1875729242458368:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 148us (1126us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835102.061635:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 142 00000100:00100000:3.0:1788835102.065783:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835102.065828:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242458624 00000100:00100000:3.0:1788835102.065838:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242458624 00000100:00100000:3.0:1788835102.065893:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 143 00000100:00100000:3.0:1788835102.065907:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd8543ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+22:11372:x1875729242458624:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788835102.065929:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835102.065952:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d24e3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae069e expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.066506:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d24ea lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.066523:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d24ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.066536:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d24ea lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835102.066547:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:3.0:1788835102.066657:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d24e3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae069e expref: 25 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.066676:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d24ea lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae069e expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.066684:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:3.0:1788835102.066702:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788835102.066706:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884aae00, rc 0) 00000100:00100000:3.0:1788835102.067869:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd8543ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+24:11372:x1875729242458624:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 1957us (2087us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1788835102.067879:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 143 00000100:00100000:3.0:1788835102.080524:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835102.081584:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242459008 00000100:00100000:2.0:1788835102.081595:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242459008 00000100:00100000:2.0:1788835102.081656:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1788835102.081666:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaae6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+24:2387:x1875729242459008:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835102.081681:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835102.081705:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d24ea lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae069e expref: 24 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835102.081733:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:2.0:1788835102.081738:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835102.081802:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaae6a450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+23:2387:x1875729242459008:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 137us (1285us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835102.081810:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1788835102.082689:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835102.082784:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242458880 00000100:00100000:3.0:1788835102.082790:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242458880 00000100:00100000:3.0:1788835102.082834:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 144 00000100:00100000:3.0:1788835102.082843:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+23:11372:x1875729242458880:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788835102.082910:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d24f8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.082927:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d24f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.085467:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d24f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.085660:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d24f8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.085669:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d24f8 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.085675:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d24f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.085682:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884ab600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835102.085686:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d24f8 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.085708:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d24f8 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.085723:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:3.0:1788835102.085727:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788835102.085732:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d24f8 lrc: 2/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.085738:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d24f8 lrc: 0/0,0 mode: --/PW res: [0x200000402:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835102.085880:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+24:11372:x1875729242458880:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 3034us (3189us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1788835102.085891:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 144 00000040:00080000:0.0:1788835102.086535:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788835102.086540:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788835102.087037:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1788835102.087059:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788835102.091227:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835102.091311:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242459264 00000100:00100000:2.0:1788835102.091362:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242459264 00000100:00100000:2.0:1788835102.091419:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:2.0:1788835102.091429:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+24:11372:x1875729242459264:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788835102.091634:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+25:11372:x1875729242459264:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 205us (414us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1788835102.091642:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 34 00010000:00010000:2.0:1788835102.196230:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788835102.320920:0:14230:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788835102.320929:0:14230:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788835102.320974:0:14230:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1788835102.321671:0:14230:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788835102.501985:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788835102.502014:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254059776:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788835102.502098:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835102.502179:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254059776 00000100:00100000:1.0:1788835102.502186:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254059776 00000100:00100000:1.0:1788835102.502229:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788835102.502239:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254059776:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788835102.502283:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:1.0:1788835102.502355:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254059776:12345-0@lo:41:osp-pre-0-1.0 Request processed in 117us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835102.502362:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1788835102.502408:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254059776:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788835102.549590:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835102.549659:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242459520 00000100:00100000:1.0:1788835102.549669:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242459520 00000100:00100000:1.0:1788835102.549726:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 145 00000100:00100000:1.0:1788835102.549736:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+25:11385:x1875729242459520:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788835102.549758:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835102.549778:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d24ff lrc: 2/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae06a5 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835102.549879:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d2506 lrc: 3/1,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835102.549899:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d2506 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835102.549911:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d2506 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835102.549923:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0x7:0x0]: returning size 0 00010000:00010000:1.0:1788835102.550038:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60000/0xdf60171e5a5d24ff lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06a5 expref: 28 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835102.550064:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d2506 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06a5 expref: 27 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835102.550072:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:1.0:1788835102.550075:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1788835102.550079:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61a00, rc 0) 00000100:00100000:1.0:1788835102.550145:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+27:11385:x1875729242459520:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 410us (563us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1788835102.550153:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 145 00000100:00100000:0.0:1788835102.553392:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835102.553491:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242459648 00000100:00100000:3.0:1788835102.553501:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242459648 00000100:00100000:3.0:1788835102.553557:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 146 00000100:00100000:3.0:1788835102.553566:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+27:11385:x1875729242459648:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:3.0:1788835102.553625:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d2514 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.553641:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d2514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.553653:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d2514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.553686:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d2514 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.553710:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d2514 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.553718:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d2514 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.553724:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884ab600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835102.553728:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d2514 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.553735:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d2514 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.553746:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:3.0:1788835102.553749:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788835102.553754:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d2514 lrc: 2/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835102.553761:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d2514 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835102.553838:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+27:11385:x1875729242459648:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 273us (454us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835102.553845:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 146 00000100:00100000:0.0:1788835102.691198:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835102.691360:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242459776 00000100:00100000:1.0:1788835102.691370:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242459776 00000100:00100000:1.0:1788835102.691448:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:1.0:1788835102.691459:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+6:2388:x1875729242459776:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:1.0:1788835102.691477:0:9814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835102.691499:0:9814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d69caee5/0xdf60171e5a5d251b lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae06ac expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788835102.691543:0:9814:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f751c, atime: 0x6a9f751c, ctime: 0x6a9f751c, blocks: 0x8 00010000:00010000:1.0:1788835102.691563:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=344s v=(0 0) 00010000:00010000:1.0:1788835102.691567:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835102.691577:0:9814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d69caee5/0xdf60171e5a5d251b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06ac expref: 7 pid: 9814 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835102.691597:0:9814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d69caee5/0xdf60171e5a5d251b lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06ac expref: 7 pid: 9814 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835102.691611:0:9814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60000, rc 0) 00000100:00100000:1.0:1788835102.691666:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+7:2388:x1875729242459776:12345-192.168.203.22@tcp:101:cat.0 Request processed in 208us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835102.691674:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00080000:0.0:1788835102.691898:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788835102.696345:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835102.696440:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242459904 00000100:00100000:0.0:1788835102.696452:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242459904 00002000:00100000:0.0:1788835102.696502:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9afdbfaa2300 x1875729242459904/t0(0) o3->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:23/0 lens 488/0 e 0 to 0 dl 1788835113 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788835102.696512:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afdbfaa2300 with x1875729242459904 ext(0->4095) 00002000:00010000:0.0:1788835102.696517:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afdbfaa2300 00000100:00100000:0.0:1788835102.696550:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:0.0:1788835102.696560:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b8987b33-76f7-43a0-9448-1013c4af787f+7:2386:x1875729242459904:12345-192.168.203.22@tcp:3:cat.0 00000100:00100000:0.0:1788835102.696777:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b8987b33-76f7-43a0-9448-1013c4af787f+7:2386:x1875729242459904:12345-192.168.203.22@tcp:3:cat.0 Request processed in 218us (468us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1788835102.696785:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00002000:00100000:0.0:1788835102.696803:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x2c0000401:0x4:0x0] (0->4095) req@ffff9afdbfaa2300 x1875729242459904/t0(0) o3->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:23/0 lens 488/4536 e 0 to 0 dl 1788835113 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1788835102.696811:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afdbfaa2300 with x1875729242459904 ext(0->4095) 00002000:00010000:0.0:1788835102.696815:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afdbfaa2300 00000040:00080000:0.0:1788835103.146300:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1788835103.146309:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1788835103.146347:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1788835103.146362:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788835103.205616:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788835103.334092:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788835104.229743:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835104.876163:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835104.876216:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835104.876243:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835104.876269:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835104.876300:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835104.876377:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835104.876412:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835104.876441:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242460288 00000100:00100000:3.0:1788835104.876450:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242460288 00000100:00100000:3.0:1788835104.876511:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242460800 00000100:00100000:3.0:1788835104.876513:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242460800 00000100:00100000:0.0:1788835104.876735:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242460032 00000100:00100000:0.0:1788835104.876740:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242460032 00000100:00100000:0.0:1788835104.876774:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 383 00000100:00100000:0.0:1788835104.876783:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:2385:x1875729242460032:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835104.876867:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84fce850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:2385:x1875729242460032:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 85us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835104.876874:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 383 00000100:00100000:0.0:1788835104.876909:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242460544 00000100:00100000:0.0:1788835104.876912:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242460544 00000100:00100000:0.0:1788835104.876936:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242460416 00000100:00100000:0.0:1788835104.876939:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242460416 00000100:00100000:0.0:1788835104.876957:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 104 00000100:00100000:0.0:1788835104.876963:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba75ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+7:2385:x1875729242460544:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835104.876991:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba75ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+7:2385:x1875729242460544:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 28us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835104.876998:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 104 00000100:00100000:0.0:1788835104.877144:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 105 00000100:00100000:0.0:1788835104.877150:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbface300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242460416:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835104.877198:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbface300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242460416:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 48us (820us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835104.877204:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 105 00000100:00080000:0.0:1788835104.877221:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788835104.877225:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788835104.877227:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788835104.877235:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242460160 00000100:00100000:0.0:1788835104.877238:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242460160 00000100:00100000:0.0:1788835104.877260:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242460672 00000100:00100000:0.0:1788835104.877263:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242460672 00000100:00100000:0.0:1788835104.877274:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 288 00000100:00100000:0.0:1788835104.877281:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd85439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242460288:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835104.877308:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd85439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242460288:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 28us (1092us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835104.877365:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 288 00000100:00100000:0.0:1788835104.877380:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 289 00000100:00100000:0.0:1788835104.877387:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd85438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242460800:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835104.877423:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd85438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242460800:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (1141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835104.877429:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 289 00000100:00100000:0.0:1788835104.877440:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 290 00000100:00100000:0.0:1788835104.877446:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+27:2385:x1875729242460160:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835104.877472:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+27:2385:x1875729242460160:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (1171us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835104.877478:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 290 00000100:00100000:0.0:1788835104.877497:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 291 00000100:00100000:0.0:1788835104.877504:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242460672:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835104.877540:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242460672:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 37us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835104.877546:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 291 00000100:00080000:0.0:1788835104.877565:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1788835105.063764:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00010000:00010000:3.0:1788835105.256771:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835106.089367:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788835106.089399:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfacca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254059904:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835106.089496:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835106.089594:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254059904 00000100:00100000:3.0:1788835106.089604:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254059904 00000100:00100000:3.0:1788835106.089681:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788835106.089696:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254059904:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788835106.089744:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788835106.089811:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254059904:12345-0@lo:41:osp-pre-1-0.0 Request processed in 118us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835106.089822:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788835106.089912:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfacca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254059904:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788835106.091267:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254060160:0@lo:400:kworker.0 00000100:00100000:0.0:1788835106.091345:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835106.091381:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875729254060672:0@lo:400:kworker.0 00000100:00100000:0.0:1788835106.091401:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835106.091414:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254061184:0@lo:400:kworker.0 00000100:00100000:0.0:1788835106.091431:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835106.091452:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:0.0:1788835106.091458:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254060032:0@lo:400:kworker.0 00000100:00100000:0.0:1788835106.091484:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835106.091502:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254060544:0@lo:400:kworker.0 00000100:00100000:0.0:1788835106.091528:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835106.091546:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8365fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729254061056:0@lo:400:kworker.0 00000100:00100000:0.0:1788835106.091568:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835106.091712:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254060160 00000100:00100000:0.0:1788835106.091719:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254060160 00000100:00100000:0.0:1788835106.091755:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254060672 00000100:00100000:0.0:1788835106.091758:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254060672 00000100:00100000:0.0:1788835106.091781:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254061184 00000100:00100000:0.0:1788835106.091784:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254061184 00000100:00100000:0.0:1788835106.091811:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254060544 00000100:00100000:0.0:1788835106.091813:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254060544 00000100:00100000:0.0:1788835106.091825:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254061056 00000100:00100000:0.0:1788835106.091828:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254061056 00000100:00100000:0.0:1788835106.091842:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788835106.091850:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254060160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835106.091902:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa22680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254060160:12345-0@lo:400:kworker.0 Request processed in 52us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835106.091909:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:0.0:1788835106.091925:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788835106.091931:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875729254060672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835106.091959:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa20e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875729254060672:12345-0@lo:400:kworker.0 Request processed in 28us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835106.091966:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1788835106.091978:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788835106.091984:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875729254061184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835106.092010:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875729254061184:12345-0@lo:400:kworker.0 Request processed in 27us (578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835106.092016:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:0.0:1788835106.092040:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788835106.092047:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254060544:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835106.092074:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254060544:12345-0@lo:400:kworker.0 Request processed in 27us (545us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835106.092079:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1788835106.092090:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:0.0:1788835106.092096:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729254061056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835106.092133:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90482a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729254061056:12345-0@lo:400:kworker.0 Request processed in 37us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835106.092140:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00080000:0.0:1788835106.092161:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788835106.092165:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788835106.092190:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83fb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254060544:0@lo:400:kworker.0 00000100:00100000:0.0:1788835106.092201:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729254061056:0@lo:400:kworker.0 00000100:00100000:0.0:1788835106.092210:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83fb4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254060160:0@lo:400:kworker.0 00010000:00080000:0.0:1788835106.092221:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83fb6680 x1875729254060672/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835106.092231:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83fb6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875729254060672:0@lo:400:kworker.0 00010000:00080000:0.0:1788835106.092240:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8365d500 x1875729254061184/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835106.092248:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8365d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254061184:0@lo:400:kworker.0 00000100:00100000:3.0:1788835106.097829:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254060288:0@lo:400:kworker.0 00000100:00100000:3.0:1788835106.097967:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835106.098037:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788835106.098053:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd90483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254061568:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835106.098084:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835106.098131:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254061568 00000100:00100000:1.0:1788835106.098138:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254061568 00000100:00100000:1.0:1788835106.098202:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1788835106.098237:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254061568:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788835106.098278:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835106.098372:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254061568:12345-0@lo:13:osp-pre-0-1.0 Request processed in 158us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835106.098404:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:1.0:1788835106.098439:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788835106.098498:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd90483800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254061568:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788835106.099361:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254060800:0@lo:400:kworker.0 00000100:00100000:3.0:1788835106.099402:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835106.099424:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254061312:0@lo:400:kworker.0 00000100:00100000:3.0:1788835106.099444:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835106.099468:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:3.0:1788835106.099485:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254060416:0@lo:400:kworker.0 00000100:00100000:3.0:1788835106.099511:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835106.099527:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc836b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254060928:0@lo:400:kworker.0 00000100:00100000:3.0:1788835106.099543:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835106.099556:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254061440:0@lo:400:kworker.0 00000100:00100000:3.0:1788835106.099571:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835106.099671:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254060032 00000100:00100000:3.0:1788835106.099678:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254060032 00000100:00100000:3.0:1788835106.099720:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788835106.099728:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729254060032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835106.099773:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7282850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729254060032:12345-0@lo:400:kworker.0 Request processed in 46us (8288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835106.099780:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 384 00000100:00100000:3.0:1788835106.099808:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254060416 00000100:00100000:3.0:1788835106.099812:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254060416 00000100:00100000:3.0:1788835106.099835:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1788835106.099842:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254060416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835106.099876:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254060416:12345-0@lo:400:kworker.0 Request processed in 35us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835106.099882:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1788835106.100141:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254060800 00000100:00100000:2.0:1788835106.100146:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254060800 00000100:00100000:2.0:1788835106.100168:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254061312 00000100:00100000:2.0:1788835106.100171:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254061312 00000100:00100000:2.0:1788835106.100189:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254060928 00000100:00100000:2.0:1788835106.100191:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254060928 00000100:00100000:2.0:1788835106.100204:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254061440 00000100:00100000:2.0:1788835106.100331:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254061440 00000100:00100000:2.0:1788835106.100362:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788835106.100368:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254060800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835106.100407:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254060800:12345-0@lo:400:kworker.0 Request processed in 39us (1004us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835106.100413:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788835106.100425:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788835106.100431:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254061312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835106.100457:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f37100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254061312:12345-0@lo:400:kworker.0 Request processed in 26us (1013us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835106.100462:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1788835106.100472:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788835106.100478:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254060928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835106.100502:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f34000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254060928:12345-0@lo:400:kworker.0 Request processed in 25us (957us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835106.100507:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1788835106.100516:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788835106.100522:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3614:x1875729254061440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835106.100545:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f36d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3614:x1875729254061440:12345-0@lo:400:kworker.0 Request processed in 24us (973us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835106.100550:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1788835106.100604:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788835106.100614:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254061696:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788835106.100643:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835106.100672:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254061696 00000100:00100000:2.0:1788835106.100676:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254061696 00000100:00100000:2.0:1788835106.100699:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788835106.100713:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254061696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788835106.100728:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788835106.100763:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254061696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 51us (119us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835106.100768:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 125 00000100:00100000:2.0:1788835106.100797:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1788835106.100803:0:3616:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967304 committed transno 4294967305 00000004:00080000:2.0:1788835106.100821:0:3616:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afdbfaa1880, transno 4294967305 00000100:00100000:2.0:1788835106.100836:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254061696:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788835106.101077:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83fb6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254060032:0@lo:400:kworker.0 00000100:00080000:1.0:1788835106.101097:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1788835106.101101:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788835106.101505:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254060288 00000100:00100000:0.0:1788835106.101515:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254060288 00000100:00100000:0.0:1788835106.101571:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788835106.101583:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfacca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254060288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835106.101663:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfacca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254060288:12345-0@lo:400:kworker.0 Request processed in 81us (3693us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835106.101672:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000001:00080000:1.0:1788835106.107673:0:6467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:1.0:1788835106.107741:0:6467:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9afd83e4e180 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1788835106.107751:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afc82784200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9afd83e4ec00 00000020:00080000:1.0:1788835106.107755:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afc82784d00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9afd8670de00 00000020:00080000:1.0:1788835106.107797:0:6467:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00010000:00010000:1.0:1788835106.107829:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2496 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835106.107844:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2496 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835106.107856:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2496 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835106.107864:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374c000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835106.107872:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2496 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835106.107882:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2496 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835106.107924:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x9:0x0].0x0 (ffff9afc810b8500) 00010000:00010000:1.0:1788835106.107950:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835106.107959:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2496 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835106.107966:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2496 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x9:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788835106.108043:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1788835106.108132:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1788835106.110457:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83fb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254060416:0@lo:400:kworker.0 00000100:00100000:2.0:1788835106.110485:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc836b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254060928:0@lo:400:kworker.0 00000100:00100000:2.0:1788835106.110505:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254061440:0@lo:400:kworker.0 00000100:00100000:2.0:1788835106.110524:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83fb5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254060288:0@lo:400:kworker.0 00000100:00100000:2.0:1788835106.110543:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaaa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254060800:0@lo:400:kworker.0 00000100:00100000:2.0:1788835106.110562:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254061312:0@lo:400:kworker.0 00010000:00010000:3.0:1788835106.281360:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835106.598070:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788835106.598108:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd90482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254061824:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788835106.598188:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835106.598448:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254061824 00000100:00100000:0.0:1788835106.598457:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254061824 00000100:00100000:0.0:1788835106.598517:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1788835106.598543:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254061824:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788835106.598587:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:0.0:1788835106.598642:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f35c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254061824:12345-0@lo:13:osp-pre-1-1.0 Request processed in 102us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835106.598650:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788835106.598840:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd90482680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254061824:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788835106.599773:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788835106.599790:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254061952:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788835106.599841:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835106.599976:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254061952 00000100:00100000:1.0:1788835106.599983:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254061952 00000100:00100000:1.0:1788835106.600035:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:1.0:1788835106.600044:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3614:x1875729254061952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788835106.600062:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788835106.600123:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3614:x1875729254061952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835106.600130:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1788835106.600358:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254061952:0@lo:13:osp-pre-1-0.0 00000001:00080000:2.0:1788835107.115548:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:2.0:1788835107.115562:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:2.0:1788835107.308846:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835107.622560:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788835107.622589:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd87f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254062080:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788835107.622740:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835107.622814:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254062080 00000100:00100000:0.0:1788835107.622826:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254062080 00000100:00100000:0.0:1788835107.622885:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1788835107.622967:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254062080:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788835107.623001:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:0.0:1788835107.623067:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254062080:12345-0@lo:41:osp-pre-0-1.0 Request processed in 173us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835107.623074:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1788835107.623523:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd87f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254062080:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788835108.325650:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835108.415429:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835108.418218:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242460928 00000100:00100000:3.0:1788835108.418234:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242460928 00000100:00100000:3.0:1788835108.418370:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 147 00000100:00100000:3.0:1788835108.418384:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+13:11046:x1875729242460928:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1788835108.418504:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+13:11046:x1875729242460928:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 Request processed in 123us (3087us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835108.418513:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 147 00000100:00080000:1.0:1788835108.420429:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788835108.421233:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835108.421370:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242461056 00000100:00100000:2.0:1788835108.421402:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242461056 00000100:00080000:1.0:1788835108.421502:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788835108.421510:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 148 00000100:00100000:2.0:1788835108.421529:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+5:11046:x1875729242461056:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788835108.421652:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+5:11046:x1875729242461056:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 Request processed in 131us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835108.421660:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 148 00000100:00100000:0.0:1788835108.431589:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835108.432469:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242461312 00000100:00100000:3.0:1788835108.432491:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242461312 00000100:00100000:3.0:1788835108.435211:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:3.0:1788835108.435243:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+13:11046:x1875729242461312:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788835108.435610:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+14:11046:x1875729242461312:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 383us (4030us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1788835108.435620:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:1.0:1788835108.853834:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835108.854071:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242461440 00000100:00100000:0.0:1788835108.854089:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242461440 00000100:00080000:1.0:1788835108.854356:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788835108.854472:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 149 00000100:00100000:0.0:1788835108.854487:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:11846:x1875729242461440:12345-192.168.203.22@tcp:101:lsof.0 00010000:00010000:0.0:1788835108.854519:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835108.854548:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2522 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae06b3 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835108.854638:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2529 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835108.854657:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2529 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835108.854697:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2529 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788835108.854842:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788835108.854847:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788835108.854904:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2529 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835108.854934:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2522 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06b3 expref: 7 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835108.854958:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2529 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06b3 expref: 6 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835108.854969:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afdba168f00) 00010000:00010000:0.0:1788835108.854972:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788835108.854977:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5600, rc 0) 00000100:00100000:0.0:1788835108.856298:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:11846:x1875729242461440:12345-192.168.203.22@tcp:101:lsof.0 Request processed in 1805us (2472us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835108.856312:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 149 00010000:00010000:3.0:1788835109.355378:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835109.981041:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835109.981097:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835109.981130:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835109.981195:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242462080 00000100:00100000:3.0:1788835109.981206:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242461568 00000100:00100000:2.0:1788835109.981206:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242462080 00000100:00100000:3.0:1788835109.981213:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242461568 00000100:00100000:3.0:1788835109.981262:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 385 00000100:00100000:2.0:1788835109.981263:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 110 00000100:00100000:3.0:1788835109.981279:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:2386:x1875729242461568:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835109.981280:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+6:2386:x1875729242462080:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835109.981375:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:2386:x1875729242461568:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 98us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835109.981399:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 385 00000100:00080000:0.0:1788835109.981441:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788835109.981447:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242461824 00000100:00100000:3.0:1788835109.981452:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242461824 00000100:00100000:3.0:1788835109.981478:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 298 00000100:00100000:3.0:1788835109.981484:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242461824:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835109.981976:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+6:2386:x1875729242462080:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 703us (844us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835109.981984:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 110 00000100:00100000:1.0:1788835109.986335:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835109.986341:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242461824:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 4818us (5207us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835109.986357:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 298 00000100:00100000:3.0:1788835109.986388:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242462336 00000100:00100000:3.0:1788835109.986396:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242462336 00000100:00100000:3.0:1788835109.986452:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 299 00000100:00100000:1.0:1788835109.986471:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00080000:0.0:1788835109.986501:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788835109.986517:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242461696 00000100:00100000:0.0:1788835109.986521:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242461696 00000100:00100000:3.0:1788835109.987159:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242462336:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835109.987234:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242462336:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 131us (921us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835109.987418:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835109.987851:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835109.988008:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242461952 00000100:00100000:1.0:1788835109.988015:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242461952 00000100:00100000:1.0:1788835109.988066:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 111 00000100:00100000:1.0:1788835109.988141:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242461952:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835109.988187:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242461952:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 113us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835109.988195:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 111 00000100:00080000:1.0:1788835109.988292:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788835109.988334:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242462208 00000100:00100000:1.0:1788835109.988338:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242462208 00000100:00100000:0.0:1788835109.989825:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 300 00000100:00100000:0.0:1788835109.989841:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+14:2386:x1875729242461696:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835109.990239:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+14:2386:x1875729242461696:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 402us (3766us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835109.990273:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 300 00000100:00100000:3.0:1788835109.991161:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 299 00000100:00100000:1.0:1788835109.991476:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 301 00000100:00100000:1.0:1788835109.991490:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2386:x1875729242462208:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835109.991558:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2386:x1875729242462208:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 74us (3708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835109.991566:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 301 00010000:00010000:2.0:1788835110.377501:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835111.205691:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd87f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254062208:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788835111.205785:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835111.205900:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254062208 00000100:00100000:3.0:1788835111.205911:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254062208 00000100:00100000:3.0:1788835111.205968:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1788835111.205978:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254062208:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788835111.206024:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788835111.206093:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90483800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254062208:12345-0@lo:41:osp-pre-1-0.0 Request processed in 116us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835111.206101:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1788835111.206410:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd87f35180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254062208:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835111.207423:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729254062464:0@lo:400:kworker.0 00000100:00100000:1.0:1788835111.207492:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254062720:0@lo:400:kworker.0 00000100:00100000:3.0:1788835111.207503:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835111.207530:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835111.207565:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254063232:0@lo:400:kworker.0 00000100:00100000:1.0:1788835111.207589:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835111.207611:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254063744:0@lo:400:kworker.0 00000100:00100000:1.0:1788835111.207632:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835111.207651:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:1.0:1788835111.207657:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254062592:0@lo:400:kworker.0 00000100:00100000:1.0:1788835111.207681:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835111.207705:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd86629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875729254063104:0@lo:400:kworker.0 00000100:00100000:1.0:1788835111.207726:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835111.207740:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254063616:0@lo:400:kworker.0 00000100:00100000:1.0:1788835111.207758:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835111.207785:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254062720 00000100:00100000:1.0:1788835111.207790:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254062720 00000100:00100000:1.0:1788835111.207829:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788835111.207837:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254062720:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835111.207923:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254062464 00000100:00100000:0.0:1788835111.207929:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254062464 00000100:00100000:2.0:1788835111.207940:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd87f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254062336:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788835111.207964:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 386 00000100:00100000:0.0:1788835111.207972:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3615:x1875729254062464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835111.212128:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254062720:12345-0@lo:400:kworker.0 Request processed in 4282us (4588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835111.212143:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1788835111.212308:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254063232 00000100:00100000:1.0:1788835111.212330:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254063232 00000100:00100000:1.0:1788835111.212380:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254063744 00000100:00100000:1.0:1788835111.212383:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254063744 00000100:00100000:1.0:1788835111.212405:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788835111.212413:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254063232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835111.212469:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254063232:12345-0@lo:400:kworker.0 Request processed in 57us (4878us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835111.212475:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788835111.212487:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788835111.212558:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254063744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835111.212592:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254063744:12345-0@lo:400:kworker.0 Request processed in 99us (4959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835111.212598:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1788835111.212626:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788835111.212630:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788835111.212682:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83c20a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254062720:0@lo:400:kworker.0 00000100:00100000:1.0:1788835111.212694:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83682300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254063232:0@lo:400:kworker.0 00000100:00100000:1.0:1788835111.212704:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ec700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254063744:0@lo:400:kworker.0 00000100:00100000:1.0:1788835111.212829:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254062592 00000100:00100000:1.0:1788835111.212833:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254062592 00000100:00100000:1.0:1788835111.212868:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254063104 00000100:00100000:1.0:1788835111.212872:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254063104 00000100:00100000:1.0:1788835111.212894:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254063616 00000100:00100000:1.0:1788835111.212897:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254063616 00000100:00100000:1.0:1788835111.212913:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788835111.212919:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254062592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835111.212956:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254062592:12345-0@lo:400:kworker.0 Request processed in 38us (5274us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835111.212964:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1788835111.212974:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788835111.212979:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875729254063104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835111.213014:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875729254063104:12345-0@lo:400:kworker.0 Request processed in 35us (5287us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835111.213020:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1788835111.213031:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1788835111.213036:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875729254063616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835111.213062:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875729254063616:12345-0@lo:400:kworker.0 Request processed in 26us (5303us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835111.213067:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00080000:1.0:1788835111.213081:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788835111.213100:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254062592:0@lo:400:kworker.0 00010000:00080000:1.0:1788835111.213123:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afd86629180 x1875729254063104/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835111.213134:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd86629180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875729254063104:0@lo:400:kworker.0 00010000:00080000:1.0:1788835111.213145:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbf9ed880 x1875729254063616/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835111.213153:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ed880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254063616:0@lo:400:kworker.0 00000100:00100000:3.0:1788835111.215126:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd86628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875729254062976:0@lo:400:kworker.0 00000100:00100000:3.0:1788835111.215196:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835111.215280:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254063488:0@lo:400:kworker.0 00000100:00100000:3.0:1788835111.215339:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835111.219087:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835111.219146:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254062336 00000100:00100000:2.0:1788835111.219156:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254062336 00000100:00100000:2.0:1788835111.219360:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1788835111.219370:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254062336:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788835111.219401:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788835111.219445:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254062336:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835111.219452:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00080000:2.0:1788835111.219477:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788835111.219512:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd87f37480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254062336:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788835111.219536:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd8662a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254062848:0@lo:400:kworker.0 00000100:00100000:3.0:1788835111.220384:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254064000:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788835111.220424:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835111.220453:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254064000 00000100:00100000:3.0:1788835111.220458:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254064000 00000100:00100000:3.0:1788835111.220510:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788835111.220525:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254064000:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788835111.220542:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25534144 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788835111.220571:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254064000:12345-0@lo:13:osp-pre-0-1.0 Request processed in 54us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835111.220577:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1788835111.220610:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254064000:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788835111.221744:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3615:x1875729254062464:12345-0@lo:400:kworker.0 Request processed in 13767us (14254us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835111.221756:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 386 00000100:00100000:3.0:1788835111.221926:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729254062464:0@lo:400:kworker.0 00000100:00100000:1.0:1788835111.222628:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254062976 00000100:00100000:1.0:1788835111.222635:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254062976 00000100:00100000:1.0:1788835111.222864:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254063488 00000100:00100000:1.0:1788835111.222868:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254063488 00000100:00100000:1.0:1788835111.222893:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788835111.222900:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875729254062976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835111.222967:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875729254062976:12345-0@lo:400:kworker.0 Request processed in 67us (7770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835111.222973:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1788835111.222996:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1788835111.223002:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729254063488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835111.223028:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729254063488:12345-0@lo:400:kworker.0 Request processed in 27us (7689us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835111.223034:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00080000:3.0:1788835111.223120:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788835111.223153:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd86628700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875729254062976:0@lo:400:kworker.0 00000100:00100000:3.0:1788835111.223165:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254063488:0@lo:400:kworker.0 00000100:00100000:3.0:1788835111.223209:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835111.223260:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254063360:0@lo:400:kworker.0 00000100:00100000:3.0:1788835111.223293:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835111.223339:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254063360 00000100:00100000:3.0:1788835111.223342:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254063360 00000100:00100000:3.0:1788835111.223397:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788835111.223403:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254063360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835111.223433:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254063360:12345-0@lo:400:kworker.0 Request processed in 30us (140us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835111.223439:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1788835111.223466:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254063360:0@lo:400:kworker.0 00000100:00100000:3.0:1788835111.223472:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254063872:0@lo:400:kworker.0 00000100:00100000:3.0:1788835111.223919:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835111.223947:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254063872 00000100:00100000:3.0:1788835111.223951:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254063872 00000100:00100000:3.0:1788835111.223995:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:3.0:1788835111.224003:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254063872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835111.224037:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254063872:12345-0@lo:400:kworker.0 Request processed in 36us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835111.224043:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00080000:3.0:1788835111.224058:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788835111.224077:0:3614:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967313 gen 2 00000004:00080000:3.0:1788835111.224083:0:3614:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afc83ed1f80, transno 4294967311 00000004:00080000:3.0:1788835111.224094:0:3614:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967313 committed transno 4294967313 00000100:00100000:3.0:1788835111.224111:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ec000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254063872:0@lo:400:kworker.0 00000100:00100000:0.0:1788835111.224357:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254062848 00000100:00100000:0.0:1788835111.224361:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254062848 00000100:00100000:0.0:1788835111.224401:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:0.0:1788835111.224408:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254062848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835111.224444:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254062848:12345-0@lo:400:kworker.0 Request processed in 37us (1235us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835111.224449:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:3.0:1788835111.225160:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd8662a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254062848:0@lo:400:kworker.0 00000001:00080000:3.0:1788835111.232379:0:6467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967416 is committed 00000020:00080000:3.0:1788835111.232398:0:6467:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1788835111.232469:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1788835111.232480:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:3.0:1788835111.401465:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835111.717577:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254064128:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788835111.717652:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835111.717760:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254064128 00000100:00100000:1.0:1788835111.717769:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254064128 00000100:00100000:1.0:1788835111.717822:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1788835111.717832:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254064128:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788835111.717867:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788835111.717914:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254064128:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835111.717921:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1788835111.718101:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254064256:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788835111.718139:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835111.718252:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254064256 00000100:00100000:1.0:1788835111.718257:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254064256 00000100:00100000:1.0:1788835111.718281:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1788835111.718287:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254064256:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788835111.718299:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788835111.718349:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254064256:12345-0@lo:13:osp-pre-1-1.0 Request processed in 61us (209us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835111.718355:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1788835111.718430:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254064256:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788835111.718565:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254064128:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1788835111.963695:0:14427:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:38:31 (1788835111) 00010000:00010000:3.0:1788835112.421742:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835112.744474:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788835112.744498:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254064384:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788835112.744573:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835112.745721:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254064384 00000100:00100000:3.0:1788835112.745734:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254064384 00000100:00100000:3.0:1788835112.745796:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1788835112.745807:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254064384:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788835112.745842:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446264832 avail 1300025344 00000100:00100000:3.0:1788835112.745920:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254064384:12345-0@lo:41:osp-pre-0-1.0 Request processed in 115us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835112.745928:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788835112.746038:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83f8f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254064384:0@lo:41:osp-pre-0-1.0 00000040:00080000:1.0:1788835113.381567:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788835113.381578:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788835113.381680:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1788835113.381688:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1788835113.449753:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788835113.575623:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1788835113.704478:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835113.705429:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242462592 00000100:00100000:2.0:1788835113.705441:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242462592 00000100:00100000:2.0:1788835113.705534:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 150 00000100:00100000:2.0:1788835113.705546:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+13:12113:x1875729242462592:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788835113.705570:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835113.705594:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2530 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae06ba expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.706391:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2537 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.706408:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2537 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.706419:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2537 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.706455:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d253e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.706462:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d253e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.706484:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d253e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.706580:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2545 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.706589:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2545 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.706596:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2545 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835113.706606:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00000100:00080000:3.0:1788835113.708308:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1788835113.708719:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2537 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.708735:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2537 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.708742:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2537 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.708749:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374da00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835113.708754:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2537 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.708761:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2537 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.708778:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9afc810b8400) 00010000:00010000:2.0:1788835113.708781:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835113.708804:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2537 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.708810:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2537 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.708827:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d253e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.708833:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d253e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.708839:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d253e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.708845:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835113.708848:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d253e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.708854:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d253e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.708862:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9afdb2e5ee00) 00010000:00010000:2.0:1788835113.708864:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835113.708867:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d253e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.708873:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d253e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.709238:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2530 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06ba expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.709267:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2545 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06ba expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835113.709274:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afc835ccc00) 00010000:00010000:2.0:1788835113.709276:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835113.709278:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374ce00, rc 0) 00000100:00100000:2.0:1788835113.711301:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+15:12113:x1875729242462592:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 5748us (6829us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1788835113.711329:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 150 00000100:00100000:0.0:1788835113.724558:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835113.724616:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835113.724725:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242462848 00000100:00100000:2.0:1788835113.724736:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242462848 00000100:00100000:2.0:1788835113.724813:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 151 00000100:00100000:2.0:1788835113.724824:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+15:12113:x1875729242462848:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788835113.724941:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+15:12113:x1875729242462848:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 Request processed in 119us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835113.724948:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 151 00000100:00100000:1.0:1788835113.726712:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242462720 00000100:00100000:1.0:1788835113.726725:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242462720 00000100:00100000:1.0:1788835113.726803:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:1.0:1788835113.726813:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+15:2387:x1875729242462720:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788835113.726827:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835113.726856:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2545 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06ba expref: 15 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835113.726892:0:9491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afc835ccc00) 00010000:00010000:1.0:1788835113.726897:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788835113.726957:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+14:2387:x1875729242462720:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 146us (2414us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835113.726965:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:0.0:1788835113.730198:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835113.730275:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242462976 00000100:00100000:2.0:1788835113.730284:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242462976 00000100:00100000:2.0:1788835113.730382:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 152 00000100:00100000:2.0:1788835113.730392:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:12113:x1875729242462976:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1788835113.730494:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:12113:x1875729242462976:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 Request processed in 103us (303us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835113.730501:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 152 00000100:00080000:3.0:1788835113.731042:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000040:00080000:1.0:1788835114.405629:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788835114.405639:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788835114.406513:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1788835114.406532:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:3.0:1788835114.472452:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788835114.600505:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788835115.116538:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835115.116651:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835115.116675:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835115.118186:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242463488 00000100:00100000:1.0:1788835115.118198:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242463488 00000100:00100000:1.0:1788835115.118261:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 116 00000100:00100000:1.0:1788835115.118272:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2387:x1875729242463488:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835115.118373:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2387:x1875729242463488:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 103us (1721us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835115.118381:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 116 00000100:00080000:2.0:1788835115.119366:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788835115.120775:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835115.120812:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835115.121212:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242463232 00000100:00100000:3.0:1788835115.121223:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242463232 00000100:00100000:3.0:1788835115.121298:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242463744 00000100:00100000:3.0:1788835115.121301:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242463744 00000100:00100000:3.0:1788835115.121345:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 308 00000100:00100000:3.0:1788835115.121355:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+14:2387:x1875729242463232:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835115.121432:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+14:2387:x1875729242463232:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 78us (4905us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835115.121441:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 308 00000100:00100000:3.0:1788835115.121458:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 309 00000100:00100000:3.0:1788835115.121473:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2387:x1875729242463744:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835115.121583:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2387:x1875729242463744:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 26us (4822us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835115.121591:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 309 00000100:00080000:3.0:1788835115.121697:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788835115.122243:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242463104 00000100:00100000:3.0:1788835115.122249:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242463104 00000100:00100000:3.0:1788835115.122288:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 387 00000100:00100000:3.0:1788835115.122295:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:2387:x1875729242463104:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835115.122354:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:2387:x1875729242463104:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 59us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835115.122361:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 387 00000100:00100000:0.0:1788835115.131382:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835115.131421:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835115.131456:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242463360 00000100:00100000:0.0:1788835115.131466:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242463360 00000100:00100000:0.0:1788835115.131527:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242463872 00000100:00100000:0.0:1788835115.131530:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242463872 00000100:00100000:0.0:1788835115.131554:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 310 00000100:00100000:0.0:1788835115.131562:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+5:2387:x1875729242463360:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835115.131654:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+5:2387:x1875729242463360:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 91us (10841us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835115.131662:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 310 00000100:00100000:0.0:1788835115.131681:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 311 00000100:00100000:0.0:1788835115.131687:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2387:x1875729242463872:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835115.131711:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2387:x1875729242463872:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835115.131717:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 311 00000100:00100000:0.0:1788835115.131736:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242463616 00000100:00100000:0.0:1788835115.131740:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242463616 00000100:00100000:0.0:1788835115.131777:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:0.0:1788835115.131785:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+6:2387:x1875729242463616:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835115.131812:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+6:2387:x1875729242463616:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 30us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835115.131819:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00080000:0.0:1788835115.131978:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788835115.131983:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788835115.493905:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835115.677128:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835115.677230:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242464000 00000100:00100000:1.0:1788835115.677242:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242464000 00000100:00100000:1.0:1788835115.677304:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 153 00000100:00100000:1.0:1788835115.677353:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+14:12155:x1875729242464000:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788835115.677511:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835115.677537:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2553 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae06c1 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677610:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d255a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677634:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d255a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677646:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d255a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677663:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2561 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677670:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2561 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677676:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2561 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677719:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d255a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677726:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d255a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677732:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d255a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677738:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835115.677742:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d255a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677748:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d255a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677759:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afdba168f00) 00010000:00010000:1.0:1788835115.677767:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835115.677772:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d255a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677778:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d255a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677791:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2561 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677797:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2561 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677803:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2561 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677809:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835115.677812:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2561 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677818:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2561 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677826:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9afd93eb1c00) 00010000:00010000:1.0:1788835115.677829:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835115.677831:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2561 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677837:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2561 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677866:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2553 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06c1 expref: 15 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677888:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afdba168f00) 00010000:00010000:1.0:1788835115.677890:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835115.677895:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2553 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06c1 expref: 15 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.677904:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60c00, rc 0) 00000100:00100000:1.0:1788835115.677973:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+14:12155:x1875729242464000:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 660us (856us total) trans 0 rc 301/301 00000100:00100000:1.0:1788835115.677980:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 153 00000100:00100000:1.0:1788835115.695510:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835115.695591:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242464256 00000100:00100000:3.0:1788835115.695601:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242464256 00000100:00100000:3.0:1788835115.695664:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 154 00000100:00100000:3.0:1788835115.695675:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+14:12155:x1875729242464256:12345-192.168.203.22@tcp:36:lfs.0 00010000:00010000:3.0:1788835115.695732:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835115.695758:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d1ea7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04e5 expref: 14 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.695778:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afdba168f00) 00010000:00010000:3.0:1788835115.695783:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788835115.695844:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2568 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.696109:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2529 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06b3 expref: 5 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.696123:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2568 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.696162:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2529 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06b3 expref: 5 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.696178:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2529 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06b3 expref: 5 pid: 6487 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835115.696192:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83f8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1875729254064512:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788835115.696283:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd88ed3cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788835115.714843:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835115.716149:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83f8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1875729254064512:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788835115.716178:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2568 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835115.722603:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242464384 00000100:00100000:0.0:1788835115.722620:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242464384 00010000:00010000:0.0:1788835115.728692:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2529 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06b3 expref: 6 pid: 6487 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835115.728759:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:0.0:1788835115.728772:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2385:x1875729242464384:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788835115.728789:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835115.728797:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2529 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06b3 expref: 6 pid: 6487 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835115.728812:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2529 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06b3 expref: 6 pid: 6487 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835115.728839:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2529 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06b3 expref: 6 pid: 6487 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835115.728857:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afdba168f00) 00010000:00010000:0.0:1788835115.728862:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2568 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835115.728873:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2568 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835115.729166:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2568 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835115.730334:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835115.730414:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2385:x1875729242464384:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 1642us (15578us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835115.730436:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 81 00010000:00010000:2.0:1788835115.731180:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2568 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835115.731194:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2568 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835115.731223:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d256f lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835115.731238:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d256f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835115.731248:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d256f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835115.734951:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2576 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835115.734983:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2576 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835115.734995:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2576 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788835115.735013:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cf028d8 reply state 0000000005c36693 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2576 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835115.735025:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2576 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835115.735033:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:2.0:1788835115.735041:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788835115.735045:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788835115.735052:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:2.0:1788835115.735061:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2568 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835115.735068:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2568 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835115.735075:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2568 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835115.735081:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884ab200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835115.735085:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2568 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835115.735093:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2568 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835115.735104:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afdba168f00) 00010000:00010000:2.0:1788835115.735107:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835115.735110:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2568 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835115.735116:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2568 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788835115.735133:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009cf028d8 reply state 0000000005c36693 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d256f lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835115.735141:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d256f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835115.735156:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9afdb2e5e200) 00010000:00010000:2.0:1788835115.735158:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788835115.735161:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:2.0:1788835115.735267:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+15:12155:x1875729242464256:12345-192.168.203.22@tcp:36:lfs.0 Request processed in 39589us (39895us total) trans 4294967418 rc 0/0 00000100:00100000:2.0:1788835115.735277:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 154 00000100:00100000:2.0:1788835115.829554:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835115.837891:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242464512 00000100:00100000:1.0:1788835115.837905:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242464512 00000100:00100000:1.0:1788835115.837999:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 155 00000100:00100000:1.0:1788835115.838011:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+15:12163:x1875729242464512:12345-192.168.203.22@tcp:101:lctl.0 00010000:00010000:1.0:1788835115.838040:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835115.838064:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d257d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae06c8 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.838135:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2584 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.838151:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.838163:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835115.838239:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788835115.838243:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835115.838266:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2584 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.838290:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d257d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06c8 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.838310:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2584 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06c8 expref: 16 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.838403:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afd93eb1c00) 00010000:00010000:1.0:1788835115.838406:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788835115.838410:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60600, rc 0) 00000100:00100000:1.0:1788835115.838482:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+16:12163:x1875729242464512:12345-192.168.203.22@tcp:101:lctl.0 Request processed in 473us (8938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835115.838490:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 155 00000100:00100000:0.0:1788835115.929473:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835115.930860:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242464640 00000100:00100000:3.0:1788835115.930882:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242464640 00000100:00100000:3.0:1788835115.931122:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 156 00000100:00100000:3.0:1788835115.931137:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+16:12169:x1875729242464640:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1788835115.931166:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835115.931204:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa600/0xdf60171e5a5d258b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae06cf expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931292:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d2592 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931374:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d2592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931389:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d2592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931404:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2599 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931412:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931419:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931529:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa800/0xdf60171e5a5d25a0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931538:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa800/0xdf60171e5a5d25a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931545:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa800/0xdf60171e5a5d25a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835115.931601:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788835115.931606:0:9047:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788835115.931649:0:9047:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa800/0xdf60171e5a5d25a0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931665:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d2592 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931682:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d2592 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931689:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d2592 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931696:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884ab600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835115.931701:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d2592 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931710:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d2592 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931725:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afd93eb1c00) 00010000:00010000:3.0:1788835115.931728:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835115.931734:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d2592 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931741:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d2592 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931757:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2599 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931762:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2599 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931768:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2599 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931773:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aac00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835115.931783:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2599 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931790:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2599 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931798:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9afdb2e5e200) 00010000:00010000:3.0:1788835115.931801:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835115.931804:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2599 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931811:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2599 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931846:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa600/0xdf60171e5a5d258b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06cf expref: 18 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931860:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa800/0xdf60171e5a5d25a0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06cf expref: 17 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.931868:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:3.0:1788835115.931871:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1788835115.931873:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884aa800, rc 0) 00000100:00100000:3.0:1788835115.931999:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+17:12169:x1875729242464640:12345-192.168.203.22@tcp:101:bash.0 Request processed in 865us (2539us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835115.932007:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 156 00000100:00100000:2.0:1788835115.951566:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835115.951969:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242464896 00000100:00100000:3.0:1788835115.951983:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242464896 00000100:00100000:3.0:1788835115.952068:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 157 00000100:00100000:3.0:1788835115.952080:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+17:12169:x1875729242464896:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1788835115.952128:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835115.952157:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa600/0xdf60171e5a5d25a7 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae06d6 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.952307:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d25ae lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.952375:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d25ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.952389:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d25ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.952409:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d25b5 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.952416:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d25b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.952423:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d25b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788835115.952894:0:6489:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x4:0x0], index 0: 0 00010000:00010000:3.0:1788835115.953077:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d25bc lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.953088:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d25bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.953097:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d25bc lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.953155:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d25ae lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.953164:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d25ae lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.953171:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d25ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.953179:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aac00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835115.953184:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d25ae lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.953193:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d25ae lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.953208:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:3.0:1788835115.953212:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835115.953217:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d25ae lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.953224:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d25ae lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788835115.953239:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026b31282 reply state 00000000c3a0d058 transno 4294967419 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d25b5 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.953251:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d25b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.953258:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afdb2e6e800) 00010000:00010000:3.0:1788835115.953266:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788835115.953270:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1788835115.953311:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa600/0xdf60171e5a5d25a7 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06d6 expref: 20 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.953376:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d25bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06d6 expref: 19 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.953383:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e6ec00) 00010000:00010000:3.0:1788835115.953386:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788835115.953388:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884abe00, rc 0) 00000100:00100000:3.0:1788835115.953500:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+20:12169:x1875729242464896:12345-192.168.203.22@tcp:101:bash.0 Request processed in 1422us (1949us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1788835115.953509:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 157 00000100:00100000:2.0:1788835115.959164:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835115.959276:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242465024 00000100:00100000:1.0:1788835115.959290:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242465024 00000100:00100000:1.0:1788835115.959414:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:1.0:1788835115.959427:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2385:x1875729242465024:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1788835115.959452:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835115.959476:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0fa15a3/0xdf60171e5a5d25ca lrc: 2/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae06dd expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788835115.959509:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788835115.959535:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=358s v=(0 0) 00010000:00010000:1.0:1788835115.959557:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835115.959570:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0fa15a3/0xdf60171e5a5d25ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06dd expref: 6 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.959596:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f0fa15a3/0xdf60171e5a5d25ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06dd expref: 6 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835115.959614:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60c00, rc 0) 00000100:00100000:1.0:1788835115.959710:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+6:2385:x1875729242465024:12345-192.168.203.22@tcp:101:bash.0 Request processed in 285us (563us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835115.959719:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:2.0:1788835115.966814:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835115.967052:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242465152 00000100:00100000:3.0:1788835115.967066:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242465152 00000100:00100000:3.0:1788835115.967158:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:3.0:1788835115.967170:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+6:12169:x1875729242465152:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1788835115.967195:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835115.967220:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d764058/0xdf60171e5a5d25d1 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae06e4 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.967266:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0fa15a3/0xdf60171e5a5d25ca lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06dd expref: 7 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.967276:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835115.967282:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835115.967288:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d764058/0xdf60171e5a5d25d1 lrc: 4/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06e4 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.967403:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f0fa15a3/0xdf60171e5a5d25ca lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06dd expref: 7 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.967420:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f0fa15a3/0xdf60171e5a5d25ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06dd expref: 7 pid: 8402 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835115.967439:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83f8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8403:1875729254064640:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788835115.967564:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda10bd600 going to sleep for 11 seconds 00000100:00100000:2.0:1788835115.972557:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835115.973649:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242465280 00000100:00100000:0.0:1788835115.973666:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242465280 00010000:00010000:0.0:1788835115.973736:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f0fa15a3/0xdf60171e5a5d25ca lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06dd expref: 8 pid: 8402 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835115.973793:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:0.0:1788835115.973805:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+8:2386:x1875729242465280:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788835115.973825:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835115.973856:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f0fa15a3/0xdf60171e5a5d25ca lrc: 5/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06dd expref: 8 pid: 8402 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835115.973872:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f0fa15a3/0xdf60171e5a5d25ca lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06dd expref: 8 pid: 8402 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835115.973919:0:7430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835115.973925:0:7430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835115.973936:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000008d764058/0xdf60171e5a5d25d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06e4 expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835115.973947:0:7430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d764058/0xdf60171e5a5d25d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06e4 expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835115.974010:0:7430:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000008d764058/0xdf60171e5a5d25d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06e4 expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835115.974061:0:7430:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba3e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7430:1875729254064768:192.168.203.22@tcp:105: 00000100:00100000:0.0:1788835115.974173:0:7430:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd83e4ec00 going to sleep for 11 seconds 00010000:00010000:3.0:1788835115.974895:0:8403:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0fa15a3/0xdf60171e5a5d25ca lrc: 0/0,0 mode: --/PR res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06dd expref: 8 pid: 8402 timeout: 458 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835115.974930:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83f8c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:8403:1875729254064640:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788835115.974979:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008d764058/0xdf60171e5a5d25d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06e4 expref: 7 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835115.974993:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884aa600, rc 0) 00000100:00100000:3.0:1788835115.975052:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+7:12169:x1875729242465152:12345-192.168.203.22@tcp:101:bash.0 Request processed in 7883us (8258us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835115.975060:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:0.0:1788835115.983167:0:7430:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba3e1500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0000_UUID:7430:1875729254064768:192.168.203.22@tcp:105: 00010000:00010000:0.0:1788835115.983207:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835115.983286:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+6:2386:x1875729242465280:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 9482us (10752us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835115.983300:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:2.0:1788835115.990290:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835115.990450:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242465536 00000100:00100000:3.0:1788835115.990466:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242465536 00000100:00100000:3.0:1788835115.990538:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:3.0:1788835115.990553:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+20:12169:x1875729242465536:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:3.0:1788835115.991021:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+21:12169:x1875729242465536:12345-192.168.203.22@tcp:35:bash.0 Request processed in 470us (750us total) trans 4294967420 rc 0/0 00000100:00100000:3.0:1788835115.991032:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:2.0:1788835116.055122:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835116.055488:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242465792 00000100:00100000:1.0:1788835116.055503:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242465792 00000100:00100000:1.0:1788835116.055604:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 158 00000100:00100000:1.0:1788835116.055616:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+21:12179:x1875729242465792:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788835116.055649:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835116.055794:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d25d8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae06eb expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835116.055942:0:9806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788835116.056100:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d25d8 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06eb expref: 23 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.056118:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afd93eb1c00) 00010000:00010000:1.0:1788835116.056122:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788835116.056127:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d25d8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06eb expref: 23 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.056167:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60800, rc 0) 00000100:00100000:1.0:1788835116.056290:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+22:12179:x1875729242465792:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 676us (1187us total) trans 4294967421 rc 301/301 00000100:00100000:1.0:1788835116.056299:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 158 00000100:00100000:0.0:1788835116.074495:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835116.074597:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242466048 00000100:00100000:3.0:1788835116.074613:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242466048 00000100:00100000:3.0:1788835116.074693:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:3.0:1788835116.074705:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+22:12179:x1875729242466048:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1788835116.075071:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+23:12179:x1875729242466048:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 365us (590us total) trans 4294967422 rc 0/0 00000100:00100000:3.0:1788835116.075080:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:2.0:1788835116.194817:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835116.194914:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242466176 00000100:00100000:3.0:1788835116.194927:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242466176 00000100:00100000:3.0:1788835116.195004:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 159 00000100:00100000:3.0:1788835116.195024:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+23:12185:x1875729242466176:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788835116.195049:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835116.195072:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d25e6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae06f2 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.195150:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa000/0xdf60171e5a5d25ed lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.195166:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa000/0xdf60171e5a5d25ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.195180:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa000/0xdf60171e5a5d25ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835116.195230:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:3.0:1788835116.195248:0:9047:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788835116.195273:0:9047:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa000/0xdf60171e5a5d25ed lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.195304:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d25e6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06f2 expref: 25 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.195356:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa000/0xdf60171e5a5d25ed lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06f2 expref: 24 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.195365:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:3.0:1788835116.195367:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1788835116.195371:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884aa000, rc 0) 00000100:00100000:3.0:1788835116.195430:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+24:12185:x1875729242466176:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 417us (624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835116.195436:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 159 00000100:00100000:2.0:1788835116.199384:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835116.199487:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242466432 00000100:00100000:1.0:1788835116.199496:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242466432 00000100:00100000:1.0:1788835116.199559:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 160 00000100:00100000:1.0:1788835116.199570:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+24:12185:x1875729242466432:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788835116.199590:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835116.199611:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d25f4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae06f9 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.199711:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d25fb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.199724:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d25fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.199736:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d25fb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835116.199746:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788835116.199845:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d25f4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06f9 expref: 27 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.199862:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d25fb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06f9 expref: 26 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.199888:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e6ec00) 00010000:00010000:1.0:1788835116.199890:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788835116.199894:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61e00, rc 0) 00000100:00100000:1.0:1788835116.199971:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+26:12185:x1875729242466432:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 402us (596us total) trans 4294967423 rc 0/0 00000100:00100000:1.0:1788835116.199978:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 160 00000100:00100000:0.0:1788835116.203085:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835116.203170:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242466688 00000100:00100000:1.0:1788835116.203180:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242466688 00000100:00100000:1.0:1788835116.203237:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 161 00000100:00100000:1.0:1788835116.203246:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+26:12185:x1875729242466688:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788835116.203269:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835116.203289:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2609 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0700 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.203407:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2610 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.203422:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2610 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.203433:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2610 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835116.203445:0:9806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:1.0:1788835116.203543:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2609 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0700 expref: 29 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.203575:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2610 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0700 expref: 28 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.203584:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e6ec00) 00010000:00010000:1.0:1788835116.203587:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1788835116.203591:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61200, rc 0) 00000100:00100000:1.0:1788835116.203652:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+28:12185:x1875729242466688:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 407us (577us total) trans 4294967424 rc 0/0 00000100:00100000:1.0:1788835116.203659:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 161 00000100:00100000:3.0:1788835116.206708:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835116.206844:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242466816 00000100:00100000:2.0:1788835116.206853:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242466816 00000100:00100000:2.0:1788835116.206922:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:2.0:1788835116.206932:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+28:2385:x1875729242466816:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835116.206948:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835116.206980:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d25fb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06f9 expref: 28 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.206999:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e6ec00) 00010000:00010000:2.0:1788835116.207004:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835116.207068:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+27:2385:x1875729242466816:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 137us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835116.207090:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:2.0:1788835116.211754:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835116.211823:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242466944 00000100:00100000:1.0:1788835116.211833:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242466944 00000100:00100000:1.0:1788835116.211890:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:1.0:1788835116.211900:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+6:2387:x1875729242466944:12345-192.168.203.22@tcp:1:lfs.0 00010000:00010000:1.0:1788835116.211961:0:8402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d261e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.211981:0:8402:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008d764058/0xdf60171e5a5d25d1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06e4 expref: 6 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.211990:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835116.211994:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788835116.211999:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d261e lrc: 4/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.212046:0:8402:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008d764058/0xdf60171e5a5d25d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06e4 expref: 6 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.212074:0:8402:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008d764058/0xdf60171e5a5d25d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06e4 expref: 6 pid: 8403 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835116.212089:0:8402:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8402:1875729254064896:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788835116.212189:0:8402:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eac900 going to sleep for 11 seconds 00000100:00100000:0.0:1788835116.217398:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835116.217623:0:8402:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:8402:1875729254064896:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788835116.217651:0:8402:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d261e lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835116.217823:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242467072 00000100:00100000:3.0:1788835116.217830:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242467072 00002000:00100000:3.0:1788835116.217876:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9afdbfb91c00 x1875729242467072/t0(0) o4->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:37/0 lens 504/0 e 0 to 0 dl 1788835127 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788835116.217886:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afdbfb91c00 with x1875729242467072 ext(0->12) 00010000:00010000:3.0:1788835116.217894:0:8410:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008d764058/0xdf60171e5a5d25d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06e4 expref: 7 pid: 8403 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.217921:0:8410:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008d764058/0xdf60171e5a5d25d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06e4 expref: 7 pid: 8403 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788835116.217948:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9afdbfb91c00 00000100:00100000:3.0:1788835116.217991:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:3.0:1788835116.218000:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b8987b33-76f7-43a0-9448-1013c4af787f+7:2386:x1875729242467072:12345-192.168.203.22@tcp:4:lfs.0 00000100:00100000:3.0:1788835116.218999:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b8987b33-76f7-43a0-9448-1013c4af787f+9:2386:x1875729242467072:12345-192.168.203.22@tcp:4:lfs.0 Request processed in 993us (1605us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1788835116.219020:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00002000:00100000:3.0:1788835116.219029:0:8410:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x280000401:0x4:0x0] (0->12) req@ffff9afdbfb91c00 x1875729242467072/t4294967306(0) o4->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:37/0 lens 504/448 e 0 to 0 dl 1788835127 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788835116.219038:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afdbfb91c00 with x1875729242467072 ext(0->12) 00010000:00010000:3.0:1788835116.219047:0:8410:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000008d764058/0xdf60171e5a5d25d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06e4 expref: 9 pid: 8403 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.219062:0:8410:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000008d764058/0xdf60171e5a5d25d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06e4 expref: 9 pid: 8403 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788835116.219069:0:8410:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9afdbfb91c00 00000100:00100000:2.0:1788835116.221450:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835116.221539:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242467200 00000100:00100000:0.0:1788835116.221549:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242467200 00010000:00010000:0.0:1788835116.221589:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008d764058/0xdf60171e5a5d25d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06e4 expref: 9 pid: 8403 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835116.221634:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:0.0:1788835116.221643:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+9:2388:x1875729242467200:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788835116.221658:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788835116.221675:0:6474:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788835116.221679:0:6474:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb mtime from disk: 0 -> 1788835117 00002000:00010000:0.0:1788835116.221681:0:6474:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb atime from disk: 0 -> 1788835117 00002000:00010000:0.0:1788835116.221683:0:6474:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb ctime from disk: 0 -> 1788835117 00002000:00010000:0.0:1788835116.221686:0:6474:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x4:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788835116.221691:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008d764058/0xdf60171e5a5d25d1 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06e4 expref: 9 pid: 8403 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835116.221717:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008d764058/0xdf60171e5a5d25d1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06e4 expref: 9 pid: 8403 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835116.221737:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d764058/0xdf60171e5a5d25d1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06e4 expref: 9 pid: 8403 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835116.221754:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788835116.221758:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788835116.221763:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d261e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835116.221772:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d261e lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835116.221804:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835116.221863:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+8:2388:x1875729242467200:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 220us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835116.221871:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 83 00010000:00010000:1.0:1788835116.221942:0:8402:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d261e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.221960:0:8402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d261e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.221980:0:8402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d261e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.221988:0:8402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d261e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.221996:0:8402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d261e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.222027:0:8402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61000 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:1.0:1788835116.222032:0:8402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d261e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.222041:0:8402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d261e lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.222054:0:8402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d261e lrc: 2/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.222062:0:8402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d261e lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835116.222110:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+7:2387:x1875729242466944:12345-192.168.203.22@tcp:1:lfs.0 Request processed in 10212us (10364us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835116.222117:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:2.0:1788835116.224777:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835116.224858:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242467456 00000100:00100000:1.0:1788835116.224868:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242467456 00000100:00100000:1.0:1788835116.224927:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:1.0:1788835116.224936:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84e64c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+27:12185:x1875729242467456:12345-192.168.203.22@tcp:35:lfs.0 00000004:00010000:1.0:1788835116.225011:0:6490:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2610 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0700 expref: 27 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788835116.225212:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:1.0:1788835116.225577:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:1.0:1788835116.225898:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00010000:00010000:1.0:1788835116.225931:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2625 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.225945:0:6490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d25bc lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06d6 expref: 31 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.225964:0:6490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2625 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.225995:0:6490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d25bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06d6 expref: 31 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.226010:0:6490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d25bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06d6 expref: 31 pid: 6489 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835116.226133:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efe300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6490:1875729254065024:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788835116.226225:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eacb40 going to sleep for 11 seconds 00000100:00100000:3.0:1788835116.228986:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835116.229121:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efe300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:6490:1875729254065024:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788835116.229146:0:6490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2625 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835116.229283:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242467584 00000100:00100000:2.0:1788835116.229290:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242467584 00010000:00010000:2.0:1788835116.229364:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d25bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06d6 expref: 32 pid: 6489 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835116.229406:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 84 00000100:00100000:2.0:1788835116.229415:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+32:2385:x1875729242467584:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835116.229431:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835116.229438:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d25bc lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06d6 expref: 32 pid: 6489 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.229449:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d25bc lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06d6 expref: 32 pid: 6489 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.229470:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d25bc lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06d6 expref: 32 pid: 6489 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.229485:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e6ec00) 00010000:00010000:2.0:1788835116.229490:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2625 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.229499:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2625 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.229525:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2625 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.229554:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835116.229612:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+31:2385:x1875729242467584:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 197us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835116.229619:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 84 00010000:00010000:1.0:1788835116.229908:0:6490:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2625 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.229917:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2625 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788835116.230037:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000001:00080000:1.0:1788835116.230161:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:1.0:1788835116.230267:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efe300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6490:1875729254065152:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788835116.230346:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835116.230380:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eac780 going to sleep for 11 seconds 00000100:00100000:0.0:1788835116.230442:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254065152 00000100:00100000:0.0:1788835116.230448:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254065152 00000100:00100000:0.0:1788835116.230500:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788835116.230508:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6490:x1875729254065152:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788835116.230583:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6490:x1875729254065152:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 76us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835116.230591:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:1.0:1788835116.231020:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788835116.231054:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efe300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6490:1875729254065152:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1788835116.231180:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00000100:00100000:1.0:1788835116.231223:0:6490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efe300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6490:1875729254065280:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1788835116.231268:0:6490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835116.231295:0:6490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eac900 going to sleep for 11 seconds 00000100:00100000:0.0:1788835116.231393:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254065280 00000100:00100000:0.0:1788835116.231398:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254065280 00000100:00100000:0.0:1788835116.231427:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1788835116.231434:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6490:x1875729254065280:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1788835116.231540:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6490:x1875729254065280:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 106us (271us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1788835116.231547:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1788835116.231763:0:6490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efe300 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:6490:1875729254065280:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1788835116.231803:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1788835116.231837:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2625 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.231847:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2625 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.231854:0:6490:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2625 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.231862:0:6490:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835116.231866:0:6490:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2625 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.231873:0:6490:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2625 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.231889:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e6ec00) 00010000:00010000:2.0:1788835116.231892:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1788835116.231896:0:6490:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2625 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.231926:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2625 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788835116.232029:0:6490:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1788835116.232088:0:6490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1788835116.232098:0:6490:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 358273782683ns, next at 359273780681ns, rc = 0 00000001:00080000:2.0:1788835116.232106:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967432 00010000:00010000:2.0:1788835116.232128:0:6490:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e6ec00) 00010000:00010000:2.0:1788835116.232131:0:6490:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788835116.232137:0:6490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2610 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0700 expref: 35 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835116.232289:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84e64c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+34:12185:x1875729242467456:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 7353us (7519us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1788835116.232297:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 38 00000020:00080000:2.0:1788835116.232301:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1788835116.235977:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835116.236059:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242467712 00000100:00100000:2.0:1788835116.236068:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242467712 00000100:00100000:2.0:1788835116.236133:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 162 00000100:00100000:2.0:1788835116.236142:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+34:12185:x1875729242467712:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788835116.236165:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835116.236188:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d262c lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0707 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.236252:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d262c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0707 expref: 35 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.236288:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d262c lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0707 expref: 35 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.236309:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:2.0:1788835116.236350:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788835116.236355:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374dc00, rc 0) 00000100:00100000:2.0:1788835116.236412:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+35:12185:x1875729242467712:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 270us (445us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835116.236420:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 162 00000100:00100000:3.0:1788835116.239239:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835116.239375:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242467968 00000100:00100000:1.0:1788835116.239387:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242467968 00000100:00100000:1.0:1788835116.239449:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:1.0:1788835116.239461:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+35:12185:x1875729242467968:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1788835116.239698:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+36:12185:x1875729242467968:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 239us (470us total) trans 4294967434 rc 0/0 00000100:00100000:1.0:1788835116.239706:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:3.0:1788835116.325724:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788835116.325747:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254065408:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788835116.325815:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835116.325888:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254065408 00000100:00100000:3.0:1788835116.325895:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254065408 00000100:00100000:3.0:1788835116.326153:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788835116.326162:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729254065408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788835116.326186:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788835116.326238:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729254065408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835116.326246:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1788835116.326294:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254065408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788835116.326611:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254065536:0@lo:400:kworker.0 00000100:00100000:0.0:1788835116.326648:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835116.326673:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254066048:0@lo:400:kworker.0 00000100:00100000:0.0:1788835116.326697:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835116.326715:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875729254066560:0@lo:400:kworker.0 00000100:00100000:0.0:1788835116.326738:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835116.326758:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788835116.326764:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254065664:0@lo:400:kworker.0 00000100:00100000:0.0:1788835116.326784:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835116.326799:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729254066176:0@lo:400:kworker.0 00000100:00100000:0.0:1788835116.326818:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835116.326832:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254066688:0@lo:400:kworker.0 00000100:00100000:0.0:1788835116.326865:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835116.326898:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254065536 00000100:00100000:0.0:1788835116.326902:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254065536 00000100:00100000:0.0:1788835116.326948:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788835116.326967:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254065536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835116.327005:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254065536:12345-0@lo:400:kworker.0 Request processed in 40us (356us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835116.327146:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 388 00000100:00100000:0.0:1788835116.327182:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254065920:0@lo:400:kworker.0 00000100:00100000:0.0:1788835116.327207:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835116.327222:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254066432:0@lo:400:kworker.0 00000100:00100000:0.0:1788835116.327241:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835116.327257:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254066944:0@lo:400:kworker.0 00000100:00100000:0.0:1788835116.327277:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835116.327292:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788835116.327298:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254065792:0@lo:400:kworker.0 00000100:00100000:0.0:1788835116.327346:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835116.327365:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729254066304:0@lo:400:kworker.0 00000100:00100000:0.0:1788835116.327385:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835116.327396:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254066816:0@lo:400:kworker.0 00000100:00100000:0.0:1788835116.327430:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835116.327458:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254066560 00000100:00100000:0.0:1788835116.327462:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254066560 00000100:00100000:0.0:1788835116.327489:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254065664 00000100:00100000:0.0:1788835116.327492:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254065664 00000100:00100000:0.0:1788835116.327503:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254066176 00000100:00100000:0.0:1788835116.327505:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254066176 00000100:00100000:0.0:1788835116.327516:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788835116.327522:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875729254066560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835116.327555:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875729254066560:12345-0@lo:400:kworker.0 Request processed in 33us (815us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835116.327561:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1788835116.327581:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254066688 00000100:00100000:0.0:1788835116.327585:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254066688 00000100:00100000:0.0:1788835116.327598:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254065920 00000100:00100000:0.0:1788835116.327601:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254065920 00000100:00100000:0.0:1788835116.327610:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254066304 00000100:00100000:0.0:1788835116.327613:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254066304 00000100:00100000:0.0:1788835116.327625:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788835116.327630:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254065664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835116.327658:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254065664:12345-0@lo:400:kworker.0 Request processed in 28us (873us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835116.327663:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 313 00000100:00100000:0.0:1788835116.327673:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788835116.327678:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729254066176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835116.327703:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729254066176:12345-0@lo:400:kworker.0 Request processed in 25us (884us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835116.327709:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1788835116.327720:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788835116.327726:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254066688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835116.327753:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254066688:12345-0@lo:400:kworker.0 Request processed in 28us (888us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835116.327759:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 315 00000100:00100000:0.0:1788835116.327770:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788835116.327776:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254065920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835116.327805:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254065920:12345-0@lo:400:kworker.0 Request processed in 30us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835116.327811:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:0.0:1788835116.327822:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788835116.327835:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729254066304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835116.327864:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb97800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729254066304:12345-0@lo:400:kworker.0 Request processed in 29us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835116.327869:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 317 00000100:00100000:0.0:1788835116.327887:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254066048 00000100:00100000:0.0:1788835116.327890:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254066048 00000100:00080000:1.0:1788835116.328171:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788835116.328177:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788835116.328187:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254066432 00000100:00100000:1.0:1788835116.328191:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254066432 00000100:00100000:1.0:1788835116.328224:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254066944 00000100:00100000:1.0:1788835116.328227:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254066944 00000100:00100000:1.0:1788835116.328240:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254066816 00000100:00100000:1.0:1788835116.328243:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254066816 00000100:00100000:1.0:1788835116.328257:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788835116.328264:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254066432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835116.328335:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254066432:12345-0@lo:400:kworker.0 Request processed in 72us (1092us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835116.328349:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1788835116.328363:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788835116.328369:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254066944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835116.328399:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb96a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254066944:12345-0@lo:400:kworker.0 Request processed in 30us (1120us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835116.328405:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:1.0:1788835116.328415:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1788835116.328422:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254066816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835116.328448:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb96680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254066816:12345-0@lo:400:kworker.0 Request processed in 27us (1018us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835116.328454:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00080000:1.0:1788835116.328468:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1788835116.328471:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788835116.328544:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb91f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254065664:0@lo:400:kworker.0 00000100:00100000:1.0:1788835116.328558:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729254066176:0@lo:400:kworker.0 00010000:00080000:1.0:1788835116.328571:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfb91500 x1875729254066688/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835116.328582:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254066688:0@lo:400:kworker.0 00000100:00100000:1.0:1788835116.328594:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254065536:0@lo:400:kworker.0 00000100:00100000:1.0:1788835116.328604:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875729254066560:0@lo:400:kworker.0 00010000:00080000:1.0:1788835116.328652:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfb91880 x1875729254066304/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835116.328661:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729254066304:0@lo:400:kworker.0 00000100:00100000:1.0:1788835116.328684:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254066816:0@lo:400:kworker.0 00000100:00100000:1.0:1788835116.328693:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb91180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254065920:0@lo:400:kworker.0 00000100:00100000:1.0:1788835116.328702:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254066432:0@lo:400:kworker.0 00000100:00100000:1.0:1788835116.328711:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254066944:0@lo:400:kworker.0 00000100:00100000:3.0:1788835116.329378:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788835116.329393:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254067072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835116.329442:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835116.329486:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254065792 00000100:00100000:3.0:1788835116.329492:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254065792 00000100:00100000:3.0:1788835116.329517:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254067072 00000100:00100000:3.0:1788835116.329520:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254067072 00000100:00100000:3.0:1788835116.329533:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788835116.329540:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254065792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835116.329587:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb95180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254065792:12345-0@lo:400:kworker.0 Request processed in 46us (2239us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835116.329593:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1788835116.329607:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788835116.329613:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1875729254067072:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788835116.329639:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788835116.329673:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:3617:x1875729254067072:12345-0@lo:41:osp-pre-1-0.0 Request processed in 60us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835116.329680:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1788835116.329716:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254067072:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835116.329762:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254065792:0@lo:400:kworker.0 00000100:00100000:1.0:1788835116.330192:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1788835116.330201:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254066048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835116.330711:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835116.330739:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242468224 00000100:00100000:3.0:1788835116.330745:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242468224 00000100:00100000:3.0:1788835116.330776:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 163 00000100:00100000:3.0:1788835116.330783:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+36:12195:x1875729242468224:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788835116.330798:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835116.330817:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d2633 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae070e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835116.331055:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254066048:12345-0@lo:400:kworker.0 Request processed in 854us (4355us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835116.331064:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000004:00200000:3.0:1788835116.331158:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:3.0:1788835116.331251:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d2633 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae070e expref: 38 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.331265:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afd93eb1c00) 00010000:00010000:3.0:1788835116.331267:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788835116.331272:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d2633 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae070e expref: 38 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.331284:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884ab400, rc 0) 00000100:00100000:3.0:1788835116.331371:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+37:12195:x1875729242468224:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 587us (661us total) trans 4294967435 rc 301/301 00000100:00100000:3.0:1788835116.331377:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 163 00000100:00100000:3.0:1788835116.331991:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254067200:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788835116.332046:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835116.332170:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254067200 00000100:00100000:2.0:1788835116.332177:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254067200 00000100:00100000:2.0:1788835116.332218:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1788835116.332226:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254067200:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788835116.332245:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 33971904 pending 28672 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788835116.332297:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254067200:12345-0@lo:13:osp-pre-0-1.0 Request processed in 71us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835116.332311:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1788835116.332444:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83fb6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254067200:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788835116.332640:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254066048:0@lo:400:kworker.0 00000100:00100000:3.0:1788835116.335639:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835116.335739:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242468352 00000100:00100000:1.0:1788835116.335748:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242468352 00000100:00100000:1.0:1788835116.335806:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 164 00000100:00100000:1.0:1788835116.335816:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+37:12195:x1875729242468352:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:1.0:1788835116.335898:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2641 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.335921:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2641 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.335932:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2641 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.335961:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2648 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.335979:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2648 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.335985:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2648 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336067:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d264f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336076:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d264f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336082:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d264f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788835116.336129:0:9806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d264f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336143:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2641 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336150:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2641 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336156:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2641 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336163:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835116.336167:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2641 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336174:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2641 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336194:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:1.0:1788835116.336197:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835116.336201:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2641 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336207:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2641 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336220:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2648 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336225:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2648 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336231:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2648 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336235:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835116.336237:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2648 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336243:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2648 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336250:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afdb2e6e800) 00010000:00010000:1.0:1788835116.336252:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835116.336255:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2648 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336260:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d2648 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336276:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d264f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336281:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d264f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336287:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d264f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336291:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835116.336293:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d264f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336298:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d264f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336303:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:1.0:1788835116.336305:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835116.336307:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d264f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.336730:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d264f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835116.336813:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+37:12195:x1875729242468352:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 997us (1180us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835116.336822:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 164 00000100:00100000:3.0:1788835116.341176:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835116.341445:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242468608 00000100:00100000:1.0:1788835116.341454:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242468608 00000100:00100000:1.0:1788835116.341507:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:1.0:1788835116.341525:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+37:12195:x1875729242468608:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1788835116.341723:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+38:12195:x1875729242468608:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 199us (557us total) trans 4294967436 rc 0/0 00000100:00100000:1.0:1788835116.341729:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:0.0:1788835116.378462:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835116.378558:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242468864 00000100:00100000:3.0:1788835116.378567:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242468864 00000100:00100000:3.0:1788835116.378632:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 165 00000100:00100000:3.0:1788835116.378643:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+38:12198:x1875729242468864:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788835116.378669:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835116.378690:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d2656 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0715 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.378768:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d265d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.378783:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d265d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.378795:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d265d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.378806:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2664 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.378813:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2664 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.378820:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2664 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.378965:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d266b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.378974:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d266b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.378999:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d266b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835116.379010:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:3.0:1788835116.379088:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d265d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.379096:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d265d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.379103:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d265d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.379108:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aac00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835116.379113:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d265d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.379121:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d265d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.379133:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:3.0:1788835116.379136:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835116.379140:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d265d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.379146:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d265d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.379158:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2664 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.379164:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2664 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.379177:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2664 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.379182:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aba00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835116.379185:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2664 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.379191:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2664 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.379199:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afdb2e6e800) 00010000:00010000:3.0:1788835116.379201:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835116.379204:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2664 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.379210:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2664 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.379849:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d2656 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0715 expref: 41 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.379869:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d266b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0715 expref: 40 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.379878:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:3.0:1788835116.379881:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788835116.379884:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884abe00, rc 0) 00000100:00100000:3.0:1788835116.379985:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+40:12198:x1875729242468864:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1343us (1536us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1788835116.380004:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 165 00000100:00100000:3.0:1788835116.383820:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835116.383936:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242468992 00000100:00100000:0.0:1788835116.383959:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242468992 00000100:00100000:0.0:1788835116.384034:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 166 00000100:00100000:0.0:1788835116.384044:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+40:12198:x1875729242468992:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:0.0:1788835116.384112:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2679 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835116.384130:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2679 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835116.384142:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2679 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835116.384181:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2679 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835116.384188:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2679 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835116.384195:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2679 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835116.384219:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835116.384224:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2679 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835116.384232:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2679 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835116.384248:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:0.0:1788835116.384251:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788835116.384255:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2679 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835116.384261:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2679 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835116.384366:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+40:12198:x1875729242468992:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 324us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835116.384372:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 166 00000100:00100000:0.0:1788835116.386579:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835116.386680:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242469248 00000100:00100000:1.0:1788835116.386689:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242469248 00000100:00100000:1.0:1788835116.386787:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:1.0:1788835116.386798:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+40:12198:x1875729242469248:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1788835116.387109:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+41:12198:x1875729242469248:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 311us (536us total) trans 4294967438 rc 0/0 00000100:00100000:1.0:1788835116.387117:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 41 00010000:00010000:2.0:1788835116.518053:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835116.610679:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835116.611013:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242469504 00000100:00100000:2.0:1788835116.611023:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242469504 00000100:00100000:2.0:1788835116.611087:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 167 00000100:00100000:2.0:1788835116.611099:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+41:12229:x1875729242469504:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:2.0:1788835116.611128:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835116.611152:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2680 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae071c expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.611284:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2687 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.611298:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.611310:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2687 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835116.611350:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:2.0:1788835116.611451:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2680 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae071c expref: 44 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.611469:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2687 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae071c expref: 43 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.611477:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:2.0:1788835116.611480:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788835116.611483:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374d000, rc 0) 00000100:00100000:2.0:1788835116.611544:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+43:12229:x1875729242469504:12345-192.168.203.22@tcp:101:cat.0 Request processed in 447us (875us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1788835116.611550:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 167 00000100:00100000:3.0:1788835116.624470:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835116.624520:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835116.624971:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242469760 00000100:00100000:2.0:1788835116.624981:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242469760 00000100:00100000:2.0:1788835116.625163:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:2.0:1788835116.625177:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+43:12229:x1875729242469760:12345-192.168.203.22@tcp:35:cat.0 00000100:00100000:0.0:1788835116.625195:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242469888 00000100:00100000:0.0:1788835116.625201:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242469888 00000100:00100000:0.0:1788835116.625253:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:0.0:1788835116.625263:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaae69c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+44:2388:x1875729242469888:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788835116.625274:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835116.625299:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2687 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae071c expref: 44 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835116.625352:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:0.0:1788835116.625372:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835116.625437:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaae69c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+44:2388:x1875729242469888:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 175us (915us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835116.625446:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:2.0:1788835116.625453:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+44:12229:x1875729242469760:12345-192.168.203.22@tcp:35:cat.0 Request processed in 278us (988us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1788835116.625469:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:0.0:1788835116.720863:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835116.721027:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242470144 00000100:00100000:3.0:1788835116.721037:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242470144 00000100:00100000:3.0:1788835116.721100:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 168 00000100:00100000:3.0:1788835116.721112:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+43:12235:x1875729242470144:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:3.0:1788835116.721136:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835116.721139:0:9047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1788835116.721164:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa000/0xdf60171e5a5d25ed lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06f2 expref: 43 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.721183:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:3.0:1788835116.721188:0:9047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788835116.721200:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa600/0xdf60171e5a5d2695 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0723 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.721301:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d269c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.722183:0:9047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d266b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0715 expref: 43 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.722197:0:9047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d269c lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.722259:0:9047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d266b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0715 expref: 43 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835116.722278:0:9047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d266b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0715 expref: 43 pid: 9047 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835116.722292:0:9047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9047:1875729254067328:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788835116.724431:0:9047:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda10bd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788835116.733048:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835116.733153:0:9047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9047:1875729254067328:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788835116.733180:0:9047:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d269c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835116.733224:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242470272 00000100:00100000:2.0:1788835116.733231:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242470272 00010000:00010000:2.0:1788835116.733274:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d266b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0715 expref: 44 pid: 9047 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835116.733357:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 85 00000100:00100000:2.0:1788835116.733368:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+44:2385:x1875729242470272:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835116.733382:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835116.733389:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d266b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0715 expref: 44 pid: 9047 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.733402:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d266b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0715 expref: 44 pid: 9047 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.733424:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abe00/0xdf60171e5a5d266b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0715 expref: 44 pid: 9047 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.733438:0:9491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:2.0:1788835116.733443:0:9491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d269c lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.733453:0:9491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d269c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.733461:0:9491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d269c lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835116.733504:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835116.733564:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+43:2385:x1875729242470272:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 198us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835116.733573:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 85 00010000:00010000:0.0:1788835116.733593:0:9047:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d269c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835116.733600:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d269c lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788835116.733619:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 13 00010000:00010000:0.0:1788835116.733768:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa600/0xdf60171e5a5d2695 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0723 expref: 44 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835116.733783:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d269c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0723 expref: 43 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835116.733790:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:0.0:1788835116.733794:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788835116.733796:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884ab400, rc 0) 00000100:00100000:0.0:1788835116.733941:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb96d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+43:12235:x1875729242470144:12345-192.168.203.22@tcp:101:dd.0 Request processed in 12830us (13088us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1788835116.733957:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 168 00000100:00100000:3.0:1788835116.741234:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835116.741356:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242470400 00000100:00100000:1.0:1788835116.741366:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242470400 00000100:00100000:1.0:1788835116.741432:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 169 00000100:00100000:1.0:1788835116.741442:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+43:12235:x1875729242470400:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:1.0:1788835116.741466:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835116.741486:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d26aa lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae072a expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.741520:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d26b1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.741534:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d26b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.741546:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d26b1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.741680:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d26aa lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae072a expref: 45 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.741698:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d26b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae072a expref: 44 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.741718:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:1.0:1788835116.741721:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788835116.741724:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61200, rc 0) 00000100:00100000:1.0:1788835116.741780:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f39880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+44:12235:x1875729242470400:12345-192.168.203.22@tcp:101:dd.0 Request processed in 340us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835116.741788:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 169 00000100:00100000:2.0:1788835116.745249:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835116.745359:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242470656 00000100:00100000:1.0:1788835116.745368:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242470656 00000100:00100000:1.0:1788835116.745431:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 170 00000100:00100000:1.0:1788835116.745442:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+44:12235:x1875729242470656:12345-192.168.203.22@tcp:36:dd.0 00010000:00010000:1.0:1788835116.745672:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d26b8 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.745688:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d26b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.745712:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d26b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788835116.745757:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967442 00000004:00010000:1.0:1788835116.745781:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000013457d04 reply state 000000002a3afa38 transno 4294967443 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d26b8 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.745814:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d26b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835116.745821:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:1.0:1788835116.745823:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788835116.745826:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788835116.745923:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83fb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+47:12235:x1875729242470656:12345-192.168.203.22@tcp:36:dd.0 Request processed in 483us (684us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1788835116.745930:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 170 00000020:00080000:1.0:1788835116.745934:0:6487:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788835116.840463:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254067456:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788835116.840560:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835116.840649:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788835116.840656:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254067584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788835116.840679:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835116.840738:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254067456 00000100:00100000:2.0:1788835116.840747:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254067456 00000100:00100000:1.0:1788835116.840752:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254067584 00000100:00100000:1.0:1788835116.840755:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254067584 00000100:00100000:2.0:1788835116.840798:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1788835116.840808:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254067456:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788835116.840840:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:2.0:1788835116.840899:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254067456:12345-0@lo:13:osp-pre-1-1.0 Request processed in 92us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835116.840906:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1788835116.841471:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254067456:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788835116.844539:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788835116.844564:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254067584:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788835116.844595:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 25505472 pending 0 free 3923525632 avail 3692003328 00000100:00100000:1.0:1788835116.844694:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254067584:12345-0@lo:13:osp-pre-1-0.0 Request processed in 143us (4013us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835116.844702:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1788835116.844895:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254067584:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788835117.035099:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835117.035211:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242470784 00000100:00100000:0.0:1788835117.035221:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242470784 00000100:00100000:0.0:1788835117.035442:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 171 00000100:00100000:0.0:1788835117.035454:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+47:12249:x1875729242470784:12345-192.168.203.22@tcp:101:stat.0 00010000:00010000:0.0:1788835117.035478:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835117.035499:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d26bf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0731 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.035567:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d26c6 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.035582:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d26c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.035598:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d26c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.035612:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d26cd lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.035619:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d26cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.035627:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d26cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.035713:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d26d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.035743:0:9047:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d269c lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0723 expref: 48 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.035752:0:9047:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d26d4 lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.035785:0:9047:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d269c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0723 expref: 48 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.035798:0:9047:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d269c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0723 expref: 48 pid: 9047 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835117.035811:0:9047:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb95500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9047:1875729254067712:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788835117.038196:0:9047:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd83e4ee40 going to sleep for 11 seconds 00000100:00080000:1.0:1788835117.038295:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788835117.040677:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835117.040841:0:9047:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb95500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:9047:1875729254067712:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788835117.040872:0:9047:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d26d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835117.047080:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242471040 00000100:00100000:1.0:1788835117.047095:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242471040 00000100:00100000:1.0:1788835117.047167:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:1.0:1788835117.047177:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+49:6157:x1875729242471040:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788835117.047486:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+50:6157:x1875729242471040:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 310us (6820us total) trans 4294967444 rc 0/0 00000100:00100000:1.0:1788835117.047493:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:0.0:1788835117.050240:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835117.052472:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242471168 00000100:00100000:3.0:1788835117.052485:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242471168 00010000:00010000:3.0:1788835117.052537:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d269c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0723 expref: 50 pid: 9047 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835117.052798:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 86 00000100:00100000:3.0:1788835117.052809:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+50:2386:x1875729242471168:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788835117.052825:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835117.052843:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d269c lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0723 expref: 50 pid: 9047 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835117.052856:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d269c lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0723 expref: 50 pid: 9047 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835117.052879:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d269c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0723 expref: 50 pid: 9047 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835117.052903:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:3.0:1788835117.052909:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d26d4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x48 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835117.052919:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d26d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835117.052926:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d26d4 lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835117.052966:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835117.053027:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb95500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+49:2386:x1875729242471168:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 221us (2796us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835117.053035:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 86 00010000:00010000:1.0:1788835117.053083:0:9047:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d26d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.053092:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d26d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835117.053149:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788835117.053153:0:9047:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835117.053177:0:9047:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d26d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.053191:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d26d4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.053201:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d26c6 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.053208:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d26c6 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.053214:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d26c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.053220:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835117.053223:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d26c6 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.053230:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d26c6 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.053239:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:1.0:1788835117.053241:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835117.053245:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d26c6 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.053258:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d26c6 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.053272:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d26cd lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.053278:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d26cd lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.053283:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d26cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.053287:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835117.053290:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d26cd lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.053296:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d26cd lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.053303:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afdb2e6e800) 00010000:00010000:1.0:1788835117.053304:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835117.053307:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d26cd lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.053311:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d26cd lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.053381:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d26bf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0731 expref: 49 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.053394:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d26d4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0731 expref: 48 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.053406:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:1.0:1788835117.053408:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788835117.053410:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f4e00, rc 0) 00000100:00100000:1.0:1788835117.053450:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+48:12249:x1875729242470784:12345-192.168.203.22@tcp:101:stat.0 Request processed in 18000us (18362us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835117.053456:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 171 00000100:00100000:0.0:1788835117.125987:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835117.126131:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242471424 00000100:00100000:2.0:1788835117.126145:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242471424 00000100:00100000:2.0:1788835117.126217:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 172 00000100:00100000:2.0:1788835117.126227:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+48:12255:x1875729242471424:12345-192.168.203.22@tcp:36:truncate.0 00010000:00010000:2.0:1788835117.126295:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835117.126352:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d26d4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0731 expref: 48 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835117.126372:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:2.0:1788835117.126378:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788835117.126560:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d26db lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835117.126575:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d26db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835117.126599:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d26db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788835117.126640:0:6489:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967445 00000004:00010000:2.0:1788835117.126667:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060b3fdd7 reply state 00000000eaa42ff2 transno 4294967446 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d26db lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835117.126679:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d26db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835117.126685:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:2.0:1788835117.126688:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788835117.126690:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788835117.126784:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+50:12255:x1875729242471424:12345-192.168.203.22@tcp:36:truncate.0 Request processed in 558us (806us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1788835117.126791:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 172 00000020:00080000:2.0:1788835117.126796:0:6489:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788835117.335692:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835117.335860:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242471552 00000100:00100000:1.0:1788835117.335869:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242471552 00000100:00100000:1.0:1788835117.335973:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 173 00000100:00100000:1.0:1788835117.335985:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd90482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+50:12269:x1875729242471552:12345-192.168.203.22@tcp:101:stat.0 00010000:00010000:1.0:1788835117.336009:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835117.336033:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d26e2 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0738 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336101:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d26e9 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336117:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d26e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336131:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d26e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336144:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d26f0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336152:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d26f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336181:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d26f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336262:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d26f7 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336272:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d26f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336278:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d26f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835117.336361:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1788835117.336366:0:6487:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835117.336387:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d26f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336399:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d26f7 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336406:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d26e9 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336411:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d26e9 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336417:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d26e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336422:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835117.336427:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d26e9 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336442:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d26e9 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336455:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:1.0:1788835117.336458:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835117.336462:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d26e9 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336467:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d26e9 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336480:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d26f0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336485:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d26f0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336490:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d26f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336494:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60c00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835117.336497:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d26f0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336517:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d26f0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336524:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afdb2e6e800) 00010000:00010000:1.0:1788835117.336527:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835117.336529:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d26f0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336545:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d26f0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336575:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d26e2 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0738 expref: 52 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336588:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d26f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0738 expref: 51 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.336595:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:1.0:1788835117.336597:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788835117.336599:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60e00, rc 0) 00000100:00100000:1.0:1788835117.336666:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd90482680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+51:12269:x1875729242471552:12345-192.168.203.22@tcp:101:stat.0 Request processed in 683us (983us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835117.336674:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 173 00000100:00100000:3.0:1788835117.447054:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835117.451366:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242471808 00000100:00100000:1.0:1788835117.451383:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242471808 00000100:00100000:1.0:1788835117.451474:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 174 00000100:00100000:1.0:1788835117.451485:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+51:12279:x1875729242471808:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788835117.451517:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835117.451536:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d26fe lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae073f expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835117.451637:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788835117.451755:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d26fe lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae073f expref: 53 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.451790:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afd93eb1c00) 00010000:00010000:1.0:1788835117.451792:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788835117.451798:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d26fe lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae073f expref: 53 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.451812:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60800, rc 0) 00000100:00100000:1.0:1788835117.451900:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+52:12279:x1875729242471808:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 416us (4855us total) trans 4294967447 rc 301/301 00000100:00100000:1.0:1788835117.451907:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 174 00000100:00100000:0.0:1788835117.459085:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835117.461392:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242472064 00000100:00100000:1.0:1788835117.461407:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242472064 00000100:00100000:1.0:1788835117.461484:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:1.0:1788835117.461497:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84e66c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+52:12279:x1875729242472064:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1788835117.461762:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84e66c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+53:12279:x1875729242472064:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 268us (2687us total) trans 4294967448 rc 0/0 00000100:00100000:1.0:1788835117.461770:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00010000:00010000:3.0:1788835117.541621:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835117.555648:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835117.555745:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242472320 00000100:00100000:0.0:1788835117.555756:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242472320 00000100:00100000:0.0:1788835117.555819:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 175 00000100:00100000:0.0:1788835117.555830:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+53:12285:x1875729242472320:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1788835117.555855:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835117.555890:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d270c lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0746 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.556046:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2713 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.556069:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d26f7 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0738 expref: 54 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.556083:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2713 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.556119:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d26f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0738 expref: 54 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.556133:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d26f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0738 expref: 54 pid: 6487 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835117.556147:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb97100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1875729254067840:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788835117.556959:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd83e4ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788835117.559509:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835117.559622:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242472448 00000100:00100000:1.0:1788835117.559631:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242472448 00010000:00010000:1.0:1788835117.559674:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d26f7 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0738 expref: 55 pid: 6487 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835117.559723:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 87 00000100:00100000:1.0:1788835117.559735:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+55:2386:x1875729242472448:12345-192.168.203.22@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1788835117.559750:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb97100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1875729254067840:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788835117.559754:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835117.559781:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d26f7 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0738 expref: 55 pid: 6487 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.559781:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2713 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.559803:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d26f7 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0738 expref: 55 pid: 6487 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.559896:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d26f7 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0738 expref: 55 pid: 6487 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.561782:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:1.0:1788835117.561795:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2713 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.561810:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2713 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.561818:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2713 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.561924:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788835117.562023:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+54:2386:x1875729242472448:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 2287us (2520us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835117.562034:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 87 00010000:00010000:3.0:1788835117.562147:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2713 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835117.562173:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2713 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835117.562192:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1788835117.563123:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d270c lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0746 expref: 55 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835117.563147:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2713 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0746 expref: 54 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835117.563156:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:3.0:1788835117.563159:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788835117.563161:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5000, rc 0) 00000100:00100000:3.0:1788835117.563258:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+54:12285:x1875729242472320:12345-192.168.203.22@tcp:101:bash.0 Request processed in 7429us (7622us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1788835117.563266:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 175 00000100:00100000:3.0:1788835117.567029:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835117.567131:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242472704 00000100:00100000:1.0:1788835117.567145:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242472704 00000100:00100000:1.0:1788835117.567212:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 176 00000100:00100000:1.0:1788835117.567222:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+54:12285:x1875729242472704:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:1.0:1788835117.567517:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2721 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.567545:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2721 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.567558:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2721 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788835117.567607:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967450 00000004:00010000:1.0:1788835117.567629:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005a77629c reply state 00000000b5a033ba transno 4294967451 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2721 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.567641:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2721 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.567649:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:1.0:1788835117.567651:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788835117.567655:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788835117.567741:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+57:12285:x1875729242472704:12345-192.168.203.22@tcp:36:bash.0 Request processed in 520us (725us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1788835117.567748:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 176 00000020:00080000:1.0:1788835117.567753:0:6487:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1788835117.578382:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835117.578658:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242472832 00000100:00100000:2.0:1788835117.578668:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242472832 00000100:00100000:2.0:1788835117.578737:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 177 00000100:00100000:2.0:1788835117.578747:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+57:12285:x1875729242472832:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1788835117.578772:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835117.578795:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2728 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae074d expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835117.578907:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d272f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 9 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835117.578939:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2713 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0746 expref: 58 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835117.578971:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d272f lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835117.579007:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2713 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0746 expref: 58 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835117.579021:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2713 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0746 expref: 58 pid: 6488 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835117.579034:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1875729254067968:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788835117.579133:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd869d09c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788835117.584228:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835117.584405:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed1f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1875729254067968:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788835117.584438:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d272f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835117.584629:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242472960 00000100:00100000:3.0:1788835117.584637:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242472960 00010000:00010000:3.0:1788835117.584675:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2713 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 9 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0746 expref: 59 pid: 6488 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835117.584718:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 88 00000100:00100000:3.0:1788835117.584728:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+59:2385:x1875729242472960:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788835117.584754:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835117.584761:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2713 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0746 expref: 59 pid: 6488 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835117.584790:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2713 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0746 expref: 59 pid: 6488 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835117.584815:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2713 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 10 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0746 expref: 59 pid: 6488 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835117.584832:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:3.0:1788835117.584837:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d272f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x8 rrc: 9 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835117.584846:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d272f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835117.584854:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d272f lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835117.584882:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835117.584955:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+58:2385:x1875729242472960:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 228us (738us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835117.584962:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 88 00010000:00010000:1.0:1788835117.585629:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d272f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.585641:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d272f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835117.585714:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:1.0:1788835117.585719:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835117.585949:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d272f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.585990:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2728 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae074d expref: 58 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.586021:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d272f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae074d expref: 57 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.586030:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:1.0:1788835117.586033:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788835117.586037:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374d600, rc 0) 00000100:00100000:1.0:1788835117.586093:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb97100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+57:12285:x1875729242472832:12345-192.168.203.22@tcp:101:bash.0 Request processed in 7347us (7780us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835117.586101:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 177 00000100:00100000:2.0:1788835117.589679:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835117.589829:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242473216 00000100:00100000:3.0:1788835117.589839:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242473216 00000100:00100000:3.0:1788835117.589966:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:3.0:1788835117.589978:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+57:12285:x1875729242473216:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:3.0:1788835117.590359:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+58:12285:x1875729242473216:12345-192.168.203.22@tcp:35:bash.0 Request processed in 383us (689us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1788835117.590368:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:3.0:1788835117.675246:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835117.677496:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242473472 00000100:00100000:0.0:1788835117.677512:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242473472 00000100:00100000:0.0:1788835117.677591:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 178 00000100:00100000:0.0:1788835117.677602:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+58:12295:x1875729242473472:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788835117.677643:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835117.678759:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2736 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0754 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788835117.678874:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:0.0:1788835117.679001:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2736 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0754 expref: 60 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.679014:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afd93eb1c00) 00010000:00010000:0.0:1788835117.679017:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788835117.679022:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2736 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0754 expref: 60 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.679037:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5600, rc 0) 00000100:00100000:0.0:1788835117.679162:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+59:12295:x1875729242473472:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1561us (3929us total) trans 4294967453 rc 301/301 00000100:00100000:0.0:1788835117.679172:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 178 00000100:00100000:2.0:1788835117.685781:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835117.687426:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242473600 00000100:00100000:0.0:1788835117.687439:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242473600 00000100:00100000:0.0:1788835117.687498:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 179 00000100:00100000:0.0:1788835117.687507:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+59:12295:x1875729242473600:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:0.0:1788835117.687582:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2744 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.687598:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2744 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.687610:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2744 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.687636:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d274b lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.687644:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d274b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.688886:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d274b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689105:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2752 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689117:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689125:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788835117.689172:0:9047:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689211:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2744 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689218:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2744 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689225:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2744 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689231:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835117.689235:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2744 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689243:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2744 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689254:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:1.0:1788835117.689257:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835117.689261:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2744 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689266:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2744 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689280:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d274b lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689287:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d274b lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689293:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d274b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689302:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835117.689305:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d274b lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689311:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d274b lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689363:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afdb2e6e800) 00010000:00010000:1.0:1788835117.689365:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835117.689368:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d274b lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689374:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d274b lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689384:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2752 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689389:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2752 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689395:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2752 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689400:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835117.689402:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2752 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689408:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2752 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689425:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:1.0:1788835117.689427:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835117.689429:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2752 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.689436:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2752 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835117.689518:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+59:12295:x1875729242473600:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 2009us (3892us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835117.689526:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 179 00000100:00100000:2.0:1788835117.692617:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835117.692751:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242473856 00000100:00100000:1.0:1788835117.692760:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242473856 00000100:00100000:1.0:1788835117.692820:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:1.0:1788835117.692832:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+59:12295:x1875729242473856:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1788835117.693057:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+60:12295:x1875729242473856:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 227us (449us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1788835117.693065:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:3.0:1788835117.763652:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835117.763993:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242474112 00000100:00100000:1.0:1788835117.764004:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242474112 00000100:00100000:1.0:1788835117.764073:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 180 00000100:00100000:1.0:1788835117.764084:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+60:12298:x1875729242474112:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788835117.764110:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835117.764132:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2759 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae075b expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.764813:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2760 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.764841:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2760 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.764853:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2760 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.764864:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2767 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.764871:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2767 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.764887:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2767 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.765233:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167200/0xdf60171e5a5d276e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.765245:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167200/0xdf60171e5a5d276e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.765253:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167200/0xdf60171e5a5d276e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835117.765265:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788835117.765398:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2760 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.765406:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2760 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.765413:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2760 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.765427:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60c00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835117.765432:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2760 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.765440:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2760 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.765452:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:1.0:1788835117.765455:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835117.765460:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2760 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.765466:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2760 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.765480:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2767 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.765486:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2767 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.765491:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2767 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.765497:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835117.765500:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2767 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.765505:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2767 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.765521:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afdb2e6e800) 00010000:00010000:1.0:1788835117.765524:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835117.765527:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2767 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.765533:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2767 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.765575:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2759 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae075b expref: 63 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.765589:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167200/0xdf60171e5a5d276e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae075b expref: 62 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835117.765596:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:1.0:1788835117.765599:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788835117.765601:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc2167200, rc 0) 00000100:00100000:1.0:1788835117.765696:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+62:12298:x1875729242474112:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1614us (2055us total) trans 4294967455 rc 0/0 00000100:00100000:1.0:1788835117.765713:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 180 00000100:00100000:2.0:1788835117.769720:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835117.769820:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835117.770298:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242474368 00000100:00100000:3.0:1788835117.770308:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242474368 00000100:00100000:3.0:1788835117.770400:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:3.0:1788835117.770410:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83debb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+62:2388:x1875729242474368:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788835117.770425:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835117.770449:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167200/0xdf60171e5a5d276e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae075b expref: 62 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835117.770470:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:3.0:1788835117.770475:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835117.770530:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83debb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+61:2388:x1875729242474368:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 122us (710us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835117.770538:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:0.0:1788835117.770850:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242474240 00000100:00100000:0.0:1788835117.770855:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242474240 00000100:00100000:0.0:1788835117.770924:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 181 00000100:00100000:0.0:1788835117.770932:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba3e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+61:12298:x1875729242474240:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:0.0:1788835117.770998:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d277c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.771012:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d277c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.771024:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d277c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.771060:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d277c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.771067:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d277c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.771073:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d277c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.771093:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835117.771098:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d277c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.771106:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d277c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.771114:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:0.0:1788835117.771117:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788835117.771120:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d277c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835117.771125:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d277c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 8 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835117.771166:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba3e1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+61:12298:x1875729242474240:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 235us (1454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835117.771172:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 181 00000100:00100000:2.0:1788835117.773553:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835117.773643:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242474624 00000100:00100000:1.0:1788835117.773661:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242474624 00000100:00100000:1.0:1788835117.773760:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:1.0:1788835117.773770:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+61:12298:x1875729242474624:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:1.0:1788835117.774014:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+62:12298:x1875729242474624:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 245us (468us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1788835117.774021:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:0.0:1788835117.863519:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254068096:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788835117.863620:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835117.863794:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254068096 00000100:00100000:3.0:1788835117.863806:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254068096 00000100:00100000:3.0:1788835117.863882:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1788835117.863903:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254068096:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788835117.863961:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788835117.864037:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254068096:12345-0@lo:41:osp-pre-0-1.0 Request processed in 136us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835117.864045:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788835117.864223:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83f39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254068096:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788835117.982683:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835117.982877:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242474880 00000100:00100000:2.0:1788835117.982891:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242474880 00000100:00100000:2.0:1788835117.982981:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 182 00000100:00100000:2.0:1788835117.982992:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+62:12316:x1875729242474880:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:2.0:1788835117.983047:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835117.983077:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2783 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0762 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835117.983221:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d278a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 8 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835117.983239:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d278a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835117.983420:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d278a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835117.983435:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788835117.983666:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2783 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0762 expref: 65 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835117.983691:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d278a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0762 expref: 64 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835117.983702:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:2.0:1788835117.983705:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788835117.983710:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374d000, rc 0) 00000100:00100000:2.0:1788835117.984500:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+64:12316:x1875729242474880:12345-192.168.203.22@tcp:101:cat.0 Request processed in 1496us (1821us total) trans 4294967457 rc 0/0 00000100:00100000:2.0:1788835117.984513:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 182 00000100:00100000:2.0:1788835118.026540:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835118.026692:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242475008 00000100:00100000:1.0:1788835118.026705:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242475008 00000100:00100000:1.0:1788835118.026785:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 183 00000100:00100000:1.0:1788835118.026797:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+64:12317:x1875729242475008:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788835118.026832:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835118.026862:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d2798 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0769 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.026974:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166600/0xdf60171e5a5d279f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.026994:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166600/0xdf60171e5a5d279f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.027008:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166600/0xdf60171e5a5d279f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835118.027070:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788835118.027075:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835118.027100:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166600/0xdf60171e5a5d279f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.027133:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d2798 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0769 expref: 66 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.027157:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166600/0xdf60171e5a5d279f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0769 expref: 65 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.027166:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:1.0:1788835118.027186:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788835118.027191:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc2166600, rc 0) 00000100:00100000:1.0:1788835118.027283:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83dea300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+65:12317:x1875729242475008:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 488us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835118.027291:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 183 00000100:00100000:3.0:1788835118.046850:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835118.048555:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242475392 00000100:00100000:2.0:1788835118.048574:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242475392 00000100:00100000:2.0:1788835118.048690:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:2.0:1788835118.048701:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+65:12317:x1875729242475392:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1788835118.051490:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+66:12317:x1875729242475392:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 2774us (4638us total) trans 4294967458 rc 0/0 00000100:00100000:2.0:1788835118.051507:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:3.0:1788835118.054580:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835118.058831:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242475520 00000100:00100000:1.0:1788835118.058853:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242475520 00000100:00100000:1.0:1788835118.058992:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:1.0:1788835118.059005:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+66:12317:x1875729242475520:12345-192.168.203.22@tcp:103:lfs.0 00010000:00010000:1.0:1788835118.059030:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1788835118.059064:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d272f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae074d expref: 66 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.059094:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d278a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0xd/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0762 expref: 65 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.059108:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d262c lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0707 expref: 64 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.059118:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:1.0:1788835118.059124:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788835118.059217:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+63:12317:x1875729242475520:12345-192.168.203.22@tcp:103:lfs.0 Request processed in 214us (4651us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835118.059226:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:0.0:1788835118.070125:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835118.070242:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242475648 00000100:00100000:3.0:1788835118.070398:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242475648 00000100:00100000:3.0:1788835118.070649:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 184 00000100:00100000:3.0:1788835118.070662:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+63:12317:x1875729242475648:12345-192.168.203.22@tcp:58:lfs.0 00010000:00010000:3.0:1788835118.070826:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d27a6 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.070851:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d27a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.070866:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d27a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788835118.071020:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1788835118.071142:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+63:12317:x1875729242475648:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 482us (1033us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835118.071150:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 184 00000100:00100000:2.0:1788835118.104830:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835118.105125:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242475776 00000100:00100000:1.0:1788835118.105138:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242475776 00000100:00100000:1.0:1788835118.105236:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 185 00000100:00100000:1.0:1788835118.105296:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+63:12319:x1875729242475776:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788835118.105597:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835118.105625:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d27ad lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0770 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.105704:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d27b4 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.105720:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d27b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.105739:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d27b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.105750:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d27bb lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.105756:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d27bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.105761:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d27bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.105850:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d27c2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.105859:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d27c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.106451:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d27c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788835118.106574:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:0.0:1788835118.106579:0:9047:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788835118.106608:0:9047:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d27c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x53/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.106625:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d27c2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.106636:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d27b4 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.106658:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d27b4 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.106666:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d27b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.106673:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835118.106679:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d27b4 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.106688:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d27b4 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.106702:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:0.0:1788835118.106705:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835118.106710:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d27b4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.106717:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d27b4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.106736:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d27bb lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.106742:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d27bb lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.106748:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d27bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.106753:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835118.106762:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d27bb lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.106768:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d27bb lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.106777:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afdb2e6e800) 00010000:00010000:0.0:1788835118.106779:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835118.106782:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d27bb lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.106788:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d27bb lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.106833:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d27ad lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0770 expref: 65 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.106847:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d27c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0770 expref: 64 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.106854:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:0.0:1788835118.106857:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788835118.106859:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5600, rc 0) 00000100:00100000:0.0:1788835118.107230:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83de8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+64:12319:x1875729242475776:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1982us (2413us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835118.107240:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 185 00000040:00080000:2.0:1788835118.501586:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788835118.501598:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788835118.501635:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788835118.501650:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788835118.501860:0:13768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83de8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875729254068224:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1788835118.502564:0:13768:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd869d0840 going to sleep for 11 seconds 00000100:00100000:1.0:1788835118.512791:0:13768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83de8380 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875729254068224:192.168.203.22@tcp:107:hsm_cdtr.0 00000001:00080000:3.0:1788835118.515286:0:6467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00010000:00010000:1.0:1788835118.515466:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d256f lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515482:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d256f lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515491:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d256f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515498:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835118.515504:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d256f lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515512:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d256f lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515534:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9afdb2e5e200) 00010000:00010000:1.0:1788835118.515537:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835118.515543:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d256f lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515551:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d256f lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515577:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2576 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515583:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2576 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515609:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2576 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515614:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374ce00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835118.515618:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2576 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515624:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2576 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515634:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:1.0:1788835118.515636:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835118.515641:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2576 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515646:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2576 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515664:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d25b5 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515670:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d25b5 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515675:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d25b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515680:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884ab600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835118.515683:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d25b5 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515700:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d25b5 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515709:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afdb2e6e800) 00010000:00010000:1.0:1788835118.515711:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835118.515714:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d25b5 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515720:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab600/0xdf60171e5a5d25b5 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515736:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d26b8 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515743:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d26b8 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515749:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d26b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515754:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835118.515757:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d26b8 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515763:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d26b8 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515772:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:1.0:1788835118.515774:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835118.515777:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d26b8 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515795:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d26b8 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515807:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d26db lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515814:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d26db lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515820:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d26db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515825:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374cc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835118.515829:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d26db lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515835:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d26db lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515843:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:1.0:1788835118.515846:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835118.515849:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d26db lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515855:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d26db lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515866:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2721 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.515872:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2721 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.516006:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2721 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.516012:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835118.516015:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2721 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.516021:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2721 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.516030:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:1.0:1788835118.516032:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835118.516035:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2721 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.516042:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2721 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1788835118.516186:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:3.0:1788835118.517022:0:6467:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9afdb2eac780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1788835118.517030:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afc83729d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9afdb2eacf00 00000020:00080000:3.0:1788835118.517034:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afc83d85300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9afc83362a00 00000020:00080000:1.0:1788835118.518757:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1788835118.518881:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1788835118.520333:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788835118.520566:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254068352:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1788835118.520675:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835118.521739:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254068352 00000100:00100000:0.0:1788835118.521760:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254068352 00000100:00100000:0.0:1788835118.521872:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788835118.521898:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3616:x1875729254068352:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1788835118.522049:0:8405:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:4 count 1 00002000:00010000:0.0:1788835118.522098:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x4:0x0] initial LVB size: 13, mtime: 0x6a9f752d, atime: 0x6a9f752d, ctime: 0x6a9f752d, blocks: 0x8 00010000:00010000:0.0:1788835118.522109:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff03c85/0xdf60171e5a5d27c9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.522131:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=360s v=(0 0) 00010000:00010000:0.0:1788835118.522136:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835118.522143:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ff03c85/0xdf60171e5a5d27c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.522163:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ff03c85/0xdf60171e5a5d27c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.522175:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ff03c85/0xdf60171e5a5d27c9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.522184:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ff03c85/0xdf60171e5a5d27c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835118.524665:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835118.524756:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242475904 00000100:00100000:1.0:1788835118.524771:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242475904 00000100:00100000:1.0:1788835118.524854:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 186 00000100:00100000:1.0:1788835118.524866:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+17:12331:x1875729242475904:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788835118.524916:0:9806:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788835118.525113:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+17:12331:x1875729242475904:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 247us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835118.525121:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 186 00000100:00080000:3.0:1788835118.526462:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788835118.528869:0:8405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788835118.529480:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788835118.529495:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ff03c85/0xdf60171e5a5d27c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.529516:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5a00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:3.0:1788835118.529522:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff03c85/0xdf60171e5a5d27c9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.529548:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ff03c85/0xdf60171e5a5d27c9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.529579:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ff03c85/0xdf60171e5a5d27c9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.529588:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ff03c85/0xdf60171e5a5d27c9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.529618:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835118.529620:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835118.529622:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835118.531173:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000004:00080000:0.0:1788835118.532190:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afdbfb93100/2, rc 0, transno 4294967308 00000100:00100000:0.0:1788835118.532203:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254068352:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1788835118.533158:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242476032 00000100:00100000:0.0:1788835118.533170:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242476032 00000100:00100000:1.0:1788835118.533510:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb90a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3616:x1875729254068352:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10114us (11321us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1788835118.533524:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788835118.533590:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 187 00000100:00100000:2.0:1788835118.533605:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+17:12331:x1875729242476032:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1788835118.533698:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d27d0 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.533718:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d27d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.534504:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d27d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.542687:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d27d7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.542711:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d27d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.542742:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d27d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.542780:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d27de lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.542789:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d27de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.542795:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d27de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835118.542849:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00000004:00200000:2.0:1788835118.542854:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788835118.542869:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d27de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.542883:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d27d0 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.542890:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d27d0 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.542896:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d27d0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.542902:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374cc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835118.542906:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d27d0 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.542914:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d27d0 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.542947:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afc835ccc00) 00010000:00010000:2.0:1788835118.542950:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835118.542955:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d27d0 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.542962:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d27d0 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.542978:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d27d7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.542983:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d27d7 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.542989:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d27d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.542993:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374ce00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835118.542996:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d27d7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.543002:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d27d7 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.543009:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xdc6beff1 (ffff9afdb2e5e900) 00010000:00010000:2.0:1788835118.543012:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835118.543014:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d27d7 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.543019:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d27d7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xdc6beff1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.543446:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d27de lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.543455:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d27de lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.543460:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d27de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.543465:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835118.543468:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d27de lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.543474:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d27de lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.543483:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:2.0:1788835118.543485:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835118.543488:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d27de lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.543493:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d27de lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835118.543590:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83de8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+17:12331:x1875729242476032:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 Request processed in 9984us (12432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835118.543599:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 187 00000100:00100000:0.0:1788835118.553553:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835118.555930:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242476288 00000100:00100000:2.0:1788835118.555956:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242476288 00000100:00100000:2.0:1788835118.556039:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 188 00000100:00100000:2.0:1788835118.556066:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+17:12331:x1875729242476288:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788835118.556088:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835118.556110:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d27e5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0777 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.556231:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d27ec lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.556244:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d27ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.556254:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d27ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835118.556265:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:2.0:1788835118.556409:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d27ec lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.556417:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d27ec lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.556423:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d27ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.556428:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374dc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835118.556432:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d27ec lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.556438:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d27ec lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.556449:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:2.0:1788835118.556459:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788835118.556466:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d27ec lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.556471:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d27ec lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.556514:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d27e5 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0777 expref: 19 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.556523:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afc835ccc00) 00010000:00010000:2.0:1788835118.556526:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788835118.556529:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d27e5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0777 expref: 19 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.556537:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374c000, rc 0) 00000100:00100000:2.0:1788835118.556624:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb94380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+18:12331:x1875729242476288:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 559us (3085us total) trans 4294967459 rc 301/301 00000100:00100000:2.0:1788835118.556632:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 188 00000100:00100000:2.0:1788835118.561664:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835118.563147:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242476416 00000100:00100000:1.0:1788835118.563168:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242476416 00000100:00100000:1.0:1788835118.563266:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 189 00000100:00100000:1.0:1788835118.563280:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+18:12331:x1875729242476416:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788835118.563599:0:6487:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788835118.563801:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83deb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+18:12331:x1875729242476416:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 523us (2154us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835118.563810:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 189 00010000:00010000:2.0:1788835118.565670:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835118.568441:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835118.568877:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242476672 00000100:00100000:2.0:1788835118.568890:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242476672 00000100:00100000:2.0:1788835118.569124:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 190 00000100:00100000:2.0:1788835118.569137:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+18:12331:x1875729242476672:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788835118.569167:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835118.569171:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788835118.569210:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166600/0xdf60171e5a5d279f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0769 expref: 18 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.569251:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:2.0:1788835118.569257:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788835118.569275:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d27fa lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae077e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1788835118.573112:0:6488:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x5:0x0], index 1: 0 00010000:00010000:1.0:1788835118.573635:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d2801 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.573657:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d2801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.573672:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d2801 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.573769:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d27fa lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae077e expref: 20 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.573794:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d2801 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae077e expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.573817:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9afd93eb1800) 00010000:00010000:1.0:1788835118.573821:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788835118.573824:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc2166000, rc 0) 00000100:00100000:1.0:1788835118.574265:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+19:12331:x1875729242476672:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 4791us (5500us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1788835118.574278:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 190 00000100:00100000:2.0:1788835118.591536:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835118.592593:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242476928 00000100:00100000:0.0:1788835118.592611:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242476928 00000100:00100000:0.0:1788835118.592693:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 191 00000100:00100000:0.0:1788835118.592717:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+19:12331:x1875729242476928:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788835118.592805:0:9047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835118.592840:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d2801 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae077e expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.592863:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9afd93eb1800) 00010000:00010000:0.0:1788835118.592876:0:9047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788835118.592906:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d280f lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.592922:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d280f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.594696:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d280f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.594880:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d2816 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x20ec0358 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.594895:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d2816 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x20ec0358 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.594909:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d2816 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x20ec0358 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.594984:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d280f lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.594992:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d280f lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.595082:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d280f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.595089:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5400 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835118.595094:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d280f lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.595104:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d280f lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.595118:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:0.0:1788835118.595121:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835118.595126:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d280f lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.595133:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d280f lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.595153:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d2816 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x20ec0358 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.595159:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d2816 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x20ec0358 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.595165:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d2816 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x20ec0358 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.595170:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835118.595173:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d2816 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x20ec0358 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.595190:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d2816 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x20ec0358 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.595199:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x20ec0358 (ffff9afc835cc000) 00010000:00010000:0.0:1788835118.595201:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835118.595205:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d2816 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x20ec0358 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.595210:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d2816 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x20ec0358 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835118.597619:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83de9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+18:12331:x1875729242476928:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 4885us (6078us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788835118.597635:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 191 00000100:00100000:1.0:1788835118.602417:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835118.604071:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242477056 00000100:00100000:0.0:1788835118.604088:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242477056 00000100:00100000:0.0:1788835118.604169:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 192 00000100:00100000:0.0:1788835118.604181:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+18:12331:x1875729242477056:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788835118.604211:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835118.604244:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d281d lrc: 2/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0785 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.604292:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2824 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.604310:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2824 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.604357:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2824 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.604516:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d281d lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0785 expref: 20 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.604541:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2824 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0785 expref: 19 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.604550:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9afc835cc200) 00010000:00010000:0.0:1788835118.604553:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788835118.604556:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f4a00, rc 0) 00000100:00100000:0.0:1788835118.604643:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+19:12331:x1875729242477056:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 464us (2239us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835118.604651:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 192 00000100:00100000:3.0:1788835118.611502:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835118.611624:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242477312 00000100:00100000:1.0:1788835118.611640:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242477312 00000100:00100000:1.0:1788835118.611756:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 193 00000100:00100000:1.0:1788835118.611769:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+19:12331:x1875729242477312:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788835118.611883:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d282b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.611903:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d282b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.611917:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d282b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788835118.612171:0:6488:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1788835118.612183:0:6488:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360653867134ns, next at 361653863650ns, rc = 0 00000004:00010000:1.0:1788835118.612257:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b88849f6 reply state 00000000d2e8ee34 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d282b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.612274:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d282b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.612306:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9afc835cc200) 00010000:00010000:1.0:1788835118.612309:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:1.0:1788835118.612355:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788835118.612499:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+21:12331:x1875729242477312:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 731us (1012us total) trans 4294967461 rc 0/0 00000100:00100000:1.0:1788835118.612508:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 193 00000100:00100000:2.0:1788835118.614542:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835118.614715:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242477440 00000100:00100000:3.0:1788835118.614961:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242477440 00000100:00100000:3.0:1788835118.615058:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 194 00000100:00100000:3.0:1788835118.615069:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+21:12331:x1875729242477440:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1788835118.615102:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835118.615129:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa000/0xdf60171e5a5d2832 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae078c expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.615209:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa000/0xdf60171e5a5d2832 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae078c expref: 22 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.615227:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa000/0xdf60171e5a5d2832 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae078c expref: 22 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.615266:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9afc835cc200) 00010000:00010000:3.0:1788835118.615270:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788835118.615274:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884aa000, rc 0) 00000100:00100000:3.0:1788835118.615394:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83de8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+22:12331:x1875729242477440:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 326us (865us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835118.615402:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 194 00000100:00100000:2.0:1788835118.618364:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835118.618430:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242477568 00000100:00100000:3.0:1788835118.618443:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242477568 00000100:00100000:3.0:1788835118.618875:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:3.0:1788835118.619464:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+6:2385:x1875729242477568:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00000100:00080000:1.0:1788835118.620442:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788835118.620464:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83de9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+7:2385:x1875729242477568:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 1574us (2152us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1788835118.620477:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:1.0:1788835118.623293:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835118.624045:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242477824 00000100:00100000:3.0:1788835118.624060:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242477824 00000100:00100000:0.0:1788835118.626624:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:0.0:1788835118.626653:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+22:12331:x1875729242477824:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1788835118.627010:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+23:12331:x1875729242477824:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 370us (3732us total) trans 4294967462 rc 0/0 00000100:00100000:0.0:1788835118.627019:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:2.0:1788835118.629854:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835118.632156:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242478080 00000100:00100000:1.0:1788835118.632176:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242478080 00000100:00100000:1.0:1788835118.632295:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 195 00000100:00100000:1.0:1788835118.632307:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+23:12331:x1875729242478080:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788835118.633299:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83deaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+23:12331:x1875729242478080:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 986us (3446us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835118.633310:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 195 00000100:00100000:3.0:1788835118.635656:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835118.635844:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242478208 00000100:00100000:2.0:1788835118.635853:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242478208 00000100:00100000:2.0:1788835118.636130:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 196 00000100:00100000:2.0:1788835118.636149:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+23:12331:x1875729242478208:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788835118.636175:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835118.636198:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2839 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0793 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.636292:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2840 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.636308:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.636351:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835118.636415:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788835118.636463:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2840 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.636508:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2839 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0793 expref: 25 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.636539:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2840 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0793 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.636551:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9afc835cc200) 00010000:00010000:2.0:1788835118.636555:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788835118.636559:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374d600, rc 0) 00000100:00100000:2.0:1788835118.636660:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+24:12331:x1875729242478208:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 516us (1011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835118.636671:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 196 00000100:00100000:3.0:1788835118.639368:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835118.642646:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242478336 00000100:00100000:1.0:1788835118.642665:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242478336 00000100:00100000:1.0:1788835118.642763:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:1.0:1788835118.642778:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+7:2386:x1875729242478336:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788835118.642804:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835118.642833:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000097192632/0xdf60171e5a5d2847 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae079a expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788835118.642867:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f752f, blocks: 0x0 00010000:00010000:1.0:1788835118.642895:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=360s v=(0 0) 00010000:00010000:1.0:1788835118.642900:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835118.642921:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000097192632/0xdf60171e5a5d2847 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae079a expref: 8 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.646933:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000097192632/0xdf60171e5a5d2847 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae079a expref: 8 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.646992:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc2166c00, rc 0) 00000100:00100000:1.0:1788835118.647115:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+8:2386:x1875729242478336:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 4341us (7755us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835118.647126:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:0.0:1788835118.656452:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835118.656797:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242478592 00000100:00100000:1.0:1788835118.656814:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242478592 00000100:00100000:1.0:1788835118.656917:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 197 00000100:00100000:1.0:1788835118.656951:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+24:12331:x1875729242478592:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788835118.657866:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+24:12331:x1875729242478592:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 931us (1419us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835118.657880:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 197 00000100:00100000:2.0:1788835118.660030:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835118.660158:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242478720 00000100:00100000:0.0:1788835118.660173:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242478720 00000100:00100000:0.0:1788835118.660248:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:0.0:1788835118.660262:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83de9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+8:12331:x1875729242478720:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788835118.660285:0:9814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835118.660310:0:9814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000615a7464/0xdf60171e5a5d284e lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae07a1 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.661059:0:9814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000097192632/0xdf60171e5a5d2847 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae079a expref: 9 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.661076:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835118.661080:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835118.661087:0:9814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000615a7464/0xdf60171e5a5d284e lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07a1 expref: 9 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.661129:0:9814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000097192632/0xdf60171e5a5d2847 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae079a expref: 9 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.661145:0:9814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000097192632/0xdf60171e5a5d2847 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae079a expref: 9 pid: 8402 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835118.661172:0:9814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83deb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9814:1875729254068480:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788835118.663672:0:9814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd869d0300 going to sleep for 11 seconds 00000100:00100000:2.0:1788835118.675110:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835118.675123:0:9814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83deb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9814:1875729254068480:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788835118.675160:0:9814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000615a7464/0xdf60171e5a5d284e lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07a1 expref: 9 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.675182:0:9814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f4e00, rc 0) 00000100:00100000:0.0:1788835118.675241:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83de9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+9:12331:x1875729242478720:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 14983us (15219us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835118.675250:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:1.0:1788835118.676629:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242478848 00000100:00100000:1.0:1788835118.676641:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242478848 00010000:00010000:1.0:1788835118.676678:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000097192632/0xdf60171e5a5d2847 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae079a expref: 9 pid: 8402 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835118.676714:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 89 00000100:00100000:1.0:1788835118.676723:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaae69050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+9:2385:x1875729242478848:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788835118.676737:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835118.676764:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000097192632/0xdf60171e5a5d2847 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae079a expref: 9 pid: 8402 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.676777:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000097192632/0xdf60171e5a5d2847 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae079a expref: 9 pid: 8402 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.676797:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000097192632/0xdf60171e5a5d2847 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae079a expref: 9 pid: 8402 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.676812:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835118.676816:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835118.676825:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000615a7464/0xdf60171e5a5d284e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07a1 expref: 8 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.676835:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000615a7464/0xdf60171e5a5d284e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07a1 expref: 8 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.676871:0:6474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000615a7464/0xdf60171e5a5d284e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07a1 expref: 8 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835118.679431:0:6474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb92d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6474:1875729254068608:192.168.203.22@tcp:105: 00000100:00100000:1.0:1788835118.679530:0:6474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b2540 going to sleep for 11 seconds 00000100:00100000:2.0:1788835118.683599:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835118.684018:0:6474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb92d80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:6474:1875729254068608:192.168.203.22@tcp:105: 00010000:00010000:0.0:1788835118.684045:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835118.684101:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaae69050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+8:2385:x1875729242478848:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 7377us (9001us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835118.684112:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 89 00000100:00100000:3.0:1788835118.688040:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242478976 00000100:00100000:3.0:1788835118.688056:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242478976 00002000:00100000:3.0:1788835118.688114:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9afc83dea680 x1875729242478976/t0(0) o4->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:39/0 lens 504/0 e 0 to 0 dl 1788835129 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788835118.688125:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afc83dea680 with x1875729242478976 ext(0->8) 00002000:00010000:3.0:1788835118.688130:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afc83dea680 00000100:00100000:3.0:1788835118.688166:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:3.0:1788835118.688175:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b8987b33-76f7-43a0-9448-1013c4af787f+8:2385:x1875729242478976:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1788835118.689794:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83dea680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b8987b33-76f7-43a0-9448-1013c4af787f+10:2385:x1875729242478976:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 Request processed in 1612us (6196us total) trans 4294967315 rc 0/0 00000100:00100000:3.0:1788835118.689807:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00002000:00100000:3.0:1788835118.689818:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->8) req@ffff9afc83dea680 x1875729242478976/t4294967315(0) o4->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:39/0 lens 504/448 e 0 to 0 dl 1788835129 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788835118.689828:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afc83dea680 with x1875729242478976 ext(0->8) 00002000:00010000:3.0:1788835118.689834:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afc83dea680 00000100:00100000:2.0:1788835118.691952:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835118.692010:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242479104 00000100:00100000:3.0:1788835118.692019:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242479104 00000100:00100000:3.0:1788835118.692074:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 198 00000100:00100000:3.0:1788835118.692084:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+24:12331:x1875729242479104:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1788835118.697068:0:6467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967462 is committed 00000004:00080000:2.0:1788835118.697089:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00010000:00010000:3.0:1788835118.697185:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d282b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.697197:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d282b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.697204:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d282b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.697211:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc2166800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835118.697216:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d282b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.697225:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d282b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.697243:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9afc835cc200) 00010000:00010000:3.0:1788835118.697256:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1788835118.697262:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d282b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.697267:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d282b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835118.698139:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254068736:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788835118.698260:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835118.698350:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254068736 00000100:00100000:0.0:1788835118.698423:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254068736 00000100:00100000:0.0:1788835118.698490:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788835118.698500:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254068736:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:3.0:1788835118.698539:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1788835118.698624:0:8405:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788835118.698627:0:8405:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788835119 00002000:00010000:0.0:1788835118.698630:0:8405:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788835118.698632:0:8405:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788835119 -> 1788835119 00002000:00010000:0.0:1788835118.698634:0:8405:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788835118.698693:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb97480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729254068736:12345-0@lo:2:osp-syn-1-0.0 Request processed in 195us (432us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1788835118.698701:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000020:00080000:2.0:1788835118.698898:0:6467:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:2.0:1788835118.699260:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83de9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+19:12331:x1875729242479104:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 Request processed in 7175us (7322us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835118.699271:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 198 00000020:00080000:1.0:1788835118.699275:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1788835118.699289:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000004:00080000:1.0:1788835118.699356:0:3614:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afdbfb95500/2, rc 0, transno 4294967316 00000100:00100000:1.0:1788835118.699363:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254068736:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1788835118.702493:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835118.703004:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242479232 00000100:00100000:0.0:1788835118.703014:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242479232 00000100:00100000:0.0:1788835118.703079:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:0.0:1788835118.703089:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+10:2386:x1875729242479232:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1788835118.710209:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:3.0:1788835118.710228:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:0.0:1788835118.710563:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+7:2386:x1875729242479232:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 Request processed in 7469us (8072us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835118.710576:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:0.0:1788835118.721700:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835118.721779:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242479488 00000100:00100000:3.0:1788835118.721789:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242479488 00000100:00100000:3.0:1788835118.721844:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 199 00000100:00100000:3.0:1788835118.721856:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+19:12331:x1875729242479488:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788835118.721916:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835118.721953:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2840 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0793 expref: 19 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.721968:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9afc835cc200) 00010000:00010000:3.0:1788835118.721973:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1788835118.722003:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2855 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.722015:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2855 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.722024:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2855 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788835118.722146:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000955e3ce0 reply state 00000000c7883533 transno 4294967463 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2855 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.722166:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2855 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.722173:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9afc835cc200) 00010000:00010000:3.0:1788835118.722175:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:3.0:1788835118.722178:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788835118.722285:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+20:12331:x1875729242479488:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 431us (592us total) trans 4294967463 rc 0/0 00000100:00100000:3.0:1788835118.722292:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 199 00000100:00100000:1.0:1788835118.729038:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835118.729105:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242479616 00000100:00100000:3.0:1788835118.729115:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242479616 00000100:00100000:3.0:1788835118.729170:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:3.0:1788835118.729180:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+7:2385:x1875729242479616:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788835118.729343:0:8402:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1788835118.729347:0:8402:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788835119 -> 1788835118 00002000:00010000:3.0:1788835118.729350:0:8402:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788835117 00002000:00010000:3.0:1788835118.729352:0:8402:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788835119 -> 1788835118 00002000:00010000:3.0:1788835118.729355:0:8402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788835118.729408:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb90000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+8:2385:x1875729242479616:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 230us (378us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1788835118.729415:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:1.0:1788835118.737260:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835118.737363:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242479872 00000100:00100000:3.0:1788835118.737374:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242479872 00000100:00100000:3.0:1788835118.737425:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 200 00000100:00100000:3.0:1788835118.737434:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+20:12331:x1875729242479872:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1788835118.737501:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d285c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.737527:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2824 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0785 expref: 20 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.737537:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d285c lrc: 4/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.737572:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2824 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0785 expref: 20 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.737585:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2824 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0785 expref: 20 pid: 6489 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835118.737600:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83f3a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1875729254068864:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788835118.737685:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd83e4ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788835118.750071:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835118.750107:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242480000 00000100:00100000:0.0:1788835118.750115:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242480000 00010000:00010000:0.0:1788835118.750149:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2824 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0785 expref: 21 pid: 6489 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835118.750185:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 90 00000100:00100000:0.0:1788835118.750195:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+21:2386:x1875729242480000:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788835118.750208:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835118.750215:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2824 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0785 expref: 21 pid: 6489 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.750228:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2824 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0785 expref: 21 pid: 6489 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835118.750471:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83f3a680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1875729254068864:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788835118.750532:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2824 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xd:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0785 expref: 21 pid: 6489 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.750726:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d285c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.750761:0:9491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9afc835cc200) 00010000:00010000:0.0:1788835118.750767:0:9491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d285c lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.750778:0:9491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d285c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.750788:0:9491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d285c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.750814:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835118.750863:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+20:2386:x1875729242480000:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 669us (796us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835118.750872:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 90 00010000:00010000:3.0:1788835118.751389:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d285c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.751399:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d285c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.751439:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d285c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.751446:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d285c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.751464:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d285c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.751470:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aac00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835118.751474:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d285c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.751482:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d285c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.751494:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9afc835cc200) 00010000:00010000:3.0:1788835118.751496:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1788835118.751500:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d285c lrc: 2/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.751507:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d285c lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835118.751557:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+19:12331:x1875729242479872:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 Request processed in 14123us (14302us total) trans 0 rc -22/-22 00000100:00100000:3.0:1788835118.751566:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 200 00000100:00100000:0.0:1788835118.754112:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835118.754228:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242480128 00000100:00100000:3.0:1788835118.754239:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242480128 00000100:00100000:3.0:1788835118.754340:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:3.0:1788835118.754356:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+8:2385:x1875729242480128:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788835118.754412:0:9814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e1fe9368/0xdf60171e5a5d2863 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.754436:0:9814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000615a7464/0xdf60171e5a5d284e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07a1 expref: 8 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.754466:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835118.754472:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788835118.754478:0:9814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1fe9368/0xdf60171e5a5d2863 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.754521:0:9814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000615a7464/0xdf60171e5a5d284e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07a1 expref: 8 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.754538:0:9814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000615a7464/0xdf60171e5a5d284e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07a1 expref: 8 pid: 9814 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835118.754556:0:9814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83f3a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9814:1875729254068992:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788835118.754657:0:9814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd83e4ee40 going to sleep for 11 seconds 00000100:00100000:0.0:1788835118.769103:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835118.769149:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242480256 00000100:00100000:0.0:1788835118.769160:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242480256 00010000:00010000:0.0:1788835118.769208:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000615a7464/0xdf60171e5a5d284e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07a1 expref: 9 pid: 9814 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835118.769263:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 91 00000100:00100000:0.0:1788835118.769274:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+9:2386:x1875729242480256:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788835118.769287:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835118.769310:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000615a7464/0xdf60171e5a5d284e lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07a1 expref: 9 pid: 9814 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.769374:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000615a7464/0xdf60171e5a5d284e lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07a1 expref: 9 pid: 9814 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.769403:0:7430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788835118.769410:0:7430:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788835118.769417:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e1fe9368/0xdf60171e5a5d2863 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.769428:0:7430:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e1fe9368/0xdf60171e5a5d2863 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.769451:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835118.769520:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+9:2386:x1875729242480256:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 244us (427us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835118.769530:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 91 00010000:00010000:3.0:1788835118.770725:0:9814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000615a7464/0xdf60171e5a5d284e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07a1 expref: 8 pid: 9814 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835118.770750:0:9814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83f3a680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9814:1875729254068992:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788835118.770773:0:9814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e1fe9368/0xdf60171e5a5d2863 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.770786:0:9814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e1fe9368/0xdf60171e5a5d2863 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.770794:0:9814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e1fe9368/0xdf60171e5a5d2863 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.770836:0:9814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e1fe9368/0xdf60171e5a5d2863 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.770845:0:9814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e1fe9368/0xdf60171e5a5d2863 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.770853:0:9814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e1fe9368/0xdf60171e5a5d2863 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.770861:0:9814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884ab200 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:3.0:1788835118.770866:0:9814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1fe9368/0xdf60171e5a5d2863 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.770876:0:9814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e1fe9368/0xdf60171e5a5d2863 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.770912:0:9814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e1fe9368/0xdf60171e5a5d2863 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.770922:0:9814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e1fe9368/0xdf60171e5a5d2863 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835118.771026:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+7:2385:x1875729242480128:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 Request processed in 16670us (16925us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835118.771038:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:0.0:1788835118.775402:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835118.775511:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242480512 00000100:00100000:3.0:1788835118.775522:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242480512 00000100:00100000:3.0:1788835118.775600:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 201 00000100:00100000:3.0:1788835118.775613:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+19:12331:x1875729242480512:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788835118.775704:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d286a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.775724:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d26b1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae072a expref: 19 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.775736:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d286a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.775778:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d26b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae072a expref: 19 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.775796:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d26b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae072a expref: 19 pid: 9806 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835118.775810:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83f3a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875729254069120:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788835118.777289:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd83e4ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1788835118.781602:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83f3a680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875729254069120:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788835118.781637:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d286a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835118.785172:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835118.785254:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242480640 00000100:00100000:1.0:1788835118.785263:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242480640 00010000:00010000:1.0:1788835118.785300:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d26b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae072a expref: 20 pid: 9806 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835118.785372:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 92 00000100:00100000:1.0:1788835118.785382:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+20:2385:x1875729242480640:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788835118.785395:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835118.785402:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d26b1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae072a expref: 20 pid: 9806 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.785416:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d26b1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae072a expref: 20 pid: 9806 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.785436:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d26b1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae072a expref: 20 pid: 9806 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.785451:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:1.0:1788835118.785457:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d286a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.785466:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d286a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.785473:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d286a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.785514:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788835118.785573:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+19:2385:x1875729242480640:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 192us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835118.785580:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 92 00010000:00010000:3.0:1788835118.786182:0:6487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d286a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.786206:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d286a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.786401:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2871 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.786414:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa000/0xdf60171e5a5d2832 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae078c expref: 19 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.786423:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2871 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.786454:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa000/0xdf60171e5a5d2832 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae078c expref: 19 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.786470:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa000/0xdf60171e5a5d2832 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae078c expref: 19 pid: 9047 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835118.786483:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83f38700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875729254069248:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788835118.786543:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda10bd600 going to sleep for 11 seconds 00000100:00100000:3.0:1788835118.795686:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83f38700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875729254069248:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788835118.795716:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2871 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835118.796250:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835118.796352:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242480768 00000100:00100000:1.0:1788835118.796359:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242480768 00010000:00010000:1.0:1788835118.796393:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa000/0xdf60171e5a5d2832 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae078c expref: 20 pid: 9047 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835118.796424:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 93 00000100:00100000:1.0:1788835118.796432:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+20:2386:x1875729242480768:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788835118.796446:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835118.796454:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa000/0xdf60171e5a5d2832 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae078c expref: 20 pid: 9047 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.796465:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa000/0xdf60171e5a5d2832 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae078c expref: 20 pid: 9047 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.796485:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa000/0xdf60171e5a5d2832 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae078c expref: 20 pid: 9047 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.796500:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9afc835cc200) 00010000:00010000:1.0:1788835118.796505:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2871 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.796514:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2871 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.796539:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2871 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835118.796565:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788835118.796613:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f38700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+19:2386:x1875729242480768:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 182us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835118.796621:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 93 00010000:00010000:2.0:1788835118.796741:0:6487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2871 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.796750:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2871 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788835118.796851:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1788835118.796985:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000001:00080000:2.0:1788835118.797032:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:2.0:1788835118.797103:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83de8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6487:1875729254069376:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788835118.797152:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835118.797182:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd93f0f840 going to sleep for 11 seconds 00000100:00100000:1.0:1788835118.797285:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254069376 00000100:00100000:1.0:1788835118.797291:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254069376 00000100:00100000:1.0:1788835118.797357:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1788835118.797365:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6487:x1875729254069376:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788835118.797442:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83dead80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6487:x1875729254069376:12345-0@lo:1000:mdt00_000.0 Request processed in 78us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835118.797449:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1788835118.797990:0:6487:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967316 gen 2 00000004:00080000:2.0:1788835118.797996:0:6487:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afdbfb95500, transno 4294967316 00000100:00100000:2.0:1788835118.798026:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83de8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6487:1875729254069376:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1788835118.798146:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00000100:00100000:2.0:1788835118.798191:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83de8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6487:1875729254069504:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788835118.798225:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835118.798258:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd86b53b40 going to sleep for 11 seconds 00000100:00100000:3.0:1788835118.798419:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254069504 00000100:00100000:3.0:1788835118.798424:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254069504 00000100:00100000:3.0:1788835118.798463:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1788835118.798477:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:6487:x1875729254069504:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788835118.798579:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83de9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6487:x1875729254069504:12345-0@lo:1000:mdt00_000.0 Request processed in 102us (353us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1788835118.798586:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788835118.799599:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83de8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6487:1875729254069504:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1788835118.799661:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2871 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.799675:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2871 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.799684:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2871 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.799692:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aac00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835118.799699:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2871 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.799708:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2871 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.799728:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9afc835cc200) 00010000:00010000:2.0:1788835118.799733:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788835118.799741:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2871 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.799749:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aac00/0xdf60171e5a5d2871 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.799783:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d27a6 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.799805:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d27a6 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.799812:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d27a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.799819:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884ab400 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835118.799823:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d27a6 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.799831:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d27a6 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.799844:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:2.0:1788835118.799847:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788835118.799851:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d27a6 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.799859:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab400/0xdf60171e5a5d27a6 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.799909:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2878 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.799925:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d27c2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0770 expref: 22 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.799943:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2878 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.799972:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d27c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0770 expref: 22 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.799994:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d27c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0770 expref: 22 pid: 9047 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835118.801111:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83debb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875729254069632:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788835118.801353:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd86b53b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788835118.814017:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83debb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875729254069632:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788835118.814055:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2878 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835118.815586:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835118.815716:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242480896 00000100:00100000:0.0:1788835118.815726:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242480896 00010000:00010000:0.0:1788835118.815771:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d27c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0770 expref: 23 pid: 9047 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835118.815822:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 94 00000100:00100000:0.0:1788835118.815835:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+23:2385:x1875729242480896:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788835118.815853:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835118.815862:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d27c2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0770 expref: 23 pid: 9047 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.815905:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d27c2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0770 expref: 23 pid: 9047 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.815945:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d27c2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0770 expref: 23 pid: 9047 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.815965:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:0.0:1788835118.815970:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2878 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.815979:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2878 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.815985:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2878 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835118.816025:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835118.816080:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+22:2385:x1875729242480896:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 249us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835118.816088:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 94 00010000:00010000:3.0:1788835118.816831:0:6487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2878 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.816842:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2878 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.816853:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2878 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.816860:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2878 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.816866:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2878 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.816872:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374c000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835118.816877:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2878 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.816896:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2878 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.816910:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:3.0:1788835118.816912:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835118.816916:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2878 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.816942:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2878 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.816957:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d286a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.816964:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d286a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.816969:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d286a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.816974:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aae00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835118.816977:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d286a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.816983:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d286a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.816992:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afdb2e5ed00) 00010000:00010000:3.0:1788835118.816995:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788835118.817006:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d286a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.817012:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d286a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835118.817182:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+21:12331:x1875729242480512:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 41571us (41794us total) trans 4294967468 rc 0/0 00000100:00100000:3.0:1788835118.817191:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 201 00000020:00080000:3.0:1788835118.817201:0:6487:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1788835118.817450:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788835118.817455:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788835118.817975:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:2.0:1788835118.817986:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788835118.823788:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835118.823902:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242481152 00000100:00100000:2.0:1788835118.823915:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242481152 00000100:00100000:2.0:1788835118.823984:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:2.0:1788835118.823995:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84e64450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+21:12331:x1875729242481152:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788835118.824270:0:6490:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788835118.824306:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967469 00010000:00010000:2.0:1788835118.824376:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d287f lrc: 3/0,1 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.824393:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d287f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.824404:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d287f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.824429:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d287f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.824436:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d287f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.824442:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d287f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835118.824454:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788835118.824544:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84e64450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+23:12331:x1875729242481152:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 550us (769us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1788835118.824553:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00000020:00080000:2.0:1788835118.824558:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1788835118.824822:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788835118.824829:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d287f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.824836:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374dc00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:3.0:1788835118.824840:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d287f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.824848:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d287f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.824861:0:7429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9afc835cc200) 00010000:00010000:3.0:1788835118.824864:0:7429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788835118.824870:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d287f lrc: 1/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.824879:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d287f lrc: 0/0,0 mode: --/PW res: [0x200000402:0xd:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835118.824896:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835118.824898:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835118.824900:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788835119.140659:0:14575:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788835119.140672:0:14575:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788835119.140705:0:14575:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1788835119.140714:0:14575:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1788835119.273017:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835119.273372:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242481408 00000100:00100000:1.0:1788835119.273382:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242481408 00000100:00100000:1.0:1788835119.273455:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 202 00000100:00100000:1.0:1788835119.273467:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8365d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+23:12341:x1875729242481408:12345-192.168.203.22@tcp:101:lfs.0 00000100:00080000:0.0:1788835119.273481:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788835119.273494:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835119.273518:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d2886 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae07a8 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.273646:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d288d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.273667:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d288d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.273708:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d288d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835119.273726:0:9806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00010000:00010000:1.0:1788835119.273910:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d2886 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07a8 expref: 26 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.273944:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d288d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07a8 expref: 25 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.273956:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:1.0:1788835119.273959:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788835119.273962:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc2166800, rc 0) 00000100:00100000:1.0:1788835119.274075:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8365d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+25:12341:x1875729242481408:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 609us (1065us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1788835119.274087:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 202 00000100:00100000:2.0:1788835119.280666:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835119.281975:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242481536 00000100:00100000:0.0:1788835119.281988:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242481536 00000100:00100000:0.0:1788835119.282058:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 203 00000100:00100000:0.0:1788835119.282076:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+25:12341:x1875729242481536:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:0.0:1788835119.282191:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d289b lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282224:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d289b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282239:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d289b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282262:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d28a2 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282272:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d28a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282279:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d28a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282386:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d28a9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282394:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d28a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282407:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d28a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788835119.282466:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d28a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282485:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d289b lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282503:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d289b lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282528:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d289b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282536:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835119.282541:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d289b lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282551:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d289b lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282568:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:0.0:1788835119.282572:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835119.282579:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d289b lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282587:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d289b lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282608:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d28a2 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282620:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d28a2 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282630:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d28a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282638:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835119.282642:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d28a2 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282669:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d28a2 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282685:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afc835cc000) 00010000:00010000:0.0:1788835119.282689:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835119.282693:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d28a2 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282701:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d28a2 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282723:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d28a9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282732:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d28a9 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282741:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d28a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282747:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5400 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835119.282751:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d28a9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282760:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d28a9 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282771:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afc835ccb00) 00010000:00010000:0.0:1788835119.282777:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835119.282781:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d28a9 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835119.282808:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d28a9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835119.282975:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83deb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+25:12341:x1875729242481536:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 903us (2318us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835119.282985:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 203 00000100:00100000:0.0:1788835119.362594:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835119.362708:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242481792 00000100:00100000:3.0:1788835119.362723:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242481792 00000100:00100000:3.0:1788835119.362803:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 204 00000100:00100000:3.0:1788835119.362817:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc836b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+25:12344:x1875729242481792:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788835119.362844:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835119.362870:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d28b0 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae07af expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363033:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d28b7 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363050:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d28b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363063:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d28b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363081:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28be lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363091:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363099:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363239:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d28c5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363250:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d28c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363259:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d28c5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835119.363270:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788835119.363621:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d28b7 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363631:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d28b7 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363652:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d28b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363659:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884ab200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835119.363664:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d28b7 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363674:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d28b7 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363689:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:3.0:1788835119.363693:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835119.363698:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d28b7 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363705:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d28b7 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363723:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28be lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363730:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28be lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363737:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363743:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aa200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835119.363746:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28be lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363769:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28be lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363780:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afc810b8e00) 00010000:00010000:3.0:1788835119.363783:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835119.363787:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28be lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363794:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28be lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363851:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d28b0 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07af expref: 28 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363869:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d28c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07af expref: 27 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.363878:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afc810b8a00) 00010000:00010000:3.0:1788835119.363881:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788835119.363883:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884aa400, rc 0) 00000100:00100000:3.0:1788835119.363965:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc836b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+27:12344:x1875729242481792:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1152us (1385us total) trans 4294967472 rc 0/0 00000100:00100000:3.0:1788835119.363972:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 204 00000100:00100000:3.0:1788835119.367947:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835119.368005:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242481920 00000100:00100000:2.0:1788835119.368015:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242481920 00000100:00100000:2.0:1788835119.368074:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 205 00000100:00100000:2.0:1788835119.368084:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+27:12344:x1875729242481920:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:2.0:1788835119.368149:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d28d3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.368173:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d28d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.368209:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d28d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.368259:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d28d3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.368268:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d28d3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.368276:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d28d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.368282:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374cc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835119.368286:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d28d3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.368293:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d28d3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.368305:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afc810b8a00) 00010000:00010000:2.0:1788835119.368309:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788835119.368341:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d28d3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.368348:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d28d3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835119.368427:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+27:12344:x1875729242481920:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 342us (498us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835119.368438:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 205 00000100:00100000:2.0:1788835119.375584:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835119.375979:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242482176 00000100:00100000:3.0:1788835119.375990:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242482176 00000100:00100000:3.0:1788835119.376049:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:3.0:1788835119.376059:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+27:12344:x1875729242482176:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1788835119.376485:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83debb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+28:12344:x1875729242482176:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 424us (911us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1788835119.376497:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:0.0:1788835119.404233:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835119.404347:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242482432 00000100:00100000:3.0:1788835119.404358:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242482432 00000100:00100000:3.0:1788835119.404459:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 206 00000100:00100000:3.0:1788835119.404469:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+28:11876:x1875729242482432:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1788835119.404500:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835119.404524:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d28da lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae07b6 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.404630:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28e1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.404644:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d28c5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07af expref: 29 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.404653:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28e1 lrc: 4/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.404712:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d28c5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07af expref: 29 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.404727:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d28c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07af expref: 29 pid: 6487 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835119.404741:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1875729254069760:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788835119.404848:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda10bd600 going to sleep for 11 seconds 00000100:00100000:0.0:1788835119.408380:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835119.408462:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242482560 00000100:00100000:2.0:1788835119.408470:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242482560 00010000:00010000:2.0:1788835119.408508:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d28c5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07af expref: 30 pid: 6487 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835119.408541:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 95 00000100:00100000:2.0:1788835119.408549:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+30:2386:x1875729242482560:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835119.408564:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835119.408571:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d28c5 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07af expref: 30 pid: 6487 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.408584:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d28c5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07af expref: 30 pid: 6487 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.408607:0:9491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afc810b8a00) 00010000:00010000:2.0:1788835119.408611:0:9491:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28e1 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.408620:0:9491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.408625:0:9491:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28e1 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.408645:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835119.408709:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+30:2386:x1875729242482560:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 161us (341us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835119.408717:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 95 00010000:00010000:3.0:1788835119.409354:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d28c5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07af expref: 29 pid: 6487 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835119.409373:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1875729254069760:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788835119.409395:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.409404:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.409410:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28e1 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835119.409429:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 9 00010000:00010000:3.0:1788835119.409564:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d28da lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07b6 expref: 30 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.409580:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07b6 expref: 29 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.409588:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afc810b8a00) 00010000:00010000:3.0:1788835119.409591:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1788835119.409593:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884aa200, rc 0) 00000100:00100000:3.0:1788835119.409714:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+29:11876:x1875729242482432:12345-192.168.203.22@tcp:101:bash.0 Request processed in 5246us (5497us total) trans 4294967474 rc 0/0 00000100:00100000:3.0:1788835119.409722:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 206 00000100:00100000:0.0:1788835119.412731:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835119.412847:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242482688 00000100:00100000:3.0:1788835119.412869:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242482688 00000100:00100000:3.0:1788835119.413140:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 207 00000100:00100000:3.0:1788835119.413151:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+29:11876:x1875729242482688:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1788835119.413175:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835119.413195:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d28ef lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae07bd expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.413229:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d28f6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.413243:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d28f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.413255:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d28f6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.413412:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d28ef lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07bd expref: 31 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.413431:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d28f6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07bd expref: 30 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.413439:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afc810b8a00) 00010000:00010000:3.0:1788835119.413442:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788835119.413445:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884aaa00, rc 0) 00000100:00100000:3.0:1788835119.413503:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+30:11876:x1875729242482688:12345-192.168.203.22@tcp:101:bash.0 Request processed in 354us (783us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835119.413509:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 207 00000100:00100000:2.0:1788835119.417365:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835119.417483:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242482944 00000100:00100000:1.0:1788835119.417494:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242482944 00000100:00100000:1.0:1788835119.417559:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 208 00000100:00100000:1.0:1788835119.417569:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+30:11876:x1875729242482944:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:1.0:1788835119.417785:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d28fd lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.417802:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d28fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.417813:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d28fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788835119.417866:0:9047:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000004:00010000:1.0:1788835119.417900:0:9047:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006465e71a reply state 00000000cb2e22c4 transno 4294967476 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d28fd lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.417912:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d28fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.417920:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afc810b8a00) 00010000:00010000:1.0:1788835119.417923:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788835119.417926:0:9047:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1788835119.417971:0:9047:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967476 00000100:00100000:1.0:1788835119.418074:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83deb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+34:11876:x1875729242482944:12345-192.168.203.22@tcp:36:bash.0 Request processed in 506us (718us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1788835119.418082:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 208 00000020:00080000:1.0:1788835119.418087:0:9047:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1788835119.421521:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835119.421665:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242483072 00000100:00100000:3.0:1788835119.421694:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242483072 00000100:00100000:3.0:1788835119.421828:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 209 00000100:00100000:3.0:1788835119.421839:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+34:11876:x1875729242483072:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1788835119.421863:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835119.421894:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2904 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae07c4 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.421960:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2904 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07c4 expref: 35 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.421974:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2904 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07c4 expref: 35 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.421996:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afc810b8a00) 00010000:00010000:3.0:1788835119.422014:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788835119.422019:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884ab200, rc 0) 00000100:00100000:3.0:1788835119.422098:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+35:11876:x1875729242483072:12345-192.168.203.22@tcp:101:bash.0 Request processed in 259us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835119.422106:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 209 00000100:00100000:3.0:1788835119.424688:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835119.424786:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242483200 00000100:00100000:1.0:1788835119.424795:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242483200 00000100:00100000:1.0:1788835119.424855:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:1.0:1788835119.424865:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+7:11876:x1875729242483200:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1788835119.424940:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835119.424962:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000004b2f613/0xdf60171e5a5d290b lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae07cb expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788835119.424989:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f752e, atime: 0x6a9f752d, ctime: 0x6a9f752e, blocks: 0x8 00010000:00010000:1.0:1788835119.425072:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:1.0:1788835119.425077:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835119.425085:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000004b2f613/0xdf60171e5a5d290b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07cb expref: 8 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.425117:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000004b2f613/0xdf60171e5a5d290b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07cb expref: 8 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.425130:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc2166600, rc 0) 00000100:00100000:1.0:1788835119.425195:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+8:11876:x1875729242483200:12345-192.168.203.22@tcp:101:bash.0 Request processed in 332us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835119.425202:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:2.0:1788835119.429374:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835119.429458:0:8410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242483328 00000100:00100000:3.0:1788835119.429469:0:8410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242483328 00002000:00010000:3.0:1788835119.429511:0:8410:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1788835119.429516:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afc83de8380 with x1875729242483328 ext(0->18446744073709551615) 00002000:00010000:3.0:1788835119.429528:0:8410:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afc83de8380. 00000100:00100000:3.0:1788835119.429559:0:8410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:3.0:1788835119.429569:0:8410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83de8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b8987b33-76f7-43a0-9448-1013c4af787f+8:2387:x1875729242483328:12345-192.168.203.22@tcp:10:bash.0 00002000:00010000:3.0:1788835119.429834:0:8410:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1788835119.429838:0:8410:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb mtime from disk: 1788835118 -> 1788835120 00002000:00010000:3.0:1788835119.429841:0:8410:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb atime from disk: 1788835117 -> 1788835117 00002000:00010000:3.0:1788835119.429843:0:8410:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb ctime from disk: 1788835118 -> 1788835120 00002000:00010000:3.0:1788835119.429845:0:8410:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x5:0x0] updating lvb blocks from disk: 8 -> 0 00000100:00100000:3.0:1788835119.429898:0:8410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83de8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:b8987b33-76f7-43a0-9448-1013c4af787f+9:2387:x1875729242483328:12345-192.168.203.22@tcp:10:bash.0 Request processed in 330us (534us total) trans 4294967319 rc 0/0 00000100:00100000:3.0:1788835119.429906:0:8410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00002000:00010000:3.0:1788835119.429910:0:8410:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 11811161089/5 (0->18446744073709551615) 00002000:00100000:3.0:1788835119.429912:0:8410:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afc83de8380 with x1875729242483328 ext(0->18446744073709551615) 00002000:00010000:3.0:1788835119.429917:0:8410:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afc83de8380. 00000100:00100000:2.0:1788835119.515840:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835119.515941:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242483456 00000100:00100000:3.0:1788835119.515950:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242483456 00000100:00100000:3.0:1788835119.516019:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 210 00000100:00100000:3.0:1788835119.516029:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+35:12358:x1875729242483456:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:3.0:1788835119.516116:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2912 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516137:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2912 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516150:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2912 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516170:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2919 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516180:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2919 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516210:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2919 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516289:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2920 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516298:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2920 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516305:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2920 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1788835119.516413:0:6487:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2920 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516428:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2912 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516434:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2912 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516442:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2912 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516448:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aae00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835119.516453:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2912 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516461:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2912 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516476:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:3.0:1788835119.516485:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835119.516490:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2912 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516496:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2912 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516509:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2919 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516515:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2919 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516520:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2919 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516525:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aa400 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835119.516528:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2919 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516534:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2919 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516541:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afc810b8e00) 00010000:00010000:3.0:1788835119.516544:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835119.516546:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2919 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516551:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2919 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516564:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2920 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516576:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2920 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516581:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2920 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516586:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884abc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835119.516589:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2920 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516595:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2920 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516603:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afc810b8a00) 00010000:00010000:3.0:1788835119.516606:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835119.516608:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2920 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.516614:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2920 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835119.516695:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+35:12358:x1875729242483456:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 666us (862us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835119.516703:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 210 00000100:00100000:0.0:1788835119.588130:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835119.588223:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242483712 00000100:00100000:1.0:1788835119.588233:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242483712 00000100:00100000:1.0:1788835119.588294:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 211 00000100:00100000:1.0:1788835119.588305:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+35:12361:x1875729242483712:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788835119.588358:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835119.588383:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d2927 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae07d2 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588462:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167200/0xdf60171e5a5d292e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588477:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167200/0xdf60171e5a5d292e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588489:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167200/0xdf60171e5a5d292e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588505:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d2935 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588531:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d2935 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588539:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d2935 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588648:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d293c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588658:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d293c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588665:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d293c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835119.588674:0:9806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 0 00010000:00010000:1.0:1788835119.588740:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167200/0xdf60171e5a5d292e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588748:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167200/0xdf60171e5a5d292e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588755:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167200/0xdf60171e5a5d292e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588762:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc2167200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835119.588766:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167200/0xdf60171e5a5d292e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588773:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167200/0xdf60171e5a5d292e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588866:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:1.0:1788835119.588880:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835119.588886:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167200/0xdf60171e5a5d292e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588892:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167200/0xdf60171e5a5d292e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588910:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d2935 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588916:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d2935 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588923:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d2935 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588936:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc2167e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835119.588940:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d2935 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588947:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d2935 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588954:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afd93eb1a00) 00010000:00010000:1.0:1788835119.588965:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835119.588969:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d2935 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.588975:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d2935 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.589027:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d2927 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07d2 expref: 38 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.589044:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d293c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07d2 expref: 37 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.589051:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afc810b8a00) 00010000:00010000:1.0:1788835119.589054:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1788835119.589056:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61200, rc 0) 00000100:00100000:1.0:1788835119.589175:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+37:12361:x1875729242483712:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 871us (1054us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1788835119.589183:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 211 00010000:00010000:0.0:1788835119.591937:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835119.607426:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835119.609666:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242483840 00000100:00100000:3.0:1788835119.609682:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242483840 00000100:00100000:3.0:1788835119.609758:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 212 00000100:00100000:3.0:1788835119.609770:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+37:12361:x1875729242483840:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:3.0:1788835119.609850:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d294a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.609879:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28e1 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07b6 expref: 37 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.609890:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d294a lrc: 4/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.609923:0:6488:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07b6 expref: 37 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.609949:0:6488:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07b6 expref: 37 pid: 6488 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835119.609965:0:6488:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1875729254069888:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788835119.610066:0:6488:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda10bd600 going to sleep for 11 seconds 00000100:00100000:2.0:1788835119.615984:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835119.616057:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242484096 00000100:00100000:1.0:1788835119.616067:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242484096 00000100:00100000:1.0:1788835119.616134:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:1.0:1788835119.616144:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+38:6157:x1875729242484096:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1788835119.616483:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+39:6157:x1875729242484096:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 339us (508us total) trans 4294967479 rc 0/0 00000100:00100000:1.0:1788835119.616491:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:3.0:1788835119.619540:0:6488:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:6488:1875729254069888:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788835119.619569:0:6488:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d294a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835119.619580:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835119.619733:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242484224 00000100:00100000:2.0:1788835119.619740:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242484224 00010000:00010000:2.0:1788835119.619775:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07b6 expref: 39 pid: 6488 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835119.619814:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 96 00000100:00100000:2.0:1788835119.619823:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaae6b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+39:2386:x1875729242484224:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835119.619837:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835119.619844:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28e1 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07b6 expref: 39 pid: 6488 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.619856:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28e1 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07b6 expref: 39 pid: 6488 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.619879:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa200/0xdf60171e5a5d28e1 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xb:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07b6 expref: 39 pid: 6488 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.619894:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afc810b8a00) 00010000:00010000:2.0:1788835119.619899:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d294a lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.619909:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d294a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.619916:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d294a lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 7 type: IBT flags: 0x40290000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.619970:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835119.620020:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaae6b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+38:2386:x1875729242484224:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 196us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835119.620027:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 96 00010000:00010000:3.0:1788835119.620266:0:6488:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d294a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.620274:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d294a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.620339:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d294a lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.620349:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d294a lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.620363:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d294a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.620370:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884abc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835119.620375:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d294a lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.620383:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d294a lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.620393:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afc810b8a00) 00010000:00010000:3.0:1788835119.620397:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1788835119.620400:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d294a lrc: 2/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.620407:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d294a lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835119.622278:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+37:12361:x1875729242483840:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 12499us (14850us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835119.622294:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 212 00000100:00100000:1.0:1788835119.625638:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835119.625830:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242484480 00000100:00100000:2.0:1788835119.625839:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242484480 00000100:00100000:2.0:1788835119.625889:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:2.0:1788835119.625900:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+37:12361:x1875729242484480:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:2.0:1788835119.626167:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+38:12361:x1875729242484480:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 267us (536us total) trans 4294967480 rc 0/0 00000100:00100000:2.0:1788835119.626175:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:0.0:1788835119.714703:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835119.714787:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835119.715047:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242484736 00000100:00100000:3.0:1788835119.715051:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242484608 00000100:00100000:2.0:1788835119.715057:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242484736 00000100:00100000:3.0:1788835119.715058:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242484608 00002000:00100000:3.0:1788835119.715114:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->7) req@ffff9afc83f8f800 x1875729242484608/t0(0) o4->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:40/0 lens 496/0 e 0 to 0 dl 1788835130 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00000100:00100000:2.0:1788835119.715132:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 68 00002000:00100000:3.0:1788835119.715142:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afc83f8f800 with x1875729242484608 ext(0->7) 00000100:00100000:2.0:1788835119.715147:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+10:2385:x1875729242484736:12345-192.168.203.22@tcp:16:kworker.0 00002000:00010000:3.0:1788835119.715151:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afc83f8f800 00000100:00100000:3.0:1788835119.715188:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:3.0:1788835119.715201:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b8987b33-76f7-43a0-9448-1013c4af787f+10:2385:x1875729242484608:12345-192.168.203.22@tcp:4:bash.0 00000001:00080000:0.0:1788835119.718062:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:0.0:1788835119.718074:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967318 is committed 00000100:00100000:2.0:1788835119.718406:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+10:2385:x1875729242484736:12345-192.168.203.22@tcp:16:kworker.0 Request processed in 3257us (3614us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835119.718417:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:3.0:1788835119.719108:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f8f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b8987b33-76f7-43a0-9448-1013c4af787f+9:2385:x1875729242484608:12345-192.168.203.22@tcp:4:bash.0 Request processed in 3907us (4415us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1788835119.719118:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00002000:00100000:3.0:1788835119.719130:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x5:0x0] (0->7) req@ffff9afc83f8f800 x1875729242484608/t4294967320(0) o4->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:40/0 lens 496/448 e 0 to 0 dl 1788835130 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788835119.719141:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afc83f8f800 with x1875729242484608 ext(0->7) 00002000:00010000:3.0:1788835119.719147:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afc83f8f800 00000100:00100000:0.0:1788835119.740602:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835119.741153:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242484992 00000100:00100000:1.0:1788835119.741163:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242484992 00000100:00100000:1.0:1788835119.741225:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 213 00000100:00100000:1.0:1788835119.741235:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+38:12372:x1875729242484992:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:1.0:1788835119.741284:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835119.741306:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2951 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae07d9 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.741802:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2958 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.741952:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2958 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.741965:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2958 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.741982:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d295f lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.742058:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d295f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.742067:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d295f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.742185:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2966 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.742194:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2966 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.742201:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2966 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835119.742210:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xb:0x0]: returning size 8 00010000:00010000:1.0:1788835119.742522:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2958 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.742530:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2958 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.742541:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2958 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.742547:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835119.742551:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2958 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.742559:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2958 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.742572:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:1.0:1788835119.742575:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835119.742579:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2958 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.742585:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d2958 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.742598:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d295f lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.742604:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d295f lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.742610:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d295f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.742615:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835119.742625:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d295f lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.742631:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d295f lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.742639:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afd93eb1a00) 00010000:00010000:1.0:1788835119.742642:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835119.742645:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d295f lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.742650:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d295f lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.742705:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61000/0xdf60171e5a5d2951 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07d9 expref: 41 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.743065:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2966 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07d9 expref: 40 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.743075:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afc810b8a00) 00010000:00010000:1.0:1788835119.743078:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788835119.743081:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60c00, rc 0) 00000100:00100000:1.0:1788835119.743206:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+40:12372:x1875729242484992:12345-192.168.203.22@tcp:101:cat.0 Request processed in 1972us (2613us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1788835119.743215:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 213 00000100:00100000:0.0:1788835119.749108:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835119.749558:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242485248 00000100:00100000:3.0:1788835119.749568:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242485248 00000100:00100000:3.0:1788835119.749626:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:3.0:1788835119.749636:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+40:12372:x1875729242485248:12345-192.168.203.22@tcp:35:cat.0 00000100:00100000:3.0:1788835119.750260:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+41:12372:x1875729242485248:12345-192.168.203.22@tcp:35:cat.0 Request processed in 623us (1161us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1788835119.750269:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:0.0:1788835119.775783:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835119.775965:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242485504 00000100:00100000:3.0:1788835119.775974:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242485504 00000100:00100000:3.0:1788835119.776100:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 214 00000100:00100000:3.0:1788835119.776110:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+41:12373:x1875729242485504:12345-192.168.203.22@tcp:36:rm.0 00010000:00010000:3.0:1788835119.776160:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 4 locks, starting at 0 00010000:00010000:3.0:1788835119.776184:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2904 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xb:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07c4 expref: 41 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.776203:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2966 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07d9 expref: 40 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.776234:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d293c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07d2 expref: 39 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.776539:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aaa00/0xdf60171e5a5d28f6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07bd expref: 38 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.776551:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afc810b8a00) 00010000:00010000:3.0:1788835119.776555:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788835119.776646:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2974 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.776660:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2974 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.776669:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2974 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.776695:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d297b lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.776702:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d297b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.776709:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d297b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.776793:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2982 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.776801:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2982 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.776807:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2982 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788835119.777160:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:2.0:1788835119.777170:0:6489:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361818853901ns, next at 362818851471ns, rc = 0 00010000:00010000:2.0:1788835119.777216:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2989 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777225:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2989 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777232:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2989 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777238:0:6489:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2989 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777270:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2989 lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777275:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2989 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777299:0:6489:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788835119.777344:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2982 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777351:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2982 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777356:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2982 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777361:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374dc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835119.777365:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2982 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777372:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2982 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777382:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afc810b8a00) 00010000:00010000:2.0:1788835119.777385:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1788835119.777388:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2982 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777394:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2982 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xb:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777571:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2974 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777585:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2974 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777590:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2974 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777594:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835119.777598:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2974 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777604:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2974 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777613:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:2.0:1788835119.777616:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835119.777618:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2974 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777624:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2974 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788835119.777634:0:6489:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007a327647 reply state 0000000083ae2bef transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d297b lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777645:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d297b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.777651:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afda01ecc00) 00010000:00010000:2.0:1788835119.777653:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788835119.777656:0:6489:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788835119.777743:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+39:12373:x1875729242485504:12345-192.168.203.22@tcp:36:rm.0 Request processed in 1633us (1971us total) trans 4294967483 rc 0/0 00000100:00100000:2.0:1788835119.777758:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 214 00010000:00010000:3.0:1788835119.777985:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788835119.778070:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2989 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.778078:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374c000 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:3.0:1788835119.778081:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2989 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.778087:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2989 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.778099:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afc810b8a00) 00010000:00010000:3.0:1788835119.778102:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1788835119.778105:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2989 lrc: 1/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.778110:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2989 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.778120:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835119.778122:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835119.778131:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835119.845015:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835119.845174:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242485760 00000100:00100000:2.0:1788835119.845184:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242485760 00000100:00100000:2.0:1788835119.845242:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 215 00000100:00100000:2.0:1788835119.845263:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+39:12379:x1875729242485760:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1788835119.845290:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835119.845355:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2990 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae07e0 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.845457:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2997 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.845472:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2997 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.845483:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2997 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.845494:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d299e lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.845500:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d299e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.845507:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d299e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788835119.845848:0:6488:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x5:0x0], index 0: 0 00010000:00010000:2.0:1788835119.846005:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d29a5 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.846026:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d29a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.846034:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d29a5 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.846075:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2997 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.846083:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2997 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.846090:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2997 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.846096:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374dc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835119.846100:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2997 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.846109:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2997 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.846122:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:2.0:1788835119.846125:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835119.846130:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2997 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.846137:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2997 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788835119.846151:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d1e43d4a reply state 00000000b2389540 transno 4294967484 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d299e lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.846172:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d299e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.846179:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afda01ecc00) 00010000:00010000:2.0:1788835119.846182:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788835119.846184:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788835119.846215:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2990 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07e0 expref: 42 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.846230:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d29a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07e0 expref: 41 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.846237:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afda01ec400) 00010000:00010000:2.0:1788835119.846239:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788835119.846242:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374ce00, rc 0) 00000100:00100000:2.0:1788835119.847210:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+42:12379:x1875729242485760:12345-192.168.203.22@tcp:101:bash.0 Request processed in 1951us (2199us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1788835119.847221:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 215 00000100:00100000:0.0:1788835119.857736:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835119.858525:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242485888 00000100:00100000:3.0:1788835119.858537:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242485888 00000100:00100000:3.0:1788835119.858617:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:3.0:1788835119.858636:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+7:2385:x1875729242485888:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1788835119.858656:0:8402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835119.858675:0:8402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012ebc248/0xdf60171e5a5d29b3 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae07e7 expref: -99 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788835119.858701:0:8402:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000100:00080000:0.0:1788835119.858972:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1788835119.859063:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=361s v=(0 0) 00010000:00010000:3.0:1788835119.859069:0:8402:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835119.859080:0:8402:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012ebc248/0xdf60171e5a5d29b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07e7 expref: 8 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.859102:0:8402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000012ebc248/0xdf60171e5a5d29b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07e7 expref: 8 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835119.859115:0:8402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884aaa00, rc 0) 00000100:00100000:3.0:1788835119.859212:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+8:2385:x1875729242485888:12345-192.168.203.22@tcp:101:bash.0 Request processed in 586us (1497us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835119.859219:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:3.0:1788835119.862432:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835119.862596:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242486016 00000100:00100000:1.0:1788835119.862608:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242486016 00000100:00100000:1.0:1788835119.862682:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:1.0:1788835119.862692:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+8:12379:x1875729242486016:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1788835119.862730:0:9814:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835119.862751:0:9814:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d29ba lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae07ee expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.862783:0:9814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000012ebc248/0xdf60171e5a5d29b3 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07e7 expref: 9 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.862792:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835119.862796:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835119.862801:0:9814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d29ba lrc: 4/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07ee expref: 9 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.862842:0:9814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000012ebc248/0xdf60171e5a5d29b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07e7 expref: 9 pid: 8402 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.862857:0:9814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000012ebc248/0xdf60171e5a5d29b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07e7 expref: 9 pid: 8402 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835119.862881:0:9814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb91880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9814:1875729254070016:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788835119.862988:0:9814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788835119.866398:0:9814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb91880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:9814:1875729254070016:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788835119.866977:0:9814:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d29ba lrc: 3/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07ee expref: 9 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835119.867211:0:9814:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61000, rc 0) 00000100:00100000:1.0:1788835119.867295:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+9:12379:x1875729242486016:12345-192.168.203.22@tcp:101:bash.0 Request processed in 4602us (4871us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835119.867304:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 70 00000100:00100000:0.0:1788835119.869236:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835119.869345:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242486144 00000100:00100000:2.0:1788835119.869353:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242486144 00010000:00010000:2.0:1788835119.869391:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000012ebc248/0xdf60171e5a5d29b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07e7 expref: 9 pid: 8402 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835119.869440:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00100000:2.0:1788835119.869449:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+9:2386:x1875729242486144:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835119.869463:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835119.869498:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000012ebc248/0xdf60171e5a5d29b3 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07e7 expref: 9 pid: 8402 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.869512:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000012ebc248/0xdf60171e5a5d29b3 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07e7 expref: 9 pid: 8402 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.869534:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012ebc248/0xdf60171e5a5d29b3 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07e7 expref: 9 pid: 8402 timeout: 461 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.869550:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835119.869555:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835119.869564:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d29ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07ee expref: 8 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.869573:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d29ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07ee expref: 8 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835119.869608:0:6474:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d29ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07ee expref: 8 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835119.869622:0:6474:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6474:1875729254070144:192.168.203.22@tcp:105: 00000100:00100000:2.0:1788835119.869704:0:6474:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc83672240 going to sleep for 11 seconds 00000100:00100000:2.0:1788835119.872380:0:6474:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fe680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:6474:1875729254070144:192.168.203.22@tcp:105: 00010000:00010000:2.0:1788835119.872418:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835119.872460:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844ab100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+8:2386:x1875729242486144:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 3012us (3232us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835119.872486:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 97 00000100:00100000:1.0:1788835119.874263:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835119.874517:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242486400 00000100:00100000:2.0:1788835119.874524:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242486400 00000100:00100000:2.0:1788835119.874574:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:2.0:1788835119.874584:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+42:12379:x1875729242486400:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:2.0:1788835119.875110:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+43:12379:x1875729242486400:12345-192.168.203.22@tcp:35:bash.0 Request processed in 524us (852us total) trans 4294967485 rc 0/0 00000100:00100000:2.0:1788835119.875118:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:0.0:1788835120.041346:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835120.041552:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242486528 00000100:00100000:1.0:1788835120.041563:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242486528 00000100:00100000:1.0:1788835120.041632:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 216 00000100:00100000:1.0:1788835120.041642:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+43:12395:x1875729242486528:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788835120.041665:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835120.041686:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d29c1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae07f5 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.041749:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d29c8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.041765:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d29c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.041779:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d29c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835120.041821:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788835120.041824:0:9047:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835120.041843:0:9047:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d29c8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.041868:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d29c1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07f5 expref: 45 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.047442:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d29c8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07f5 expref: 44 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.047478:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:1.0:1788835120.047482:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788835120.047486:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61e00, rc 0) 00000100:00100000:1.0:1788835120.047575:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+44:12395:x1875729242486528:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 5933us (6325us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835120.047585:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 216 00000100:00100000:0.0:1788835120.056688:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835120.056811:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242486784 00000100:00100000:2.0:1788835120.056821:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242486784 00000100:00100000:2.0:1788835120.056885:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 217 00000100:00100000:2.0:1788835120.056894:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+44:12395:x1875729242486784:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788835120.056915:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835120.056941:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d29cf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae07fc expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.057053:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d29d6 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.057066:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d29d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.057076:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d29d6 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835120.057085:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788835120.057174:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d29cf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07fc expref: 47 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.057209:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d29d6 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07fc expref: 46 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.057218:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afda01ec400) 00010000:00010000:2.0:1788835120.057221:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788835120.057224:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374dc00, rc 0) 00000100:00100000:2.0:1788835120.057592:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+46:12395:x1875729242486784:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 697us (910us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1788835120.057599:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 217 00000100:00100000:3.0:1788835120.062545:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835120.067375:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835120.067521:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242487168 00000100:00100000:1.0:1788835120.067531:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242487168 00000100:00100000:1.0:1788835120.067601:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:1.0:1788835120.067611:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+46:2386:x1875729242487168:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788835120.067625:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835120.067648:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d29d6 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07fc expref: 46 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.067667:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afda01ec400) 00010000:00010000:1.0:1788835120.067672:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788835120.067731:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+45:2386:x1875729242487168:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 121us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835120.067739:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:2.0:1788835120.069471:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242487040 00000100:00100000:2.0:1788835120.069487:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242487040 00000100:00100000:2.0:1788835120.069586:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 218 00000100:00100000:2.0:1788835120.069596:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+45:12395:x1875729242487040:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788835120.069620:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835120.069640:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d29e4 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0803 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.069744:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d29eb lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.069759:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d29eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.069771:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d29eb lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835120.069784:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:2.0:1788835120.069899:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d29e4 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0803 expref: 48 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.069916:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d29eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0803 expref: 47 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.069935:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afda01ec400) 00010000:00010000:2.0:1788835120.069938:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1788835120.069941:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374cc00, rc 0) 00000100:00100000:2.0:1788835120.070021:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+47:12395:x1875729242487040:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 425us (7622us total) trans 4294967487 rc 0/0 00000100:00100000:2.0:1788835120.070028:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 218 00000100:00100000:0.0:1788835120.078528:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835120.080374:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242487296 00000100:00100000:1.0:1788835120.080389:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242487296 00000100:00100000:1.0:1788835120.080531:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:1.0:1788835120.080673:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+8:2386:x1875729242487296:12345-192.168.203.22@tcp:1:lfs.0 00010000:00010000:1.0:1788835120.080719:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ef9724d/0xdf60171e5a5d29f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.080757:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d29ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07ee expref: 8 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.080766:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000401:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1788835120.080770:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1788835120.080775:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ef9724d/0xdf60171e5a5d29f9 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.080811:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d29ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07ee expref: 8 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.080826:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d29ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07ee expref: 8 pid: 9814 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835120.080989:0:8405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1875729254070272:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788835120.081093:0:8405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b2540 going to sleep for 11 seconds 00000100:00100000:1.0:1788835120.083923:0:8405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb92d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:8405:1875729254070272:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788835120.083963:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000007ef9724d/0xdf60171e5a5d29f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835120.084857:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835120.085757:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242487424 00000100:00100000:2.0:1788835120.085766:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242487424 00002000:00100000:3.0:1788835120.085970:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9afc844ab480 x1875729242487424/t0(0) o4->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:41/0 lens 504/0 e 0 to 0 dl 1788835131 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788835120.089568:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afc844ab480 with x1875729242487424 ext(0->8) 00010000:00010000:3.0:1788835120.089586:0:8408:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d29ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07ee expref: 9 pid: 9814 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.089608:0:8408:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d29ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07ee expref: 9 pid: 9814 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788835120.089617:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9afc844ab480 00000100:00100000:3.0:1788835120.089656:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:3.0:1788835120.089671:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b8987b33-76f7-43a0-9448-1013c4af787f+9:2385:x1875729242487424:12345-192.168.203.22@tcp:4:lfs.0 00000100:00100000:3.0:1788835120.090807:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b8987b33-76f7-43a0-9448-1013c4af787f+11:2385:x1875729242487424:12345-192.168.203.22@tcp:4:lfs.0 Request processed in 1136us (5947us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1788835120.090817:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00002000:00100000:3.0:1788835120.090827:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x280000401:0x5:0x0] (0->8) req@ffff9afc844ab480 x1875729242487424/t4294967309(0) o4->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:41/0 lens 504/448 e 0 to 0 dl 1788835131 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788835120.090837:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afc844ab480 with x1875729242487424 ext(0->8) 00010000:00010000:3.0:1788835120.090846:0:8408:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d29ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07ee expref: 11 pid: 9814 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.090860:0:8408:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d29ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07ee expref: 11 pid: 9814 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788835120.090868:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9afc844ab480 00000100:00100000:1.0:1788835120.094890:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835120.094952:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242487552 00000100:00100000:0.0:1788835120.094963:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242487552 00010000:00010000:0.0:1788835120.095221:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d29ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07ee expref: 11 pid: 9814 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835120.095350:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 98 00000100:00100000:0.0:1788835120.095360:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+11:2385:x1875729242487552:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788835120.095376:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1788835120.095394:0:6473:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1788835120.095397:0:6473:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb mtime from disk: 0 -> 1788835120 00002000:00010000:0.0:1788835120.095399:0:6473:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb atime from disk: 0 -> 1788835121 00002000:00010000:0.0:1788835120.095401:0:6473:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb ctime from disk: 0 -> 1788835120 00002000:00010000:0.0:1788835120.095403:0:6473:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x5:0x0] updating lvb blocks from disk: 0 -> 8 00010000:00010000:0.0:1788835120.095409:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d29ba lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07ee expref: 11 pid: 9814 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.095423:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d29ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07ee expref: 11 pid: 9814 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.095446:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d29ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07ee expref: 11 pid: 9814 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.095464:0:6473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788835120.095468:0:6473:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788835120.095473:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000007ef9724d/0xdf60171e5a5d29f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.095501:0:6473:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ef9724d/0xdf60171e5a5d29f9 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.095539:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835120.095601:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+10:2385:x1875729242487552:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 243us (722us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835120.095609:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 98 00010000:00010000:1.0:1788835120.095672:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000007ef9724d/0xdf60171e5a5d29f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.095693:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ef9724d/0xdf60171e5a5d29f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.095714:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ef9724d/0xdf60171e5a5d29f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.095734:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ef9724d/0xdf60171e5a5d29f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.095744:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ef9724d/0xdf60171e5a5d29f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.095750:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:1.0:1788835120.095754:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ef9724d/0xdf60171e5a5d29f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.095764:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ef9724d/0xdf60171e5a5d29f9 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.095776:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ef9724d/0xdf60171e5a5d29f9 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.095783:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ef9724d/0xdf60171e5a5d29f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835120.097005:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+9:2386:x1875729242487296:12345-192.168.203.22@tcp:1:lfs.0 Request processed in 16457us (18480us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835120.097018:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 71 00000100:00100000:1.0:1788835120.100011:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835120.100201:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242487808 00000100:00100000:2.0:1788835120.100212:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242487808 00000100:00100000:2.0:1788835120.100292:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:2.0:1788835120.100303:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84e64850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+47:12395:x1875729242487808:12345-192.168.203.22@tcp:35:lfs.0 00000004:00010000:2.0:1788835120.100602:0:6491:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000402:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d29eb lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0803 expref: 47 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1788835120.100774:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:2.0:1788835120.100804:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:2.0:1788835120.101576:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00010000:00010000:2.0:1788835120.101627:0:6491:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2a00 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.101644:0:6491:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d29a5 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07e0 expref: 51 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.101667:0:6491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2a00 lrc: 4/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.101704:0:6491:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d29a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07e0 expref: 51 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.101718:0:6491:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d29a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07e0 expref: 51 pid: 6488 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835120.101733:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fe680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6491:1875729254070400:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788835120.102184:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb34b8a80 going to sleep for 11 seconds 00000100:00100000:2.0:1788835120.105327:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fe680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:6491:1875729254070400:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788835120.105361:0:6491:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2a00 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835120.107657:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835120.108270:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242487936 00000100:00100000:2.0:1788835120.108280:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242487936 00010000:00010000:2.0:1788835120.108350:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d29a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07e0 expref: 52 pid: 6488 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835120.108385:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 99 00000100:00100000:2.0:1788835120.108394:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+52:2386:x1875729242487936:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835120.108413:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835120.108420:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d29a5 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07e0 expref: 52 pid: 6488 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.108451:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d29a5 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07e0 expref: 52 pid: 6488 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.108473:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d29a5 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07e0 expref: 52 pid: 6488 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.108488:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afda01ec400) 00010000:00010000:2.0:1788835120.108493:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2a00 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.108501:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2a00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.108508:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2a00 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.108538:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835120.108589:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb93800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+51:2386:x1875729242487936:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 196us (940us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835120.108596:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 99 00010000:00010000:0.0:1788835120.108743:0:6491:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2a00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.108752:0:6491:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2a00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788835120.108854:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000001:00080000:0.0:1788835120.109710:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:0.0:1788835120.109819:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6491:1875729254070528:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788835120.109881:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835120.109914:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd91672780 going to sleep for 11 seconds 00000100:00100000:2.0:1788835120.109960:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254070528 00000100:00100000:2.0:1788835120.109968:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254070528 00000100:00100000:2.0:1788835120.110023:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:2.0:1788835120.110032:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6491:x1875729254070528:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:0.0:1788835120.110094:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788835120.110333:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:6491:x1875729254070528:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 284us (432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835120.110339:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1788835120.110488:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6491:1875729254070528:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788835120.110605:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00000100:00100000:0.0:1788835120.110645:0:6491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6491:1875729254070656:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1788835120.110673:0:6491:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835120.110693:0:6491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd91672f00 going to sleep for 11 seconds 00000100:00100000:2.0:1788835120.110774:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254070656 00000100:00100000:2.0:1788835120.110779:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254070656 00000100:00100000:2.0:1788835120.110815:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1788835120.110823:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:6491:x1875729254070656:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1788835120.110943:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:6491:x1875729254070656:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 120us (268us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1788835120.110951:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1788835120.110965:0:6491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a9c00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:6491:1875729254070656:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1788835120.111077:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:0.0:1788835120.111119:0:6491:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2a00 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.111130:0:6491:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2a00 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.111138:0:6491:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2a00 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.111144:0:6491:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835120.111148:0:6491:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2a00 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.111156:0:6491:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2a00 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.111171:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afda01ec400) 00010000:00010000:0.0:1788835120.111174:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1788835120.111178:0:6491:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2a00 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.111185:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2a00 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6491 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788835120.111551:0:6491:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1788835120.111614:0:6491:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:0.0:1788835120.111626:0:6491:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 362153309959ns, next at 363153307481ns, rc = 0 00000001:00080000:0.0:1788835120.111633:0:6491:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967495 00010000:00010000:0.0:1788835120.111659:0:6491:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afda01ec400) 00010000:00010000:0.0:1788835120.111662:0:6491:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1788835120.111670:0:6491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d29eb lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0803 expref: 55 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835120.111824:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84e64850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+54:12395:x1875729242487808:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 11522us (11822us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1788835120.111833:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 56 00000020:00080000:0.0:1788835120.111837:0:6491:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1788835120.118772:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835120.118859:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242488064 00000100:00100000:3.0:1788835120.118891:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242488064 00000100:00100000:3.0:1788835120.118957:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 219 00000100:00100000:3.0:1788835120.118967:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+54:12395:x1875729242488064:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788835120.118998:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835120.119021:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2a07 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae080a expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.119075:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2a07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae080a expref: 55 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.119088:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2a07 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae080a expref: 55 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.119302:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:3.0:1788835120.119306:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788835120.119309:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884abc00, rc 0) 00000100:00100000:3.0:1788835120.119520:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+55:12395:x1875729242488064:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 553us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835120.119527:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 219 00000100:00100000:1.0:1788835120.122828:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835120.123043:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242488320 00000100:00100000:3.0:1788835120.123052:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242488320 00000100:00100000:3.0:1788835120.123104:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:3.0:1788835120.123113:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+55:12395:x1875729242488320:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1788835120.123711:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+56:12395:x1875729242488320:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 596us (889us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1788835120.123719:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:2.0:1788835120.218962:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835120.219729:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242488448 00000100:00100000:0.0:1788835120.219740:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242488448 00000100:00100000:0.0:1788835120.219814:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 220 00000100:00100000:0.0:1788835120.219825:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+56:12405:x1875729242488448:12345-192.168.203.22@tcp:34:lfs.0 00010000:00010000:0.0:1788835120.219903:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a0e lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.219921:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a0e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.219950:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a0e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.219962:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a15 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.219970:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.219977:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220065:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a1c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220092:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220100:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788835120.220155:0:9806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220169:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a0e lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220175:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a0e lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220182:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220189:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835120.220192:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a0e lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220199:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a0e lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220212:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:0.0:1788835120.220215:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835120.220220:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a0e lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220232:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a0e lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220255:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a15 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220261:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a15 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220267:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220272:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835120.220290:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a15 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220296:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a15 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220304:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afda01ecc00) 00010000:00010000:0.0:1788835120.220306:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835120.220309:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a15 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220360:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a15 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220372:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a1c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220378:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a1c lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220384:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.220396:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835120.220399:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a1c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.221297:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a1c lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.221311:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:0.0:1788835120.221337:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835120.221342:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a1c lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.221349:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a1c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835120.221517:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+56:12405:x1875729242488448:12345-192.168.203.22@tcp:34:lfs.0 Request processed in 1691us (2562us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835120.221527:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 220 00000100:00100000:2.0:1788835120.226921:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835120.226982:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835120.227032:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835120.227065:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835120.227084:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835120.227100:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835120.227121:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835120.227150:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242488832 00000100:00100000:2.0:1788835120.227159:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242488832 00000100:00100000:2.0:1788835120.227211:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242489344 00000100:00100000:2.0:1788835120.227215:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242489344 00000100:00100000:2.0:1788835120.227230:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242488704 00000100:00100000:2.0:1788835120.227233:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242488704 00000100:00100000:2.0:1788835120.227243:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242489216 00000100:00100000:2.0:1788835120.227245:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242489216 00000100:00100000:2.0:1788835120.227263:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 318 00000100:00100000:2.0:1788835120.227273:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242488832:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835120.227383:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242488832:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 111us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835120.227523:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242488576 00000100:00100000:3.0:1788835120.227534:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242488576 00000100:00100000:3.0:1788835120.227571:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 389 00000100:00100000:3.0:1788835120.227579:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:2386:x1875729242488576:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835120.227608:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7282450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:2386:x1875729242488576:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 31us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835120.227615:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 389 00000100:00100000:3.0:1788835120.227655:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 319 00000100:00100000:3.0:1788835120.227662:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242489344:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835120.227706:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242489344:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 44us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835120.227714:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 319 00000100:00100000:3.0:1788835120.227735:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 320 00000100:00100000:3.0:1788835120.227742:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+56:2386:x1875729242488704:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835120.227766:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+56:2386:x1875729242488704:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (681us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835120.227772:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 320 00000100:00100000:3.0:1788835120.227783:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 321 00000100:00100000:3.0:1788835120.227789:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242489216:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835120.227812:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242489216:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835120.227818:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 321 00000100:00080000:0.0:1788835120.228241:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788835120.228248:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788835120.228621:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242489088 00000100:00100000:1.0:1788835120.228628:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242489088 00000100:00100000:1.0:1788835120.228676:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242488960 00000100:00100000:1.0:1788835120.228680:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242488960 00000100:00100000:1.0:1788835120.228707:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:1.0:1788835120.228714:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+9:2386:x1875729242489088:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835120.228765:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+9:2386:x1875729242489088:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 51us (1732us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835120.228772:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:1.0:1788835120.228787:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:1.0:1788835120.228793:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+9:2386:x1875729242488960:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835120.228816:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+9:2386:x1875729242488960:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 24us (1715us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835120.228822:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00080000:0.0:1788835120.228966:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788835120.230181:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 318 00000100:00100000:2.0:1788835120.309998:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835120.310112:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242489600 00000100:00100000:3.0:1788835120.310122:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242489600 00000100:00100000:3.0:1788835120.310244:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 221 00000100:00100000:3.0:1788835120.310271:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+56:12408:x1875729242489600:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:3.0:1788835120.310294:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835120.310343:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2a23 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0811 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.310418:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2a2a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.310443:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2a2a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.310455:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2a2a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.310467:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a31 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.310474:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.310480:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.310589:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2a38 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.310608:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2a38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.310616:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2a38 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835120.310836:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:3.0:1788835120.310936:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2a2a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.310944:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2a2a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.310951:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2a2a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.310958:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aa400 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835120.310963:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2a2a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.310971:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2a2a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.310983:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:3.0:1788835120.310987:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835120.310991:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2a2a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.310998:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2a2a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.311011:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a31 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.311016:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a31 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.311033:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.311038:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aae00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835120.311041:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a31 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.311048:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a31 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.311057:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afda01ecc00) 00010000:00010000:3.0:1788835120.311059:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835120.311062:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a31 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.311068:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a31 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.311104:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2a23 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0811 expref: 59 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.311116:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2a38 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0811 expref: 58 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.311123:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:3.0:1788835120.311125:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1788835120.311127:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884ab000, rc 0) 00000100:00100000:3.0:1788835120.311418:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+58:12408:x1875729242489600:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1148us (1427us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1788835120.311437:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 221 00000100:00100000:1.0:1788835120.315304:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835120.317017:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242489728 00000100:00100000:0.0:1788835120.317030:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242489728 00000100:00100000:0.0:1788835120.317267:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 222 00000100:00100000:0.0:1788835120.317280:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+58:12408:x1875729242489728:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:0.0:1788835120.317375:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a46 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.317393:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.317430:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.317465:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a46 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.317473:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a46 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.317481:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.317487:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835120.317491:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a46 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.317498:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a46 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.317510:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:0.0:1788835120.317513:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788835120.317517:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a46 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.317524:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a46 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835120.317608:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+58:12408:x1875729242489728:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 331us (2312us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835120.317616:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 222 00000100:00100000:2.0:1788835120.327422:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835120.327812:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242489984 00000100:00100000:3.0:1788835120.327822:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242489984 00000100:00100000:3.0:1788835120.327884:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:3.0:1788835120.327896:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+58:12408:x1875729242489984:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1788835120.328169:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+59:12408:x1875729242489984:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 275us (755us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1788835120.328177:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:2.0:1788835120.447843:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835120.447957:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242490240 00000100:00100000:0.0:1788835120.447981:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242490240 00000100:00100000:0.0:1788835120.448043:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 223 00000100:00100000:0.0:1788835120.448053:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+59:12418:x1875729242490240:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1788835120.448078:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835120.448081:0:6489:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1788835120.448109:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d29c8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07f5 expref: 59 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.448129:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:0.0:1788835120.448133:0:6489:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788835120.448147:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a4d lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0818 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.448250:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a54 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.448263:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.448272:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a54 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788835120.448282:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 9 00010000:00010000:0.0:1788835120.448437:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2a4d lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0818 expref: 61 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.448453:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a54 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0818 expref: 60 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.448461:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:0.0:1788835120.448471:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788835120.448474:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f4600, rc 0) 00000100:00100000:0.0:1788835120.448537:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+60:12418:x1875729242490240:12345-192.168.203.22@tcp:101:bash.0 Request processed in 485us (705us total) trans 4294967500 rc 0/0 00000100:00100000:0.0:1788835120.448544:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 223 00000100:00100000:2.0:1788835120.451904:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835120.452008:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242490368 00000100:00100000:3.0:1788835120.452018:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242490368 00000100:00100000:3.0:1788835120.452079:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 224 00000100:00100000:3.0:1788835120.452089:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+60:12418:x1875729242490368:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1788835120.452111:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835120.452131:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2a62 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae081f expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.452170:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a69 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.452185:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.452197:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a69 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.452370:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2a62 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae081f expref: 62 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.452402:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae081f expref: 61 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.452410:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:3.0:1788835120.452413:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788835120.452416:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884aae00, rc 0) 00000100:00100000:3.0:1788835120.452583:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+61:12418:x1875729242490368:12345-192.168.203.22@tcp:101:bash.0 Request processed in 495us (687us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835120.452591:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 224 00000100:00100000:3.0:1788835120.455816:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835120.455911:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242490624 00000100:00100000:0.0:1788835120.455921:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242490624 00000100:00100000:0.0:1788835120.455997:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 225 00000100:00100000:0.0:1788835120.456007:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+61:12418:x1875729242490624:12345-192.168.203.22@tcp:36:bash.0 00010000:00010000:0.0:1788835120.456058:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1788835120.456086:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a54 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0818 expref: 61 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.456111:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2a38 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0811 expref: 60 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.456122:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:0.0:1788835120.456126:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788835120.456296:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a70 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.456310:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.456344:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1788835120.456385:0:6488:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967501 00000004:00010000:0.0:1788835120.456770:0:6488:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004db6d7ac reply state 000000007614d97f transno 4294967502 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a70 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.456799:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.456806:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:0.0:1788835120.456809:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788835120.456811:0:6488:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788835120.456966:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+62:12418:x1875729242490624:12345-192.168.203.22@tcp:36:bash.0 Request processed in 957us (1155us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1788835120.456973:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 225 00000020:00080000:0.0:1788835120.456979:0:6488:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1788835120.462159:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835120.462380:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242490752 00000100:00100000:0.0:1788835120.462392:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242490752 00000100:00100000:0.0:1788835120.462459:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 226 00000100:00100000:0.0:1788835120.462469:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+62:12418:x1875729242490752:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:0.0:1788835120.462490:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835120.462509:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d2a77 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0826 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.462589:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2a7e lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.462604:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2a7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.462616:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2a7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788835120.462652:0:9806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788835120.462657:0:9806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788835120.462693:0:9806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2a7e lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.462721:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d2a77 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0826 expref: 64 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.462738:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2a7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0826 expref: 63 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.462745:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:0.0:1788835120.462749:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788835120.462752:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5000, rc 0) 00000100:00100000:0.0:1788835120.462828:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+63:12418:x1875729242490752:12345-192.168.203.22@tcp:101:bash.0 Request processed in 361us (679us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835120.462834:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 226 00000100:00100000:2.0:1788835120.473251:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835120.473385:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242491008 00000100:00100000:3.0:1788835120.473396:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242491008 00000100:00100000:3.0:1788835120.473454:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:3.0:1788835120.473464:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+63:12418:x1875729242491008:12345-192.168.203.22@tcp:35:bash.0 00000100:00100000:3.0:1788835120.473702:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+64:12418:x1875729242491008:12345-192.168.203.22@tcp:35:bash.0 Request processed in 238us (460us total) trans 4294967503 rc 0/0 00000100:00100000:3.0:1788835120.473710:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:3.0:1788835120.545706:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835120.545820:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242491136 00000100:00100000:1.0:1788835120.545830:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242491136 00000100:00100000:1.0:1788835120.545904:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 227 00000100:00100000:1.0:1788835120.546047:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+64:12424:x1875729242491136:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788835120.546085:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835120.546107:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2a85 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae082d expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.546190:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2a8c lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.546205:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2a8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.546217:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2a8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835120.546265:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xa:0x0]: returning size 4096 00000004:00200000:1.0:1788835120.546269:0:9047:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835120.546289:0:9047:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2a8c lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.546361:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2a85 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae082d expref: 66 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.546380:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2a8c lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae082d expref: 65 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.546389:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:1.0:1788835120.546392:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788835120.546396:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61e00, rc 0) 00000100:00100000:1.0:1788835120.546503:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+65:12424:x1875729242491136:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 562us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835120.546511:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 227 00000100:00100000:2.0:1788835120.553002:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835120.553065:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242491264 00000100:00100000:0.0:1788835120.553074:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242491264 00000100:00100000:0.0:1788835120.553134:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 228 00000100:00100000:0.0:1788835120.553146:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+65:12424:x1875729242491264:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788835120.553166:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835120.553187:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d2a93 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0834 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553261:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a9a lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553274:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a9a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553286:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a9a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553310:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2aa1 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553337:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553344:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553407:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2aa8 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553415:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553422:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788835120.553458:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:0.0:1788835120.553462:0:6488:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788835120.553478:0:6488:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553489:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2aa8 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553497:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a9a lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553503:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a9a lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553518:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a9a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553525:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835120.553529:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a9a lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553536:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a9a lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553548:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:0.0:1788835120.553551:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835120.553566:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a9a lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553572:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4600/0xdf60171e5a5d2a9a lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553585:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2aa1 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553591:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2aa1 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553597:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553602:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835120.553604:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2aa1 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553618:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2aa1 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553626:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afda01ecc00) 00010000:00010000:0.0:1788835120.553628:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835120.553631:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2aa1 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553636:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2aa1 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553659:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d2a93 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0834 expref: 67 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553670:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0834 expref: 66 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.553678:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:0.0:1788835120.553680:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788835120.553682:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f4a00, rc 0) 00000100:00100000:0.0:1788835120.553741:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+66:12424:x1875729242491264:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 598us (757us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835120.553748:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 228 00000100:00100000:2.0:1788835120.560192:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835120.560289:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835120.560403:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242491520 00000100:00100000:0.0:1788835120.560414:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242491520 00000100:00100000:0.0:1788835120.560463:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 229 00000100:00100000:0.0:1788835120.560472:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+66:12424:x1875729242491520:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788835120.560507:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835120.560527:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d2aaf lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae083b expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.560654:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2ab6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.560670:0:9806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2a7e lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0826 expref: 67 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.560680:0:9806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2aa8 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0834 expref: 67 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.560689:0:9806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2ab6 lrc: 5/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.560721:0:9806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2aa8 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0834 expref: 67 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.560733:0:9806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2aa8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0834 expref: 67 pid: 6488 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835120.560748:0:9806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9806:1875729254070784:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788835120.560858:0:9806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2a7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0826 expref: 67 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.560873:0:9806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2a7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0826 expref: 67 pid: 9806 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835120.560896:0:9806:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9806:1875729254070912:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788835120.560936:0:9806:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc836a1a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788835120.561712:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242491648 00000100:00100000:3.0:1788835120.561720:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242491648 00010000:00010000:3.0:1788835120.561750:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2aa8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0834 expref: 68 pid: 6488 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835120.561785:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 100 00000100:00100000:3.0:1788835120.561804:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+68:2385:x1875729242491648:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788835120.561826:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835120.561833:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2aa8 lrc: 5/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0834 expref: 68 pid: 6488 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.561846:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2aa8 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0834 expref: 68 pid: 6488 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.561877:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:3.0:1788835120.561883:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2ab6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.561890:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2ab6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.561897:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835120.561957:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+68:2385:x1875729242491648:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 155us (1776us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835120.561965:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 100 00000100:00100000:0.0:1788835120.566406:0:9806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844aaa00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9806:1875729254070912:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788835120.567227:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835120.567307:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242491776 00000100:00100000:1.0:1788835120.567338:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242491776 00010000:00010000:1.0:1788835120.567378:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2a7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0826 expref: 68 pid: 9806 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835120.567417:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 101 00000100:00100000:1.0:1788835120.567436:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+68:2386:x1875729242491776:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788835120.567449:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835120.567456:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2a7e lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0826 expref: 68 pid: 9806 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.567467:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2a7e lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0826 expref: 68 pid: 9806 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.567488:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2a7e lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 8 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0826 expref: 68 pid: 9806 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.567504:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:1.0:1788835120.567508:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2ab6 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.567518:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2ab6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.567526:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2ab6 lrc: 4/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 7 type: IBT flags: 0x50290000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.567544:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788835120.567613:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+67:2386:x1875729242491776:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 187us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835120.567630:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 101 00010000:00010000:0.0:1788835120.569159:0:9806:0:(ldlm_lockd.c:741:ldlm_handle_ast_error()) ### client (nid 192.168.203.22@tcp) returned -22 from blocking AST (req@00000000f94957bf x1875729254070784) - normal race ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2aa8 lrc: 1/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0834 expref: 66 pid: 6488 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.569181:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2aa8 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0834 expref: 66 pid: 6488 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835120.569199:0:9806:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:9806:1875729254070784:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788835120.569234:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:0.0:1788835120.569242:0:9806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2ab6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.569251:0:9806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2ab6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.569257:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2ab6 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788835120.569276:0:9806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:0.0:1788835120.569457:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4e00/0xdf60171e5a5d2aaf lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae083b expref: 67 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.569472:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2ab6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae083b expref: 66 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.569493:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:0.0:1788835120.569495:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788835120.569499:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5600, rc 0) 00000100:00100000:0.0:1788835120.569552:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+66:12424:x1875729242491520:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 9080us (9261us total) trans 4294967504 rc 0/0 00000100:00100000:0.0:1788835120.570086:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 229 00000100:00100000:2.0:1788835120.573886:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835120.573990:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242492032 00000100:00100000:1.0:1788835120.574000:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242492032 00000100:00100000:1.0:1788835120.574068:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:1.0:1788835120.574078:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaae69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+66:12424:x1875729242492032:12345-192.168.203.22@tcp:103:lfs.0 00010000:00010000:1.0:1788835120.574094:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835120.574116:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2a07 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae080a expref: 66 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.574133:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:1.0:1788835120.574139:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788835120.574203:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaae69450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+65:12424:x1875729242492032:12345-192.168.203.22@tcp:103:lfs.0 Request processed in 127us (326us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835120.574209:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:2.0:1788835120.579966:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835120.580503:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242492160 00000100:00100000:0.0:1788835120.580516:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242492160 00000100:00100000:0.0:1788835120.580674:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 230 00000100:00100000:0.0:1788835120.580686:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+65:12424:x1875729242492160:12345-192.168.203.22@tcp:58:lfs.0 00010000:00010000:0.0:1788835120.580827:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d2ac4 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.580845:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d2ac4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.580859:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d2ac4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788835120.581234:0:6489:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:0.0:1788835120.581382:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+65:12424:x1875729242492160:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 696us (1426us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835120.581391:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 230 00000100:00100000:3.0:1788835120.584285:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835120.585503:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242492288 00000100:00100000:2.0:1788835120.585516:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242492288 00000100:00100000:2.0:1788835120.585593:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 231 00000100:00100000:2.0:1788835120.585604:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+65:12424:x1875729242492288:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788835120.585626:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835120.585646:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2acb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0842 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.585697:0:6488:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d2ac4 lrc: 2/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.585707:0:6488:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2acb lrc: 4/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0842 expref: 66 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.585743:0:6488:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d2ac4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.585756:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2acb lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0842 expref: 66 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.585769:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:2.0:1788835120.585771:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1788835120.585775:0:6488:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2acb lrc: 3/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0842 expref: 66 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.585783:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374d200, rc 0) 00000100:00100000:2.0:1788835120.585854:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+66:12424:x1875729242492288:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 253us (1580us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835120.585861:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 231 00010000:00010000:3.0:1788835120.614383:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788835120.870273:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788835120.870283:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788835120.870377:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1788835120.870389:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788835120.870539:0:13768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb92d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875729254071040:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788835120.870997:0:13768:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b2240 going to sleep for 11 seconds 00000100:00100000:2.0:1788835120.885080:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835120.885786:0:13768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb92d80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875729254071040:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1788835120.894069:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242492416 00000100:00100000:0.0:1788835120.894085:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242492416 00000100:00100000:0.0:1788835120.894596:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 232 00000100:00100000:0.0:1788835120.894609:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb717d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+66:12425:x1875729242492416:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788835120.894662:0:9806:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788835120.894801:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb717d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+66:12425:x1875729242492416:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 194us (9730us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835120.894809:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 232 00000100:00100000:3.0:1788835120.899780:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835120.904667:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242492544 00000100:00100000:3.0:1788835120.904683:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242492544 00000100:00100000:3.0:1788835120.904760:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 233 00000100:00100000:3.0:1788835120.904773:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+66:12425:x1875729242492544:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1788835120.904849:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2ad2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.904897:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2ad2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.904909:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2ad2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.904935:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2ad9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.904942:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.904948:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.904971:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2ae0 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.904980:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.904986:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1788835120.905032:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:3.0:1788835120.905036:0:9047:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:3.0:1788835120.905050:0:9047:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905061:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2ad2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905077:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2ad2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905084:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2ad2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905091:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aa400 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835120.905095:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2ad2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905103:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2ad2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905117:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afc835ccc00) 00010000:00010000:3.0:1788835120.905120:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835120.905125:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2ad2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905130:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa400/0xdf60171e5a5d2ad2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905144:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2ad9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905150:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2ad9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905156:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905161:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884ab200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835120.905169:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2ad9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905176:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2ad9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905184:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x69d7fe76 (ffff9afc810b8100) 00010000:00010000:3.0:1788835120.905186:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835120.905189:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2ad9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905195:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2ad9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x69d7fe76 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905208:0:9047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2ae0 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905214:0:9047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2ae0 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905221:0:9047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905226:0:9047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884abc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835120.905230:0:9047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2ae0 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905236:0:9047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2ae0 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905246:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:3.0:1788835120.905249:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835120.905258:0:9047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2ae0 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.905265:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2ae0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835120.911907:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+66:12425:x1875729242492544:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 Request processed in 7124us (12125us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835120.911930:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 233 00000100:00100000:3.0:1788835120.914639:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835120.914977:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242492800 00000100:00100000:1.0:1788835120.914987:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242492800 00000100:00100000:1.0:1788835120.915050:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 234 00000100:00100000:1.0:1788835120.915060:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+66:12425:x1875729242492800:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788835120.915107:0:6487:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835120.915370:0:6487:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2ae7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0849 expref: -99 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.915478:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2aee lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.915494:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2aee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.915511:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2aee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835120.915522:0:6487:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788835120.915599:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2aee lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.915607:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2aee lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.915614:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2aee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.915620:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60c00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835120.915624:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2aee lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.915631:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2aee lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.915644:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:1.0:1788835120.915653:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788835120.915658:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2aee lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.915665:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2aee lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.915710:0:6487:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2ae7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0849 expref: 68 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.915721:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afc835ccc00) 00010000:00010000:1.0:1788835120.915723:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788835120.915727:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2ae7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0849 expref: 68 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.915736:0:6487:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60e00, rc 0) 00000100:00100000:1.0:1788835120.915811:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+67:12425:x1875729242492800:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 753us (1182us total) trans 4294967505 rc 301/301 00000100:00100000:1.0:1788835120.915830:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 234 00000100:00100000:3.0:1788835120.921530:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835120.921674:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242492928 00000100:00100000:0.0:1788835120.921685:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242492928 00000100:00100000:0.0:1788835120.921750:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 235 00000100:00100000:0.0:1788835120.921761:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+67:12425:x1875729242492928:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1788835120.921799:0:9806:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1788835120.921918:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+67:12425:x1875729242492928:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 159us (395us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835120.921935:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 235 00000100:00100000:3.0:1788835120.926904:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835120.928474:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242493184 00000100:00100000:2.0:1788835120.928489:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242493184 00000100:00100000:2.0:1788835120.928561:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 236 00000100:00100000:2.0:1788835120.928571:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+67:12425:x1875729242493184:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788835120.928592:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835120.928595:0:9047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1788835120.928622:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2a8c lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae082d expref: 67 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.928656:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:2.0:1788835120.928661:0:9047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788835120.928676:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2afc lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0850 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1788835120.929039:0:9047:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x2c0000401:0x6:0x0], index 1: 0 00010000:00010000:2.0:1788835120.929186:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d2b03 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.929200:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d2b03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.929210:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d2b03 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.929264:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2afc lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0850 expref: 69 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.929280:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d2b03 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0850 expref: 68 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.929287:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9afda01ec200) 00010000:00010000:2.0:1788835120.929289:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788835120.929292:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374cc00, rc 0) 00000100:00100000:2.0:1788835120.929426:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+68:12425:x1875729242493184:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 856us (2532us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1788835120.929434:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 236 00000100:00100000:2.0:1788835120.937846:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835120.938106:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242493440 00000100:00100000:0.0:1788835120.938127:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242493440 00000100:00100000:0.0:1788835120.938186:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 237 00000100:00100000:0.0:1788835120.938196:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+68:12425:x1875729242493440:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1788835120.938250:0:6488:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835120.938276:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d2b03 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0850 expref: 68 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.938292:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9afda01ec200) 00010000:00010000:0.0:1788835120.938302:0:6488:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788835120.938379:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2b11 lrc: 3/0,1 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.938392:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2b11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835120.938419:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2b11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.943524:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2b18 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xa:0x0].0x2053ce9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.943549:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2b18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x2053ce9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.943562:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2b18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x2053ce9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.943616:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2b11 lrc: 3/0,1 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.943641:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2b11 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.943648:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2b11 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.943654:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835120.943659:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2b11 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.943667:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2b11 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.943680:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:1.0:1788835120.943683:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835120.943688:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2b11 lrc: 2/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.943693:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2b11 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.943709:0:6488:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2b18 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xa:0x0].0x2053ce9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.943715:0:6488:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2b18 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2053ce9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.943721:0:6488:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2b18 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2053ce9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.943726:0:6488:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835120.943736:0:6488:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2b18 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2053ce9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.943743:0:6488:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2b18 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xa:0x0].0x2053ce9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.943750:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x2053ce9b (ffff9afd93eb1a00) 00010000:00010000:1.0:1788835120.943752:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835120.943755:0:6488:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2b18 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x2053ce9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.943760:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2b18 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xa:0x0].0x2053ce9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835120.943970:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+67:12425:x1875729242493440:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 5770us (6129us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788835120.943989:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 237 00000100:00100000:0.0:1788835120.959618:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835120.959704:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242493568 00000100:00100000:2.0:1788835120.959713:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242493568 00000100:00100000:2.0:1788835120.959772:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 238 00000100:00100000:2.0:1788835120.959783:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+67:12425:x1875729242493568:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788835120.959803:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835120.959827:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2b1f lrc: 2/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0857 expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.959863:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2b26 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.960056:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2b26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.960069:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2b26 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.960267:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2b1f lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0857 expref: 69 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.960286:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2b26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0857 expref: 68 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.960295:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9afda01ec600) 00010000:00010000:2.0:1788835120.960298:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1788835120.960301:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374d000, rc 0) 00000100:00100000:0.0:1788835120.960577:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+68:12425:x1875729242493568:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 792us (964us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835120.960586:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 238 00000100:00100000:2.0:1788835120.962852:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835120.963178:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242493824 00000100:00100000:3.0:1788835120.963191:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242493824 00000100:00100000:3.0:1788835120.963261:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 239 00000100:00100000:3.0:1788835120.963271:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+68:12425:x1875729242493824:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1788835120.963379:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2b2d lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.963395:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2b2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.963408:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2b2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788835120.963574:0:6487:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1788835120.963583:0:6487:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 363005267606ns, next at 364005265186ns, rc = 0 00000004:00010000:3.0:1788835120.963638:0:6487:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a9b50da8 reply state 00000000f292374f transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2b2d lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.963651:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2b2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835120.963659:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9afda01ec600) 00010000:00010000:3.0:1788835120.963676:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:3.0:1788835120.963680:0:6487:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1788835120.963764:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+70:12425:x1875729242493824:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 493us (921us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1788835120.963771:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 239 00000100:00100000:2.0:1788835120.967400:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835120.970791:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242493952 00000100:00100000:1.0:1788835120.970806:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242493952 00000100:00100000:1.0:1788835120.970883:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 240 00000100:00100000:1.0:1788835120.970894:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+70:12425:x1875729242493952:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788835120.970928:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835120.970950:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2b34 lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae085e expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.971020:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2b34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae085e expref: 71 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.971036:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2b34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae085e expref: 71 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.971071:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9afda01ec600) 00010000:00010000:1.0:1788835120.971074:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788835120.971078:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60e00, rc 0) 00000100:00100000:1.0:1788835120.971436:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+71:12425:x1875729242493952:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 541us (4045us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835120.971444:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 240 00000100:00100000:0.0:1788835120.974144:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835120.974276:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242494080 00000100:00100000:1.0:1788835120.974285:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242494080 00000100:00100000:1.0:1788835120.974375:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:1.0:1788835120.974386:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+9:2386:x1875729242494080:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1788835120.974586:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+10:2386:x1875729242494080:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 201us (450us total) trans 4294967321 rc 0/0 00000100:00100000:1.0:1788835120.974594:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 72 00000100:00100000:2.0:1788835120.981797:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835120.982535:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242494336 00000100:00100000:3.0:1788835120.982546:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242494336 00000100:00100000:3.0:1788835120.982608:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:3.0:1788835120.982618:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+71:12425:x1875729242494336:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788835120.982844:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+72:12425:x1875729242494336:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 226us (1056us total) trans 4294967508 rc 0/0 00000100:00100000:3.0:1788835120.982852:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:0.0:1788835120.988791:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835120.988899:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242494592 00000100:00100000:2.0:1788835120.988909:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242494592 00000100:00100000:2.0:1788835120.988990:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 241 00000100:00100000:2.0:1788835120.989002:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+72:12425:x1875729242494592:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1788835120.989128:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+72:12425:x1875729242494592:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 117us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835120.989136:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 241 00000100:00100000:1.0:1788835120.991350:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835120.991467:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242494720 00000100:00100000:2.0:1788835120.991476:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242494720 00000100:00100000:2.0:1788835120.991534:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 242 00000100:00100000:2.0:1788835120.991544:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+72:12425:x1875729242494720:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788835120.991563:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835120.991585:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2b3b lrc: 2/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0865 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.991654:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b42 lrc: 3/1,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.991667:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.991679:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835120.991726:0:9806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788835120.991748:0:9806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b42 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.991809:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2b3b lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0865 expref: 74 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.991829:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b42 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0865 expref: 73 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835120.991837:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9afda01ec600) 00010000:00010000:2.0:1788835120.991839:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1788835120.991842:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374da00, rc 0) 00000100:00100000:2.0:1788835120.992044:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+73:12425:x1875729242494720:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 500us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835120.992052:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 242 00000100:00100000:0.0:1788835120.995373:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835120.995453:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242494848 00000100:00100000:1.0:1788835120.995462:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242494848 00000100:00100000:1.0:1788835120.995517:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:1.0:1788835120.995527:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+10:2386:x1875729242494848:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788835120.995545:0:8405:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835120.995566:0:8405:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0bb3cc9/0xdf60171e5a5d2b49 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae086c expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788835120.995592:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f7532, blocks: 0x0 00010000:00010000:1.0:1788835120.995611:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=363s v=(0 0) 00010000:00010000:1.0:1788835120.995629:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835120.995639:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0bb3cc9/0xdf60171e5a5d2b49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae086c expref: 11 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.995661:0:8405:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d0bb3cc9/0xdf60171e5a5d2b49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae086c expref: 11 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835120.995675:0:8405:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61200, rc 0) 00000100:00100000:1.0:1788835120.995737:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+11:2386:x1875729242494848:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 211us (374us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835120.995744:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 73 00000100:00100000:0.0:1788835120.999550:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835120.999931:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242495104 00000100:00100000:3.0:1788835120.999942:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242495104 00000100:00100000:3.0:1788835121.000014:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 243 00000100:00100000:3.0:1788835121.000024:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+73:12425:x1875729242495104:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1788835121.000128:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+73:12425:x1875729242495104:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 105us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835121.000136:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 243 00000100:00100000:0.0:1788835121.003228:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835121.003358:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242495232 00000100:00100000:1.0:1788835121.003367:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242495232 00000100:00100000:1.0:1788835121.003423:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 74 00000100:00100000:1.0:1788835121.003432:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+11:12425:x1875729242495232:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788835121.003450:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835121.003469:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2b50 lrc: 2/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0873 expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.003501:0:8403:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d0bb3cc9/0xdf60171e5a5d2b49 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae086c expref: 12 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.003511:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835121.003515:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835121.003521:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2b50 lrc: 4/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0873 expref: 12 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.003576:0:8403:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d0bb3cc9/0xdf60171e5a5d2b49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae086c expref: 12 pid: 8405 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.003591:0:8403:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d0bb3cc9/0xdf60171e5a5d2b49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae086c expref: 12 pid: 8405 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835121.003606:0:8403:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8403:1875729254071168:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788835121.003693:0:8403:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b2840 going to sleep for 11 seconds 00000100:00100000:1.0:1788835121.006037:0:8403:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb93800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:8403:1875729254071168:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788835121.006077:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2b50 lrc: 3/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0873 expref: 12 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.006098:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60800, rc 0) 00000100:00100000:1.0:1788835121.006279:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+12:12425:x1875729242495232:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 2846us (3059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835121.006288:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 74 00000100:00100000:0.0:1788835121.014628:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835121.014722:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242495360 00000100:00100000:2.0:1788835121.014734:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242495360 00010000:00010000:2.0:1788835121.014779:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d0bb3cc9/0xdf60171e5a5d2b49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae086c expref: 12 pid: 8405 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835121.014824:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 102 00000100:00100000:2.0:1788835121.014833:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+12:2385:x1875729242495360:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835121.014848:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835121.014880:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d0bb3cc9/0xdf60171e5a5d2b49 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae086c expref: 12 pid: 8405 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.014895:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d0bb3cc9/0xdf60171e5a5d2b49 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae086c expref: 12 pid: 8405 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.014949:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0bb3cc9/0xdf60171e5a5d2b49 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae086c expref: 12 pid: 8405 timeout: 463 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.014966:0:9491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835121.014971:0:9491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835121.014979:0:9491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2b50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0873 expref: 11 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.015000:0:9491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2b50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0873 expref: 11 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.015042:0:9491:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2b50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0873 expref: 11 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835121.015057:0:9491:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845ffb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9491:1875729254071296:192.168.203.22@tcp:105: 00000100:00100000:2.0:1788835121.015153:0:9491:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb34b8d80 going to sleep for 11 seconds 00000100:00100000:0.0:1788835121.018743:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835121.018822:0:8409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242495488 00000100:00100000:3.0:1788835121.018832:0:8409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242495488 00002000:00100000:3.0:1788835121.018878:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9afc844a9180 x1875729242495488/t0(0) o4->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:42/0 lens 504/0 e 0 to 0 dl 1788835132 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788835121.018890:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afc844a9180 with x1875729242495488 ext(0->12) 00002000:00010000:3.0:1788835121.018895:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afc844a9180 00000100:00100000:3.0:1788835121.018936:0:8409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:3.0:1788835121.018961:0:8409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b8987b33-76f7-43a0-9448-1013c4af787f+12:2385:x1875729242495488:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1788835121.019729:0:9491:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845ffb80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:9491:1875729254071296:192.168.203.22@tcp:105: 00010000:00010000:2.0:1788835121.019753:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835121.019816:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844aaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+14:2385:x1875729242495360:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 4984us (5199us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835121.019826:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 102 00000100:00100000:3.0:1788835121.021476:0:8409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b8987b33-76f7-43a0-9448-1013c4af787f+13:2385:x1875729242495488:12345-192.168.203.22@tcp:4:lhsmtool_posix.0 Request processed in 2509us (2736us total) trans 4294967322 rc 0/0 00000100:00100000:3.0:1788835121.021488:0:8409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00002000:00100000:3.0:1788835121.021500:0:8409:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x2c0000401:0x6:0x0] (0->12) req@ffff9afc844a9180 x1875729242495488/t4294967322(0) o4->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:42/0 lens 504/448 e 0 to 0 dl 1788835132 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788835121.021510:0:8409:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afc844a9180 with x1875729242495488 ext(0->12) 00002000:00010000:3.0:1788835121.021517:0:8409:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afc844a9180 00000100:00100000:0.0:1788835121.024037:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835121.024115:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242495616 00000100:00100000:3.0:1788835121.024133:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242495616 00000100:00100000:3.0:1788835121.024204:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 244 00000100:00100000:3.0:1788835121.024215:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+73:12425:x1875729242495616:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 00000100:00080000:0.0:1788835121.024762:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:3.0:1788835121.026731:0:6467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000004:00080000:3.0:1788835121.026750:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000004:00080000:3.0:1788835121.026800:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:3.0:1788835121.026823:0:6467:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9afd916729c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:3.0:1788835121.026828:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afc82636b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9afd91672780 00000020:00080000:3.0:1788835121.026831:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afc82636600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9afd87f6ce00 00000004:00080000:3.0:1788835121.026850:0:6467:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:3.0:1788835121.026885:0:6467:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9afd869d0300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:3.0:1788835121.026888:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afdaf500900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9afd83e4ee40 00000020:00080000:3.0:1788835121.026891:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afdaf500100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9afc83362000 00000100:00100000:3.0:1788835121.027047:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+27:12425:x1875729242495616:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 Request processed in 2829us (3019us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835121.027072:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 244 00000100:00100000:3.0:1788835121.027728:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254071424:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1788835121.027784:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835121.028007:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254071424 00000100:00100000:2.0:1788835121.028015:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254071424 00000100:00100000:2.0:1788835121.028064:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1788835121.028084:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3615:x1875729254071424:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1788835121.028108:0:8405:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x280000401:5 count 1 00002000:00010000:2.0:1788835121.028149:0:8405:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x5:0x0] initial LVB size: 9, mtime: 0x6a9f7530, atime: 0x6a9f7531, ctime: 0x6a9f7530, blocks: 0x8 00010000:00010000:2.0:1788835121.028157:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d2b57 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.028174:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=363s v=(0 0) 00010000:00010000:2.0:1788835121.028179:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835121.028185:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d2b57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.028201:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d2b57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.028211:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d2b57 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.028218:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d2b57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.028234:0:8405:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788835121.028400:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3615:x1875729254071424:12345-0@lo:6:osp-syn-0-0.0 Request processed in 319us (615us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1788835121.028408:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:0.0:1788835121.028659:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835121.028667:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d2b57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.028676:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374ce00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835121.028681:0:6477:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d2b57 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.028690:0:6477:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d2b57 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.028720:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d2b57 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.028728:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000368cb5cb/0xdf60171e5a5d2b57 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.028747:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835121.028749:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835121.028751:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835121.028762:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254071680:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1788835121.028798:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835121.028991:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788835121.028998:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254071552:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1788835121.029023:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835121.029052:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254071680 00000100:00100000:0.0:1788835121.029057:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254071680 00000100:00100000:0.0:1788835121.029096:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254071552 00000100:00100000:0.0:1788835121.029100:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254071552 00000100:00100000:0.0:1788835121.029115:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788835121.029260:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3617:x1875729254071680:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1788835121.029416:0:9814:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1788835121.029420:0:9814:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 0 -> 1788835122 00002000:00010000:0.0:1788835121.029422:0:9814:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1788835121.029424:0:9814:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788835122 -> 1788835122 00002000:00010000:0.0:1788835121.029426:0:9814:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 0 -> 8 00000100:00100000:0.0:1788835121.029463:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83108000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3617:x1875729254071680:12345-0@lo:2:osp-syn-1-0.0 Request processed in 205us (663us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1788835121.029478:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788835121.029496:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788835121.029502:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3617:x1875729254071552:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1788835121.029515:0:9814:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x2c0000401:5 count 1 00010000:00010000:0.0:1788835121.029532:0:9814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a11a50/0xdf60171e5a5d2b5e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.029549:0:9814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000004b2f613/0xdf60171e5a5d290b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07cb expref: 12 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.029558:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:0.0:1788835121.029563:0:9814:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1788835121.029567:0:9814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a11a50/0xdf60171e5a5d2b5e lrc: 4/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.029595:0:9814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000004b2f613/0xdf60171e5a5d290b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07cb expref: 12 pid: 8402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.029611:0:9814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000004b2f613/0xdf60171e5a5d290b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07cb expref: 12 pid: 8402 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835121.029623:0:9814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83108380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9814:1875729254071808:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788835121.029689:0:9814:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd91672840 going to sleep for 11 seconds 00000100:00080000:0.0:1788835121.029702:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788835121.029731:0:3617:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967318 gen 2 00000004:00080000:0.0:1788835121.029743:0:3617:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967318 committed transno 4294967318 00000100:00100000:0.0:1788835121.029764:0:3617:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9afc844a8380 x1875729254071680/t4294967323(4294967323) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1788835137 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1788835121.029775:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afc844a8380/2, rc 0, transno 4294967323 00000100:00100000:0.0:1788835121.029780:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254071680:0@lo:2:osp-syn-1-0.0 00000004:00080000:3.0:1788835121.030679:0:3615:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afc845ffb80/2, rc 0, transno 4294967311 00000100:00100000:3.0:1788835121.030691:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254071424:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1788835121.032402:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1788835121.032487:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:0.0:1788835121.033446:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835121.033546:0:9814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83108380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:9814:1875729254071808:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788835121.033571:0:9814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000041a11a50/0xdf60171e5a5d2b5e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835121.033656:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242495872 00000100:00100000:3.0:1788835121.033663:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242495872 00010000:00010000:3.0:1788835121.033696:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000004b2f613/0xdf60171e5a5d290b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07cb expref: 13 pid: 8402 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835121.033734:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 103 00000100:00100000:3.0:1788835121.033743:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+13:2388:x1875729242495872:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788835121.033757:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835121.033763:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000004b2f613/0xdf60171e5a5d290b lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07cb expref: 13 pid: 8402 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.033775:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000004b2f613/0xdf60171e5a5d290b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07cb expref: 13 pid: 8402 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.033798:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000004b2f613/0xdf60171e5a5d290b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07cb expref: 13 pid: 8402 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.033816:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788835121.033820:0:6474:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788835121.033832:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000041a11a50/0xdf60171e5a5d2b5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.033841:0:6474:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000041a11a50/0xdf60171e5a5d2b5e lrc: 4/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.033871:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835121.033917:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+12:2388:x1875729242495872:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 175us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835121.033934:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 103 00010000:00010000:2.0:1788835121.034129:0:9814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000041a11a50/0xdf60171e5a5d2b5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.034139:0:9814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000041a11a50/0xdf60171e5a5d2b5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.034149:0:9814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000041a11a50/0xdf60171e5a5d2b5e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.034158:0:9814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000041a11a50/0xdf60171e5a5d2b5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.034181:0:9814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788835121.034367:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83109c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3617:x1875729254071552:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4864us (5341us total) trans 4294967324 rc 0/0 00000100:00100000:2.0:1788835121.034376:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000004:00080000:0.0:1788835121.035015:0:3617:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afc844ab100/2, rc 0, transno 4294967324 00000100:00100000:0.0:1788835121.035024:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254071552:0@lo:6:osp-syn-1-0.0 00010000:00010000:3.0:1788835121.035202:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788835121.035209:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000041a11a50/0xdf60171e5a5d2b5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.035220:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4600 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:3.0:1788835121.035224:0:6476:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a11a50/0xdf60171e5a5d2b5e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.035234:0:6476:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000041a11a50/0xdf60171e5a5d2b5e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.035253:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000041a11a50/0xdf60171e5a5d2b5e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.035260:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000041a11a50/0xdf60171e5a5d2b5e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 9814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.035299:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835121.035301:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835121.035303:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835121.035423:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835121.035447:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242495744 00000100:00100000:3.0:1788835121.035453:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242495744 00000100:00100000:3.0:1788835121.035488:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:3.0:1788835121.035496:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+12:2385:x1875729242495744:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 00010000:00010000:1.0:1788835121.036633:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2855 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036647:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2855 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036655:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2855 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036679:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aba00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835121.036684:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2855 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036691:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2855 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036706:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xd:0x0].0x0 (ffff9afc835cc200) 00010000:00010000:1.0:1788835121.036709:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835121.036713:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2855 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036719:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aba00/0xdf60171e5a5d2855 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xd:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036759:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d28fd lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036765:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d28fd lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036771:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d28fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036776:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc2166000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835121.036779:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d28fd lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036785:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d28fd lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036803:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xb:0x0].0x0 (ffff9afc810b8a00) 00010000:00010000:1.0:1788835121.036805:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835121.036808:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d28fd lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036814:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d28fd lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036835:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d297b lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036841:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d297b lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036846:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d297b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036851:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835121.036854:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d297b lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036860:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d297b lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036874:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afda01ecc00) 00010000:00010000:1.0:1788835121.036876:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835121.036879:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d297b lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036885:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d297b lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036909:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d299e lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036915:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d299e lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036931:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d299e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036936:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374c000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835121.036939:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d299e lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036944:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d299e lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036953:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afda01ecc00) 00010000:00010000:1.0:1788835121.036956:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835121.036959:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d299e lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036964:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d299e lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036991:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a70 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.036998:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a70 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.037003:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.037015:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835121.037018:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a70 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.037025:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a70 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.037034:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:1.0:1788835121.037036:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835121.037039:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a70 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.037044:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2a70 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.037059:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2b2d lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.037065:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2b2d lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.037071:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2b2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.037076:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884ab000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835121.037079:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2b2d lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.037085:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2b2d lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.037104:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9afda01ec600) 00010000:00010000:1.0:1788835121.037107:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788835121.037109:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2b2d lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.037114:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab000/0xdf60171e5a5d2b2d lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788835121.038491:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:3.0:1788835121.038514:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000100:00100000:0.0:1788835121.038711:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+7:2385:x1875729242495744:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 Request processed in 3209us (3283us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835121.038723:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 78 00000100:00100000:3.0:1788835121.041555:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835121.041805:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242496128 00000100:00100000:2.0:1788835121.041815:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242496128 00000100:00100000:2.0:1788835121.041889:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 245 00000100:00100000:2.0:1788835121.041900:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+21:12425:x1875729242496128:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788835121.041967:0:9806:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835121.042003:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b42 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0865 expref: 21 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.042021:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9afda01ec600) 00010000:00010000:2.0:1788835121.042040:0:9806:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788835121.042073:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d2b65 lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.042088:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d2b65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.042098:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d2b65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788835121.042236:0:9806:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000089cc3d52 reply state 0000000088ef2c17 transno 4294967509 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d2b65 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.042260:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d2b65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.042267:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9afda01ec600) 00010000:00010000:2.0:1788835121.042270:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788835121.042272:0:9806:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788835121.042419:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+22:12425:x1875729242496128:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 520us (873us total) trans 4294967509 rc 0/0 00000100:00100000:2.0:1788835121.042427:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 245 00000100:00100000:1.0:1788835121.045197:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835121.045383:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242496256 00000100:00100000:3.0:1788835121.045393:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242496256 00000100:00100000:3.0:1788835121.045454:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:3.0:1788835121.045465:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+7:2386:x1875729242496256:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1788835121.045626:0:8402:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:3.0:1788835121.045630:0:8402:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb mtime from disk: 1788835122 -> 1788835121 00002000:00010000:3.0:1788835121.045633:0:8402:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb atime from disk: 0 -> 1788835121 00002000:00010000:3.0:1788835121.045635:0:8402:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb ctime from disk: 1788835122 -> 1788835121 00002000:00010000:3.0:1788835121.045637:0:8402:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x2c0000401:0x6:0x0] updating lvb blocks from disk: 8 -> 8 00000100:00100000:3.0:1788835121.045705:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+8:2386:x1875729242496256:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 240us (518us total) trans 4294967325 rc 0/0 00000100:00100000:3.0:1788835121.045713:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 79 00000100:00100000:0.0:1788835121.051308:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835121.051458:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242496512 00000100:00100000:2.0:1788835121.051470:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242496512 00000100:00100000:2.0:1788835121.051521:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 246 00000100:00100000:2.0:1788835121.051532:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+22:12425:x1875729242496512:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1788835121.051599:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b6c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.051615:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2b26 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0857 expref: 22 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.051642:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b6c lrc: 4/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.051676:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2b26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0857 expref: 22 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.051689:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2b26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0857 expref: 22 pid: 6489 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835121.051703:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1875729254071936:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788835121.051781:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb34b8c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788835121.054287:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fe300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1875729254071936:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788835121.054350:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b6c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835121.057834:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835121.058341:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242496640 00000100:00100000:3.0:1788835121.058378:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242496640 00010000:00010000:3.0:1788835121.058433:0:7430:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2b26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0857 expref: 23 pid: 6489 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835121.058476:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 104 00000100:00100000:3.0:1788835121.058486:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+23:2385:x1875729242496640:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788835121.058501:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835121.058509:0:7430:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2b26 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0857 expref: 23 pid: 6489 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.058523:0:7430:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2b26 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0857 expref: 23 pid: 6489 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.058544:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d000/0xdf60171e5a5d2b26 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x10:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0857 expref: 23 pid: 6489 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.058560:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9afda01ec600) 00010000:00010000:3.0:1788835121.058565:0:7430:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b6c lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.058574:0:7430:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.058582:0:7430:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b6c lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.058615:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835121.058664:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+22:2385:x1875729242496640:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 178us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835121.058671:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 104 00010000:00010000:2.0:1788835121.059010:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.059020:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.059058:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b6c lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.059066:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b6c lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.059073:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b6c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.059086:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374da00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835121.059091:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b6c lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.059098:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b6c lrc: 4/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.059109:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9afda01ec600) 00010000:00010000:2.0:1788835121.059111:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1788835121.059126:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b6c lrc: 2/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.059132:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374da00/0xdf60171e5a5d2b6c lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835121.059188:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+21:12425:x1875729242496512:12345-192.168.203.22@tcp:55:lhsmtool_posix.0 Request processed in 7657us (7893us total) trans 0 rc -22/-22 00000100:00100000:2.0:1788835121.059196:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 246 00000100:00100000:0.0:1788835121.064060:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835121.064147:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242496768 00000100:00100000:3.0:1788835121.064157:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242496768 00000100:00100000:3.0:1788835121.064211:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:3.0:1788835121.064221:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+8:2385:x1875729242496768:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1788835121.064274:0:8405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d2b73 lrc: 3/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.064295:0:8405:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2b50 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0873 expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.064304:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835121.064308:0:8405:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1788835121.064351:0:8405:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d2b73 lrc: 4/1,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.064387:0:8405:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2b50 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0873 expref: 8 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.064402:0:8405:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2b50 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0873 expref: 8 pid: 8403 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835121.064417:0:8405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1875729254072064:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788835121.064493:0:8405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd81254a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788835121.068229:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835121.069306:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242496896 00000100:00100000:2.0:1788835121.069356:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242496896 00010000:00010000:2.0:1788835121.069401:0:9491:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2b50 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0873 expref: 9 pid: 8403 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835121.069442:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 105 00000100:00100000:2.0:1788835121.069452:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+9:2386:x1875729242496896:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835121.069466:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835121.069489:0:9491:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2b50 lrc: 5/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0873 expref: 9 pid: 8403 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.069522:0:9491:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2b50 lrc: 4/0,0 mode: PW/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0873 expref: 9 pid: 8403 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.069547:0:9491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788835121.069551:0:9491:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1788835121.069557:0:9491:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d2b73 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.069567:0:9491:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d2b73 lrc: 4/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.069587:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835121.069653:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83108a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:b8987b33-76f7-43a0-9448-1013c4af787f+9:2386:x1875729242496896:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 202us (1432us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835121.069661:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 105 00010000:00010000:3.0:1788835121.070437:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ef9724d/0xdf60171e5a5d2b50 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0873 expref: 8 pid: 8403 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835121.070455:0:8405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:8405:1875729254072064:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788835121.070488:0:8405:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d2b73 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.070500:0:8405:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d2b73 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.070508:0:8405:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d2b73 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.070532:0:8405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d2b73 lrc: 3/1,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.070541:0:8405:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d2b73 lrc: 2/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.070549:0:8405:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d2b73 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.070557:0:8405:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884abc00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:3.0:1788835121.070561:0:8405:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d2b73 lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.070571:0:8405:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d2b73 lrc: 4/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.070587:0:8405:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d2b73 lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.070604:0:8405:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d2b73 lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835121.070673:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+7:2385:x1875729242496768:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 Request processed in 6453us (6624us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835121.070681:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 80 00000100:00100000:0.0:1788835121.074459:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835121.074541:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242497152 00000100:00100000:3.0:1788835121.074550:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242497152 00000100:00100000:3.0:1788835121.074609:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 247 00000100:00100000:3.0:1788835121.074619:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+21:12425:x1875729242497152:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1788835121.074698:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2b7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.074716:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a69 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae081f expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.074725:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2b7a lrc: 4/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.074758:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae081f expref: 21 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.074772:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a69 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae081f expref: 21 pid: 6487 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835121.074785:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875729254072192:192.168.203.22@tcp:104: 00000100:00100000:3.0:1788835121.074886:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd81254a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788835121.083789:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875729254072192:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788835121.083819:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2b7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835121.083960:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835121.084030:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242497280 00000100:00100000:1.0:1788835121.084037:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242497280 00010000:00010000:1.0:1788835121.084073:0:6475:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a69 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae081f expref: 22 pid: 6487 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835121.084110:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 106 00000100:00100000:1.0:1788835121.084130:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+22:2385:x1875729242497280:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788835121.084143:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835121.084149:0:6475:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a69 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae081f expref: 22 pid: 6487 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.084160:0:6475:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a69 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae081f expref: 22 pid: 6487 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.084180:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aae00/0xdf60171e5a5d2a69 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae081f expref: 22 pid: 6487 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.084195:0:6475:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:1.0:1788835121.084213:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2acb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0842 expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.084222:0:6475:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2b7a lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.084229:0:6475:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2b7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.084236:0:6475:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2b7a lrc: 4/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835121.084273:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788835121.084410:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310bb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b8987b33-76f7-43a0-9448-1013c4af787f+21:2385:x1875729242497280:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 291us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835121.084418:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 106 00010000:00010000:0.0:1788835121.084584:0:6487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2b7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.084592:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2b7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.084759:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2b81 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.084782:0:6487:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2b34 lrc: 2/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae085e expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.084790:0:6487:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2b81 lrc: 4/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.084819:0:6487:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2b34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae085e expref: 21 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.084832:0:6487:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2b34 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae085e expref: 21 pid: 6488 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835121.084843:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875729254072320:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788835121.084897:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd91672840 going to sleep for 11 seconds 00000100:00100000:1.0:1788835121.089027:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835121.089145:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875729254072320:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788835121.089176:0:6487:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2b81 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835121.089519:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242497408 00000100:00100000:2.0:1788835121.089526:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242497408 00010000:00010000:2.0:1788835121.089560:0:6473:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2b34 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae085e expref: 22 pid: 6488 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835121.089601:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 107 00000100:00100000:2.0:1788835121.089610:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+22:2386:x1875729242497408:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835121.089624:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835121.089630:0:6473:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2b34 lrc: 4/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae085e expref: 22 pid: 6488 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.089660:0:6473:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2b34 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae085e expref: 22 pid: 6488 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.089684:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2b34 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae085e expref: 22 pid: 6488 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.089698:0:6473:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9afda01ec600) 00010000:00010000:2.0:1788835121.089704:0:6473:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2b81 lrc: 3/0,1 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.089713:0:6473:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2b81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.089720:0:6473:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2b81 lrc: 4/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.089749:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835121.089802:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb93480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b8987b33-76f7-43a0-9448-1013c4af787f+21:2386:x1875729242497408:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 193us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835121.089809:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 107 00010000:00010000:3.0:1788835121.089872:0:6487:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2b81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.089880:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2b81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788835121.089988:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1788835121.090107:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000001:00080000:3.0:1788835121.090161:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1788835121.090252:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6487:1875729254072448:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788835121.090304:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835121.090369:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd81254c00 going to sleep for 11 seconds 00000100:00100000:2.0:1788835121.090697:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254072448 00000100:00100000:2.0:1788835121.090703:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254072448 00000100:00100000:2.0:1788835121.090779:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1788835121.090788:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6487:x1875729254072448:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1788835121.090866:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6487:x1875729254072448:12345-0@lo:1000:mdt00_000.0 Request processed in 80us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835121.090873:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1788835121.091002:0:6487:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1788835121.091008:0:6487:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afc844a8380, transno 4294967323 00000004:00080000:3.0:1788835121.091016:0:6487:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afc844ab100, transno 4294967324 00000100:00100000:3.0:1788835121.091022:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6487:1875729254072448:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1788835121.091139:0:6487:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00000100:00100000:3.0:1788835121.091186:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6487:1875729254072576:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1788835121.091214:0:6487:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835121.092755:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd86b53f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788835121.092847:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254072576 00000100:00100000:1.0:1788835121.092855:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254072576 00000100:00100000:1.0:1788835121.092902:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1788835121.092911:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:6487:x1875729254072576:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1788835121.093255:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:6487:x1875729254072576:12345-0@lo:1000:mdt00_000.0 Request processed in 344us (2039us total) trans 4294967326 rc 0/0 00000100:00100000:1.0:1788835121.093263:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1788835121.093656:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:6487:1875729254072576:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1788835121.093756:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2b81 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.093768:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2b81 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.093776:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2b81 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.093782:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835121.093798:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2b81 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.093806:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2b81 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.093822:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9afda01ec600) 00010000:00010000:0.0:1788835121.093825:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788835121.093828:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2b81 lrc: 2/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.093834:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5a00/0xdf60171e5a5d2b81 lrc: 0/0,0 mode: --/EX res: [0x200000402:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.093859:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d2ac4 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.093866:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d2ac4 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.093872:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d2ac4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.093877:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5400 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835121.093880:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d2ac4 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.093885:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d2ac4 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.093892:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:0.0:1788835121.093894:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788835121.093906:0:6487:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2acb lrc: 2/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0842 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.093927:0:6487:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2acb lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0842 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.093937:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2acb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0842 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.093971:0:6487:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2acb lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0842 expref: 24 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835121.093984:0:6487:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875729254072704:192.168.203.22@tcp:105: 00000100:00100000:0.0:1788835121.094057:0:6487:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd91672840 going to sleep for 11 seconds 00000100:00100000:1.0:1788835121.097601:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835121.097676:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242497536 00000100:00100000:3.0:1788835121.097686:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242497536 00000100:00100000:3.0:1788835121.097757:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:3.0:1788835121.097767:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+25:12424:x1875729242497536:12345-192.168.203.22@tcp:49:lfs.0 00000100:00100000:3.0:1788835121.097889:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+25:12424:x1875729242497536:12345-192.168.203.22@tcp:49:lfs.0 Request processed in 123us (297us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835121.097896:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:0.0:1788835121.098730:0:6487:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:6487:1875729254072704:192.168.203.22@tcp:105: 00010000:00010000:0.0:1788835121.098759:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d2ac4 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.098769:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d2ac4 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.098803:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2b88 lrc: 3/0,1 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.098816:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2b88 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.098828:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2b88 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.098855:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2b88 lrc: 3/0,1 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.098863:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2b88 lrc: 2/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.098932:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2b88 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.098938:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835121.098942:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2b88 lrc: 3/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.098949:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2b88 lrc: 4/0,0 mode: EX/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.098961:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:0.0:1788835121.098964:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835121.098968:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2b88 lrc: 2/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.098974:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5000/0xdf60171e5a5d2b88 lrc: 0/0,0 mode: --/EX res: [0x200000402:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.098984:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2b7a lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.098991:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2b7a lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.098997:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2b7a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.099008:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884ab200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835121.099012:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2b7a lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.099018:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2b7a lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.099026:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:0.0:1788835121.099029:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788835121.099032:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2b7a lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.099037:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab200/0xdf60171e5a5d2b7a lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835121.100352:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+24:12425:x1875729242497152:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 25725us (25894us total) trans 4294967514 rc 0/0 00000100:00100000:0.0:1788835121.100365:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 247 00000020:00080000:0.0:1788835121.100370:0:6487:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1788835121.100771:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788835121.100776:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788835121.101389:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1788835121.101399:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1788835121.101884:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835121.102213:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242497792 00000100:00100000:3.0:1788835121.102222:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242497792 00000100:00100000:3.0:1788835121.102277:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 248 00000100:00100000:3.0:1788835121.102288:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+24:12424:x1875729242497792:12345-192.168.203.22@tcp:58:lfs.0 00000040:00080000:3.0:1788835121.102642:0:9047:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1788835121.102764:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+24:12424:x1875729242497792:12345-192.168.203.22@tcp:58:lfs.0 Request processed in 477us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835121.102773:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 248 00000100:00100000:2.0:1788835121.108052:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835121.108120:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242498048 00000100:00100000:3.0:1788835121.108129:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242498048 00000100:00100000:3.0:1788835121.108203:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:3.0:1788835121.108213:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84e67c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+24:12425:x1875729242498048:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1788835121.108489:0:6490:0:(mdd_object.c:4014:mdd_close()) Object [0x200000402:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1788835121.108522:0:6490:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967515 00010000:00010000:3.0:1788835121.108556:0:6490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2b8f lrc: 3/0,1 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.108572:0:6490:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2b8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.108583:0:6490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2b8f lrc: 3/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.108621:0:6490:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2b8f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.108627:0:6490:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2b8f lrc: 4/0,1 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.108633:0:6490:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2b8f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.108659:0:6490:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1788835121.108751:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84e67c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+26:12425:x1875729242498048:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 538us (706us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1788835121.108759:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 62 00000020:00080000:3.0:1788835121.108764:0:6490:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1788835121.108883:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835121.108890:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2b8f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.108898:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884abc00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835121.108902:0:7429:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2b8f lrc: 2/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.108910:0:7429:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2b8f lrc: 3/0,0 mode: PW/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.108943:0:7429:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9afda01ec600) 00010000:00010000:0.0:1788835121.108946:0:7429:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788835121.108952:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2b8f lrc: 1/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.108958:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884abc00/0xdf60171e5a5d2b8f lrc: 0/0,0 mode: --/PW res: [0x200000402:0x10:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6490 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835121.108971:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835121.108972:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835121.108974:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835121.142407:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835121.142481:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242498176 00000100:00100000:2.0:1788835121.142492:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242498176 00000100:00100000:2.0:1788835121.142556:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 249 00000100:00100000:2.0:1788835121.142567:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+26:12427:x1875729242498176:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788835121.142598:0:6489:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835121.142619:0:6489:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2b96 lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae087a expref: -99 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.142683:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2b9d lrc: 3/1,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.142698:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2b9d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.142710:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2b9d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.142725:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2ba4 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.142731:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.142737:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.142819:0:6489:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2bab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.142830:0:6489:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2ab6 lrc: 2/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae083b expref: 27 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.142852:0:6489:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2bab lrc: 4/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.142884:0:6489:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2ab6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae083b expref: 27 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.142898:0:6489:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2ab6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae083b expref: 27 pid: 9806 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835121.142912:0:6489:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1875729254072832:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788835121.143033:0:6489:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb34b8c00 going to sleep for 11 seconds 00000100:00100000:1.0:1788835121.146646:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835121.146826:0:6489:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:6489:1875729254072832:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788835121.146856:0:6489:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2bab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835121.146935:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242498432 00000100:00100000:3.0:1788835121.146943:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242498432 00000100:00100000:3.0:1788835121.146999:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:3.0:1788835121.147008:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+28:6158:x1875729242498432:12345-192.168.203.22@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1788835121.147809:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+29:6158:x1875729242498432:12345-192.168.203.22@tcp:35:ldlm_bl.0 Request processed in 797us (1169us total) trans 4294967517 rc 0/0 00000100:00100000:3.0:1788835121.147820:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:0.0:1788835121.152464:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835121.152550:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242498560 00000100:00100000:3.0:1788835121.152559:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242498560 00010000:00010000:3.0:1788835121.152597:0:6474:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2ab6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae083b expref: 29 pid: 9806 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835121.152635:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 108 00000100:00100000:3.0:1788835121.152646:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaae6a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+29:2386:x1875729242498560:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788835121.152673:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835121.152681:0:6474:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2ab6 lrc: 4/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae083b expref: 29 pid: 9806 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.152694:0:6474:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2ab6 lrc: 3/0,0 mode: CW/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae083b expref: 29 pid: 9806 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.152715:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d2ab6 lrc: 0/0,0 mode: --/CW res: [0x200000402:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae083b expref: 29 pid: 9806 timeout: 463 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.152733:0:6474:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:3.0:1788835121.152738:0:6474:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2bab lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.152749:0:6474:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2bab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.152756:0:6474:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2bab lrc: 4/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835121.152783:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835121.152876:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaae6a850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b8987b33-76f7-43a0-9448-1013c4af787f+28:2386:x1875729242498560:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 232us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835121.152884:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 108 00010000:00010000:2.0:1788835121.153118:0:6489:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2bab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.153127:0:6489:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2bab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835121.153176:0:6489:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00000004:00200000:2.0:1788835121.153180:0:6489:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788835121.153210:0:6489:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2bab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.153222:0:6489:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2bab lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.153254:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2b9d lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.153261:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2b9d lrc: 2/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.153267:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2b9d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.153273:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835121.153277:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2b9d lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.153284:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2b9d lrc: 4/0,0 mode: CR/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.153295:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:2.0:1788835121.153298:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835121.153301:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2b9d lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.153307:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2b9d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.153336:0:6489:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2ba4 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.153342:0:6489:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2ba4 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.153348:0:6489:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.153359:0:6489:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374ce00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835121.153363:0:6489:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2ba4 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.153370:0:6489:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2ba4 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.153378:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x719e0b09 (ffff9afdb2e5e100) 00010000:00010000:2.0:1788835121.153381:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835121.153384:0:6489:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2ba4 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.153390:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2ba4 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6489 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.153422:0:6489:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374c000/0xdf60171e5a5d2b96 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae087a expref: 28 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.153434:0:6489:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2bab lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae087a expref: 27 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835121.153441:0:6489:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:2.0:1788835121.153443:0:6489:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788835121.153445:0:6489:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374dc00, rc 0) 00000100:00100000:2.0:1788835121.153473:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+27:12427:x1875729242498176:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 10909us (11078us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835121.153480:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 249 00000100:00100000:3.0:1788835121.445471:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254072960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835121.445550:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835121.445749:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254072960 00000100:00100000:1.0:1788835121.445756:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254072960 00000100:00100000:1.0:1788835121.445800:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1788835121.445808:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254072960:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788835121.445842:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:1.0:1788835121.445902:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254072960:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835121.445909:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1788835121.446246:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1788835121.446257:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254073216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788835121.446304:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835121.446363:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254073216 00000100:00100000:3.0:1788835121.446368:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254073216 00000100:00100000:3.0:1788835121.446406:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1788835121.446413:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254073216:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788835121.446428:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788835121.446461:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254073216:12345-0@lo:13:osp-pre-0-1.0 Request processed in 48us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835121.446468:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00080000:3.0:1788835121.446484:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788835121.446500:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254073088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788835121.446528:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835121.446555:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254073088 00000100:00100000:3.0:1788835121.446559:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254073088 00000100:00100000:3.0:1788835121.446581:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788835121.446587:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdc156ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3615:x1875729254073088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788835121.446597:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42409664 pending 57344 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788835121.446626:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdc156ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+9:3615:x1875729254073088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 39us (97us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835121.446632:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1788835121.446847:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254073088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788835121.447234:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254073216:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788835121.447267:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254072960:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835121.447616:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254073600:0@lo:400:kworker.0 00000100:00100000:3.0:1788835121.447654:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835121.447687:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254074112:0@lo:400:kworker.0 00000100:00100000:3.0:1788835121.447710:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835121.447732:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788835121.447738:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875729254073472:0@lo:400:kworker.0 00000100:00100000:3.0:1788835121.447757:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835121.447772:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729254073984:0@lo:400:kworker.0 00000100:00100000:3.0:1788835121.447790:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835121.447815:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254073600 00000100:00100000:3.0:1788835121.447820:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254073600 00000100:00100000:3.0:1788835121.447851:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1788835121.447858:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254073600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835121.447966:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254074112 00000100:00100000:0.0:1788835121.447971:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254074112 00000100:00100000:0.0:1788835121.448030:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254073472 00000100:00100000:0.0:1788835121.448034:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254073472 00000100:00100000:0.0:1788835121.448052:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254073984 00000100:00100000:0.0:1788835121.448055:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254073984 00000100:00100000:0.0:1788835121.448069:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788835121.448075:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729254074112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835121.448123:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729254074112:12345-0@lo:400:kworker.0 Request processed in 47us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835121.448130:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 322 00000100:00100000:0.0:1788835121.448144:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788835121.448150:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875729254073472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835121.448176:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875729254073472:12345-0@lo:400:kworker.0 Request processed in 26us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835121.448181:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 323 00000100:00100000:0.0:1788835121.448215:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 324 00000100:00100000:0.0:1788835121.448221:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729254073984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835121.448250:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729254073984:12345-0@lo:400:kworker.0 Request processed in 29us (458us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835121.448255:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 324 00000100:00100000:1.0:1788835121.448603:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729254073728:0@lo:400:kworker.0 00000100:00100000:1.0:1788835121.448637:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835121.448674:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254074240:0@lo:400:kworker.0 00000100:00100000:1.0:1788835121.448695:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835121.448713:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788835121.448719:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254073344:0@lo:400:kworker.0 00000100:00100000:1.0:1788835121.448748:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835121.448771:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729254073856:0@lo:400:kworker.0 00000100:00100000:1.0:1788835121.448792:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835121.448809:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254074368:0@lo:400:kworker.0 00000100:00100000:1.0:1788835121.448832:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835121.448860:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254073344 00000100:00100000:1.0:1788835121.448874:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254073344 00000100:00100000:1.0:1788835121.448909:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788835121.448924:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254073344:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835121.448960:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7281850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254073344:12345-0@lo:400:kworker.0 Request processed in 45us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835121.448985:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 390 00000100:00100000:1.0:1788835121.449219:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254074368 00000100:00100000:1.0:1788835121.449224:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254074368 00000100:00100000:1.0:1788835121.449257:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788835121.449263:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254074368:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835121.449297:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254074368:12345-0@lo:400:kworker.0 Request processed in 34us (464us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835121.449303:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1788835121.449354:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254073728 00000100:00100000:1.0:1788835121.449358:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254073728 00000100:00100000:1.0:1788835121.449374:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254074240 00000100:00100000:1.0:1788835121.449377:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254074240 00000100:00100000:1.0:1788835121.449389:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254073856 00000100:00100000:1.0:1788835121.449391:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254073856 00000100:00100000:1.0:1788835121.449406:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788835121.449412:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729254073728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835121.449442:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729254073728:12345-0@lo:400:kworker.0 Request processed in 30us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835121.449448:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 325 00000100:00100000:1.0:1788835121.449459:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788835121.449465:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254074240:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835121.449490:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254074240:12345-0@lo:400:kworker.0 Request processed in 26us (794us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835121.449496:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 326 00000100:00100000:1.0:1788835121.449507:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788835121.449512:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729254073856:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835121.449550:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729254073856:12345-0@lo:400:kworker.0 Request processed in 38us (756us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835121.449557:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 327 00000100:00100000:1.0:1788835121.449597:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254073344:0@lo:400:kworker.0 00000100:00100000:1.0:1788835121.449610:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729254073856:0@lo:400:kworker.0 00000100:00100000:1.0:1788835121.449618:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254074368:0@lo:400:kworker.0 00000100:00100000:1.0:1788835121.449627:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729254073728:0@lo:400:kworker.0 00010000:00080000:1.0:1788835121.449638:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36ed80 x1875729254074240/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835121.449650:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254074240:0@lo:400:kworker.0 00000100:00100000:3.0:1788835121.449824:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254073600:12345-0@lo:400:kworker.0 Request processed in 1966us (2169us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835121.449833:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00080000:3.0:1788835121.449860:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1788835121.449934:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:3.0:1788835121.449936:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788835121.449964:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875729254073472:0@lo:400:kworker.0 00010000:00080000:3.0:1788835121.450701:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36ca80 x1875729254073984/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835121.450719:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729254073984:0@lo:400:kworker.0 00000100:00100000:3.0:1788835121.450737:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254073600:0@lo:400:kworker.0 00000100:00100000:3.0:1788835121.450748:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254074112:0@lo:400:kworker.0 00010000:00010000:1.0:1788835121.637861:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1788835121.651567:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:0.0:1788835121.651582:0:8398:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000100:00100000:0.0:1788835121.957530:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788835121.957552:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254074496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788835121.957619:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835121.957689:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254074496 00000100:00100000:0.0:1788835121.957696:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254074496 00000100:00100000:0.0:1788835121.957742:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788835121.957750:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1875729254074496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788835121.957784:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691941888 00000100:00100000:0.0:1788835121.957827:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83109f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3615:x1875729254074496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (207us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835121.957835:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1788835121.957893:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254074496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788835121.962253:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254074624:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788835121.962339:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835121.965694:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254074624 00000100:00100000:3.0:1788835121.965707:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254074624 00000100:00100000:3.0:1788835121.965767:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788835121.965784:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254074624:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788835121.965806:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691941888 00000100:00100000:3.0:1788835121.968994:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254074624:12345-0@lo:13:osp-pre-1-1.0 Request processed in 3210us (6645us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835121.969009:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1788835121.970177:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254074624:0@lo:13:osp-pre-1-1.0 00000040:00080000:2.0:1788835122.070079:0:14627:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788835122.070094:0:14627:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788835122.070131:0:14627:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788835122.070138:0:14627:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1788835122.149509:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1788835122.149522:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788835122.149553:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1788835122.149562:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1788835122.149720:0:13768:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb92a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875729254074752:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788835122.149811:0:13768:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd81254240 going to sleep for 11 seconds 00000100:00100000:1.0:1788835122.160745:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835122.160759:0:13768:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb92a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:13768:1875729254074752:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788835122.160889:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242498688 00000100:00100000:3.0:1788835122.160898:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242498688 00000100:00100000:3.0:1788835122.160960:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 250 00000100:00100000:3.0:1788835122.160970:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+27:12439:x1875729242498688:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788835122.161001:0:6489:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000402:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788835122.161110:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b8987b33-76f7-43a0-9448-1013c4af787f+27:12439:x1875729242498688:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 141us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835122.161119:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 250 00000100:00100000:3.0:1788835122.163822:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835122.163910:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242498944 00000100:00100000:1.0:1788835122.163929:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242498944 00000100:00100000:1.0:1788835122.163997:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 251 00000100:00100000:1.0:1788835122.164007:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+27:12439:x1875729242498944:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788835122.164026:0:9047:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835122.164046:0:9047:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2bb2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0881 expref: -99 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835122.164146:0:9047:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2bb9 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835122.164160:0:9047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835122.164174:0:9047:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2bb9 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9047 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835122.164184:0:9047:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:1.0:1788835122.164288:0:9047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2bb2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0881 expref: 30 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835122.164306:0:9047:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2bb9 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0881 expref: 29 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835122.164343:0:9047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:1.0:1788835122.164347:0:9047:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788835122.164351:0:9047:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60e00, rc 0) 00000100:00100000:1.0:1788835122.164404:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+29:12439:x1875729242498944:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 399us (590us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1788835122.164411:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 251 00000100:00100000:0.0:1788835122.169378:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835122.169465:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242499072 00000100:00100000:3.0:1788835122.169475:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242499072 00000100:00100000:3.0:1788835122.169533:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:3.0:1788835122.169542:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83109180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+29:2385:x1875729242499072:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788835122.169557:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835122.169580:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60e00/0xdf60171e5a5d2bb9 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0881 expref: 29 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835122.169596:0:7430:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:3.0:1788835122.169600:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835122.169656:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83109180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b8987b33-76f7-43a0-9448-1013c4af787f+28:2385:x1875729242499072:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 115us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835122.169673:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:1.0:1788835122.183271:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835122.183396:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242499328 00000100:00100000:0.0:1788835122.183407:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242499328 00000100:00100000:0.0:1788835122.183466:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 252 00000100:00100000:0.0:1788835122.183477:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+28:12439:x1875729242499328:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788835122.183554:0:6487:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2bc7 lrc: 3/0,1 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835122.183579:0:6487:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2bc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835122.183590:0:6487:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2bc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835122.183750:0:6487:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2bc7 lrc: 3/0,1 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835122.183758:0:6487:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2bc7 lrc: 2/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835122.183765:0:6487:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2bc7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835122.183771:0:6487:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835122.183775:0:6487:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2bc7 lrc: 3/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835122.183782:0:6487:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2bc7 lrc: 4/0,0 mode: PW/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835122.183794:0:6487:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:0.0:1788835122.183797:0:6487:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788835122.183802:0:6487:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2bc7 lrc: 2/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835122.183809:0:6487:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d2bc7 lrc: 0/0,0 mode: --/PW res: [0x200000402:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6487 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835122.183937:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+29:12439:x1875729242499328:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 462us (674us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1788835122.183950:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 252 00000040:00080000:2.0:1788835122.184229:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788835122.184234:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788835122.184936:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1788835122.184947:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788835122.189412:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835122.190943:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242499584 00000100:00100000:2.0:1788835122.190956:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242499584 00000100:00100000:2.0:1788835122.191160:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:2.0:1788835122.191172:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+29:12439:x1875729242499584:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788835122.191418:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+30:12439:x1875729242499584:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 248us (2015us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1788835122.191427:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00010000:00010000:3.0:1788835122.665447:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835122.981920:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254074880:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788835122.982001:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835122.982120:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254074880 00000100:00100000:2.0:1788835122.982130:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254074880 00000100:00100000:2.0:1788835122.982185:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1788835122.982194:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254074880:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788835122.982224:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:2.0:1788835122.983288:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254074880:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1092us (1284us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835122.983397:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254074880:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788835122.983469:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000040:00080000:2.0:1788835123.238037:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788835123.238046:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788835123.238067:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788835123.238079:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1788835123.686011:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788835123.816244:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000040:00080000:2.0:1788835123.906751:0:14679:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788835123.906761:0:14679:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788835123.906793:0:14679:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1788835123.906800:0:14679:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1788835124.061677:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835124.062225:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242499840 00000100:00100000:2.0:1788835124.062235:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242499840 00000100:00100000:2.0:1788835124.064422:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 253 00000100:00100000:2.0:1788835124.064437:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+30:12460:x1875729242499840:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788835124.064460:0:6488:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835124.064478:0:6488:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2bce lrc: 2/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0888 expref: -99 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835124.064575:0:6488:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2bd5 lrc: 3/1,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835124.064587:0:6488:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2bd5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835124.064600:0:6488:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2bd5 lrc: 3/1,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6488 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835124.064609:0:6488:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000402:0xe:0x0]: returning size 0 00010000:00010000:2.0:1788835124.064702:0:6488:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2bce lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0888 expref: 33 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835124.064717:0:6488:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2bd5 lrc: 3/0,0 mode: CR/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0888 expref: 32 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835124.064727:0:6488:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:2.0:1788835124.064737:0:6488:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1788835124.064741:0:6488:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374ce00, rc 0) 00000100:00100000:2.0:1788835124.066101:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+32:12460:x1875729242499840:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 1659us (4422us total) trans 4294967521 rc 0/0 00000100:00100000:2.0:1788835124.066113:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 253 00000100:00080000:2.0:1788835124.066151:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788835124.076567:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835124.076662:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242499968 00000100:00100000:2.0:1788835124.076672:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242499968 00000100:00100000:2.0:1788835124.076732:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 254 00000100:00100000:2.0:1788835124.076742:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+32:12460:x1875729242499968:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:2.0:1788835124.076822:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2be3 lrc: 3/1,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835124.076841:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2be3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835124.077070:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2be3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835124.077108:0:9806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2be3 lrc: 3/1,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835124.077115:0:9806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2be3 lrc: 2/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835124.077122:0:9806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2be3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835124.077128:0:9806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835124.077132:0:9806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2be3 lrc: 3/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835124.077151:0:9806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2be3 lrc: 4/0,0 mode: PR/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835124.077164:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:2.0:1788835124.077167:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788835124.077171:0:9806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2be3 lrc: 2/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835124.077177:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d600/0xdf60171e5a5d2be3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835124.077243:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:b8987b33-76f7-43a0-9448-1013c4af787f+32:12460:x1875729242499968:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 501us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835124.077250:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 254 00000100:00100000:1.0:1788835124.163566:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835124.165227:0:8403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242500096 00000100:00100000:0.0:1788835124.165240:0:8403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242500096 00000100:00100000:2.0:1788835124.165578:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00100000:2.0:1788835124.165590:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+7:2386:x1875729242500096:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:2.0:1788835124.165607:0:8403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835124.165628:0:8403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000aa97d7b3/0xdf60171e5a5d2bea lrc: 2/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae088f expref: -99 pid: 8403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788835124.165654:0:8403:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x6:0x0] initial LVB size: 13, mtime: 0x6a9f7531, atime: 0x6a9f7531, ctime: 0x6a9f7531, blocks: 0x8 00010000:00010000:2.0:1788835124.165672:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=366s v=(0 0) 00010000:00010000:2.0:1788835124.165677:0:8403:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835124.165686:0:8403:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000aa97d7b3/0xdf60171e5a5d2bea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae088f expref: 8 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835124.165705:0:8403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000aa97d7b3/0xdf60171e5a5d2bea lrc: 3/0,0 mode: PR/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae088f expref: 8 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835124.165732:0:8403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374d600, rc 0) 00000100:00100000:2.0:1788835124.165796:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b8987b33-76f7-43a0-9448-1013c4af787f+8:2386:x1875729242500096:12345-192.168.203.22@tcp:101:cat.0 Request processed in 208us (2239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835124.165803:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 81 00000100:00080000:3.0:1788835124.166259:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788835124.171960:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835124.172079:0:8408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242500224 00000100:00100000:3.0:1788835124.172089:0:8408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242500224 00002000:00100000:3.0:1788835124.172144:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9afc845fc700 x1875729242500224/t0(0) o3->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:45/0 lens 488/0 e 0 to 0 dl 1788835135 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788835124.172156:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afc845fc700 with x1875729242500224 ext(0->4095) 00002000:00010000:3.0:1788835124.172162:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afc845fc700 00000100:00100000:3.0:1788835124.172243:0:8408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:3.0:1788835124.172254:0:8408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b8987b33-76f7-43a0-9448-1013c4af787f+8:2385:x1875729242500224:12345-192.168.203.22@tcp:3:cat.0 00000100:00100000:3.0:1788835124.172470:0:8408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:b8987b33-76f7-43a0-9448-1013c4af787f+8:2385:x1875729242500224:12345-192.168.203.22@tcp:3:cat.0 Request processed in 217us (615us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1788835124.172478:0:8408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00002000:00100000:3.0:1788835124.172485:0:8408:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x2c0000401:0x6:0x0] (0->4095) req@ffff9afc845fc700 x1875729242500224/t0(0) o3->b8987b33-76f7-43a0-9448-1013c4af787f@192.168.203.22@tcp:45/0 lens 488/4536 e 0 to 0 dl 1788835135 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1788835124.172494:0:8408:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9afc845fc700 with x1875729242500224 ext(0->4095) 00002000:00010000:3.0:1788835124.172497:0:8408:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9afc845fc700 00010000:00010000:1.0:1788835124.710997:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835125.341654:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835125.341700:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835125.341740:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835125.341765:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835125.341782:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835125.341800:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835125.341824:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835125.341851:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242500864 00000100:00100000:0.0:1788835125.341860:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242500864 00000100:00100000:0.0:1788835125.341919:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242500736 00000100:00100000:0.0:1788835125.341922:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242500736 00000100:00100000:0.0:1788835125.342040:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 124 00000100:00100000:0.0:1788835125.342051:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+8:2386:x1875729242500864:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835125.342120:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+8:2386:x1875729242500864:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 71us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835125.342195:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 124 00000100:00100000:0.0:1788835125.342216:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 125 00000100:00100000:0.0:1788835125.342223:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242500736:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835125.342254:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83108700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242500736:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 31us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835125.342260:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 125 00000100:00100000:0.0:1788835125.342279:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242500608 00000100:00100000:0.0:1788835125.342296:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242500608 00000100:00100000:0.0:1788835125.342360:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242501120 00000100:00100000:0.0:1788835125.342364:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242501120 00000100:00100000:0.0:1788835125.342377:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242500480 00000100:00100000:0.0:1788835125.342379:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242500480 00000100:00100000:0.0:1788835125.342388:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242500992 00000100:00100000:0.0:1788835125.342390:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242500992 00000100:00100000:0.0:1788835125.342403:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 328 00000100:00100000:0.0:1788835125.342409:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242500608:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835125.342438:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2386:x1875729242500608:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 29us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835125.342443:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 328 00000100:00100000:0.0:1788835125.342454:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 329 00000100:00100000:0.0:1788835125.342460:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242501120:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835125.342481:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242501120:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 22us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835125.342486:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 329 00000100:00100000:0.0:1788835125.342496:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 330 00000100:00100000:0.0:1788835125.342501:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+32:2386:x1875729242500480:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835125.342521:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+32:2386:x1875729242500480:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 20us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835125.342526:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 330 00000100:00100000:0.0:1788835125.342538:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 331 00000100:00100000:0.0:1788835125.342543:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242500992:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835125.342566:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2386:x1875729242500992:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 23us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835125.342579:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 331 00000100:00080000:0.0:1788835125.342610:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788835125.342614:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788835125.342616:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788835125.342866:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242500352 00000100:00100000:3.0:1788835125.342870:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242500352 00000100:00100000:3.0:1788835125.342919:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 391 00000100:00100000:3.0:1788835125.342927:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:2386:x1875729242500352:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835125.342991:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7280050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:e8f7875b-4951-482c-9de0-d3888250010c+13:2386:x1875729242500352:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 65us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835125.342998:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 391 00010000:00010000:3.0:1788835125.733744:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835126.565794:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254075008:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835126.565864:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835126.565956:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254075136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788835126.565987:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835126.566023:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254075008 00000100:00100000:3.0:1788835126.566031:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254075008 00000100:00100000:3.0:1788835126.566077:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788835126.566085:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254075008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788835126.566119:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:3.0:1788835126.566167:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254075008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835126.566175:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1788835126.566198:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254075136 00000100:00100000:3.0:1788835126.566202:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254075136 00000100:00100000:3.0:1788835126.566240:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788835126.566247:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254075136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788835126.566266:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:3.0:1788835126.566303:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254075136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 56us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835126.566310:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00080000:3.0:1788835126.566358:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788835126.566387:0:3614:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:3.0:1788835126.566400:0:3614:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967307 committed transno 4294967311 00000004:00080000:3.0:1788835126.566430:0:3614:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afdbfb93100, transno 4294967308 00000004:00080000:3.0:1788835126.566441:0:3614:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967310 committed transno 4294967311 00000004:00080000:3.0:1788835126.566451:0:3614:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afc845ffb80, transno 4294967311 00000100:00100000:3.0:1788835126.566463:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254075136:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788835126.566826:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254075008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788835126.566947:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254075264:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835126.566981:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835126.567023:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254075264 00000100:00100000:1.0:1788835126.567027:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254075264 00000100:00100000:1.0:1788835126.567060:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1788835126.567067:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254075264:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:1.0:1788835126.567079:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:1.0:1788835126.567112:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254075264:12345-0@lo:13:osp-pre-0-1.0 Request processed in 45us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835126.567118:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00080000:1.0:1788835126.567134:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788835126.567153:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254075264:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788835126.567428:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254075392:0@lo:400:kworker.0 00000100:00100000:1.0:1788835126.567437:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254075776:0@lo:400:kworker.0 00000100:00100000:0.0:1788835126.567474:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835126.567481:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835126.567507:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729254075904:0@lo:400:kworker.0 00000100:00100000:1.0:1788835126.567513:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875729254076288:0@lo:400:kworker.0 00000100:00100000:0.0:1788835126.567549:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835126.567558:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254075392 00000100:00100000:1.0:1788835126.567563:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254075392 00000100:00100000:0.0:1788835126.567577:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254076416:0@lo:400:kworker.0 00000100:00100000:1.0:1788835126.567599:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 392 00000100:00100000:1.0:1788835126.567608:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254075392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835126.567615:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835126.567640:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:0.0:1788835126.567650:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254075520:0@lo:400:kworker.0 00000100:00100000:1.0:1788835126.567663:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3616:x1875729254075392:12345-0@lo:400:kworker.0 Request processed in 56us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835126.567671:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 392 00000100:00100000:0.0:1788835126.567680:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835126.567701:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729254076032:0@lo:400:kworker.0 00000100:00100000:1.0:1788835126.567707:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254075776 00000100:00100000:1.0:1788835126.567712:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254075776 00000100:00100000:0.0:1788835126.567730:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835126.567792:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254075648:0@lo:400:kworker.0 00000100:00100000:3.0:1788835126.567821:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835126.567854:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875729254076160:0@lo:400:kworker.0 00000100:00100000:3.0:1788835126.567900:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254075648 00000100:00100000:3.0:1788835126.567904:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254075648 00000100:00100000:3.0:1788835126.567929:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1788835126.567935:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254075648:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835126.567978:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254075648:12345-0@lo:400:kworker.0 Request processed in 42us (157us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835126.567984:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1788835126.571533:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254075904 00000100:00100000:1.0:1788835126.571545:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254075904 00000100:00100000:1.0:1788835126.571596:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254075520 00000100:00100000:1.0:1788835126.571600:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254075520 00000100:00100000:1.0:1788835126.571619:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254076032 00000100:00100000:1.0:1788835126.571623:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254076032 00000100:00100000:1.0:1788835126.571647:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788835126.571659:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254075776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835126.571749:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254075776:12345-0@lo:400:kworker.0 Request processed in 94us (4268us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835126.571757:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 332 00000100:00100000:1.0:1788835126.571776:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788835126.571782:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729254075904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835126.571812:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729254075904:12345-0@lo:400:kworker.0 Request processed in 30us (4264us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835126.571818:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 333 00000100:00100000:1.0:1788835126.571829:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788835126.571836:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254075520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835126.571865:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254075520:12345-0@lo:400:kworker.0 Request processed in 31us (4186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835126.571871:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 334 00000100:00100000:1.0:1788835126.571894:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 335 00000100:00100000:1.0:1788835126.571913:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729254076032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835126.571944:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729254076032:12345-0@lo:400:kworker.0 Request processed in 33us (4215us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835126.571950:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 335 00000100:00080000:1.0:1788835126.571980:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788835126.571984:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788835126.571996:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835126.572051:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83108380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254075776:0@lo:400:kworker.0 00000100:00100000:1.0:1788835126.572090:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254076288 00000100:00100000:1.0:1788835126.572094:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254076288 00000100:00100000:1.0:1788835126.572127:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 336 00000100:00100000:1.0:1788835126.572137:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875729254076288:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835126.572180:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875729254076288:12345-0@lo:400:kworker.0 Request processed in 46us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835126.572186:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 336 00000100:00080000:1.0:1788835126.572206:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:1.0:1788835126.572227:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc844ab100 x1875729254076288/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835126.572245:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875729254076288:0@lo:400:kworker.0 00000100:00100000:3.0:1788835126.574249:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254076416 00000100:00100000:3.0:1788835126.574261:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254076416 00000100:00100000:3.0:1788835126.574328:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788835126.574337:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254076416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835126.574410:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba758450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254076416:12345-0@lo:400:kworker.0 Request processed in 74us (6799us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835126.574416:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:3.0:1788835126.574573:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835126.574626:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254075648:0@lo:400:kworker.0 00000100:00080000:1.0:1788835126.574720:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788835126.574869:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254076160 00000100:00100000:1.0:1788835126.575163:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254076160 00000001:00080000:1.0:1788835126.575662:0:6467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1788835126.575698:0:6467:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9afd86b53b40 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:1.0:1788835126.575704:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afdba43b800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9afda1217f00 00000020:00080000:1.0:1788835126.575708:0:6467:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9afdba43ba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9afc844f8c00 00000020:00080000:1.0:1788835126.575735:0:6467:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00010000:00010000:1.0:1788835126.575752:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d2b65 lrc: 3/0,1 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835126.575763:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d2b65 lrc: 2/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835126.575771:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d2b65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835126.575777:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374cc00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835126.575781:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d2b65 lrc: 3/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835126.575789:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d2b65 lrc: 4/0,0 mode: TXN/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835126.575806:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x10:0x0].0x0 (ffff9afda01ec600) 00010000:00010000:1.0:1788835126.575809:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835126.575813:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d2b65 lrc: 2/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835126.575819:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374cc00/0xdf60171e5a5d2b65 lrc: 0/0,0 mode: --/TXN res: [0x200000402:0x10:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835126.576907:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 337 00000100:00100000:1.0:1788835126.576918:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875729254076160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835126.576999:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875729254076160:12345-0@lo:400:kworker.0 Request processed in 84us (2427us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835126.577007:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 337 00000100:00080000:1.0:1788835126.577027:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788835126.577069:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875729254076160:0@lo:400:kworker.0 00010000:00080000:1.0:1788835126.578087:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc844aaa00 x1875729254076032/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835142 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835126.578101:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729254076032:0@lo:400:kworker.0 00000100:00100000:1.0:1788835126.578112:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254076544:0@lo:400:kworker.0 00000100:00100000:1.0:1788835126.578152:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835126.578192:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254075392:0@lo:400:kworker.0 00000100:00100000:1.0:1788835126.578203:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729254075904:0@lo:400:kworker.0 00000100:00100000:1.0:1788835126.578239:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254076416:0@lo:400:kworker.0 00000100:00100000:3.0:1788835126.578262:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254076544 00000100:00100000:3.0:1788835126.578269:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254076544 00000100:00100000:3.0:1788835126.578309:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1788835126.578332:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3616:x1875729254076544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835126.578369:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3616:x1875729254076544:12345-0@lo:400:kworker.0 Request processed in 54us (217us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835126.578376:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00080000:3.0:1788835126.578392:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788835126.578451:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83108a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254075520:0@lo:400:kworker.0 00000100:00100000:1.0:1788835126.578459:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254076544:0@lo:400:kworker.0 00000020:00080000:2.0:1788835126.579573:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1788835126.579655:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:3.0:1788835126.757559:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835127.082688:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254076672:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788835127.082990:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835127.083144:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254076672 00000100:00100000:1.0:1788835127.083151:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254076672 00000100:00100000:1.0:1788835127.083197:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788835127.083207:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729254076672:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788835127.083234:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:1.0:1788835127.083280:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3614:x1875729254076672:12345-0@lo:13:osp-pre-1-0.0 Request processed in 75us (290us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835127.083287:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1788835127.083353:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254076672:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788835127.084238:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788835127.084251:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254076800:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788835127.084304:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835127.084431:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254076800 00000100:00100000:3.0:1788835127.084437:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254076800 00000100:00100000:3.0:1788835127.084505:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788835127.084514:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254076800:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:3.0:1788835127.084532:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788835127.084573:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254076800:12345-0@lo:13:osp-pre-1-1.0 Request processed in 60us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835127.084581:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000001:00080000:0.0:1788835127.084936:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967326 is committed 00000001:00080000:0.0:1788835127.084945:0:9481:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967325 is committed 00000100:00100000:3.0:1788835127.093056:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254076800:0@lo:13:osp-pre-1-1.0 00010000:00010000:1.0:1788835127.781535:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835128.101930:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1788835128.101961:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254076928:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788835128.102056:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835128.102196:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254076928 00000100:00100000:1.0:1788835128.102208:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254076928 00000100:00100000:1.0:1788835128.102278:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1788835128.102289:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254076928:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788835128.102359:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788835128.102428:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254076928:12345-0@lo:41:osp-pre-0-1.0 Request processed in 141us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835128.102437:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1788835128.102607:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254076928:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788835128.808086:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835129.086362:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835129.093432:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242501248 00000100:00100000:3.0:1788835129.093454:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242501248 00000100:00080000:0.0:1788835129.093713:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1788835129.093715:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 255 00000100:00100000:2.0:1788835129.093734:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+18:12113:x1875729242501248:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788835129.093916:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+18:12113:x1875729242501248:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 Request processed in 187us (7613us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835129.093925:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 255 00000100:00100000:3.0:1788835129.096024:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835129.096585:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242501376 00000100:00100000:2.0:1788835129.096598:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242501376 00000100:00100000:2.0:1788835129.096989:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 256 00000100:00100000:2.0:1788835129.097003:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:12113:x1875729242501376:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1788835129.097152:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:12113:x1875729242501376:12345-192.168.203.22@tcp:60:lhsmtool_posix.0 Request processed in 152us (1143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835129.097161:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 256 00000100:00080000:0.0:1788835129.099221:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788835129.101991:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835129.102084:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242501632 00000100:00100000:3.0:1788835129.102097:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242501632 00000100:00100000:3.0:1788835129.102196:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:3.0:1788835129.102209:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+18:12113:x1875729242501632:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1788835129.103649:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+19:12113:x1875729242501632:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 1434us (1665us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1788835129.103692:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 65 00000100:00100000:3.0:1788835129.385512:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835129.385728:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242501760 00000100:00100000:1.0:1788835129.385742:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242501760 00000100:00080000:0.0:1788835129.385840:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788835129.385848:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 257 00000100:00100000:1.0:1788835129.385869:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:12917:x1875729242501760:12345-192.168.203.22@tcp:101:lsof.0 00010000:00010000:1.0:1788835129.385897:0:9806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835129.385923:0:9806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2bf1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0896 expref: -99 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835129.386023:0:9806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2bf8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835129.386041:0:9806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835129.386056:0:9806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835129.386121:0:9806:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788835129.386125:0:9806:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835129.386172:0:9806:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2bf8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 9806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835129.386202:0:9806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60c00/0xdf60171e5a5d2bf1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0896 expref: 7 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835129.386224:0:9806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2bf8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0896 expref: 6 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835129.386234:0:9806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afd93eb1c00) 00010000:00010000:1.0:1788835129.386237:0:9806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788835129.386241:0:9806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61e00, rc 0) 00000100:00100000:1.0:1788835129.386558:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:12917:x1875729242501760:12345-192.168.203.22@tcp:101:lsof.0 Request processed in 697us (1059us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835129.386567:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 257 00010000:00010000:3.0:1788835129.838963:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835130.467783:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835130.467849:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835130.467896:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835130.467925:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835130.467953:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835130.467974:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835130.468023:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835130.468060:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242502400 00000100:00100000:1.0:1788835130.468072:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242502400 00000100:00100000:1.0:1788835130.468139:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242502272 00000100:00100000:1.0:1788835130.468144:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242502272 00000100:00100000:1.0:1788835130.468173:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 128 00000100:00100000:1.0:1788835130.468184:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+7:2387:x1875729242502400:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835130.468280:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+7:2387:x1875729242502400:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 98us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835130.468302:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 128 00000100:00100000:1.0:1788835130.468368:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 129 00000100:00100000:1.0:1788835130.468376:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+5:2387:x1875729242502272:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835130.468406:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:b8987b33-76f7-43a0-9448-1013c4af787f+5:2387:x1875729242502272:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 30us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835130.468412:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 129 00000100:00100000:1.0:1788835130.468438:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242502144 00000100:00100000:1.0:1788835130.468441:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242502144 00000100:00100000:1.0:1788835130.468467:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242502656 00000100:00100000:1.0:1788835130.468471:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242502656 00000100:00100000:1.0:1788835130.468484:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242502016 00000100:00100000:1.0:1788835130.468486:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242502016 00000100:00100000:1.0:1788835130.468496:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242502528 00000100:00100000:1.0:1788835130.468498:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242502528 00000100:00100000:1.0:1788835130.468511:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 338 00000100:00100000:1.0:1788835130.468518:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2387:x1875729242502144:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835130.468548:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2387:x1875729242502144:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 30us (699us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835130.468554:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 338 00000100:00100000:1.0:1788835130.468565:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 339 00000100:00100000:1.0:1788835130.468571:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2387:x1875729242502656:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835130.468609:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2387:x1875729242502656:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 38us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835130.468615:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 339 00000100:00100000:1.0:1788835130.468626:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 340 00000100:00100000:1.0:1788835130.468639:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+19:2387:x1875729242502016:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835130.468673:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+19:2387:x1875729242502016:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 35us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835130.468680:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 340 00000100:00100000:1.0:1788835130.468691:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 341 00000100:00100000:1.0:1788835130.468697:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2387:x1875729242502528:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835130.468718:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2387:x1875729242502528:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 21us (695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835130.468723:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 341 00000100:00100000:0.0:1788835130.468951:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242501888 00000100:00100000:0.0:1788835130.468957:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242501888 00000100:00100000:0.0:1788835130.468997:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 393 00000100:00100000:0.0:1788835130.469005:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:2387:x1875729242501888:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835130.469033:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:e8f7875b-4951-482c-9de0-d3888250010c+13:2387:x1875729242501888:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 30us (1265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835130.469040:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 393 00000100:00080000:0.0:1788835130.469072:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788835130.469079:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788835130.469081:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788835130.853605:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1788835131.687307:0:6467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967522 is committed 00000020:00080000:1.0:1788835131.687357:0:6467:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:2.0:1788835131.687419:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:2.0:1788835131.687435:0:6519:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000100:00100000:3.0:1788835131.687625:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254077056:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788835131.687721:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835131.687966:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788835131.687981:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254077184:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788835131.688033:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835131.688420:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254077056 00000100:00100000:0.0:1788835131.688429:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254077056 00000100:00100000:0.0:1788835131.688497:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:0.0:1788835131.688509:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254077056:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788835131.688548:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788835131.689200:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254077440:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.689244:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835131.689274:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729254077952:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.689294:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835131.689310:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254078464:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.689343:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835131.689365:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:2.0:1788835131.689371:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254077568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788835131.689393:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835131.689410:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729254078080:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.689431:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835131.689448:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254078592:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.690564:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835131.690649:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254077440 00000100:00100000:2.0:1788835131.690658:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254077440 00000100:00100000:2.0:1788835131.690713:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254077952 00000100:00100000:2.0:1788835131.690716:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254077952 00000100:00100000:2.0:1788835131.690735:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254078464 00000100:00100000:2.0:1788835131.690737:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254078464 00000100:00100000:2.0:1788835131.690749:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254078080 00000100:00100000:2.0:1788835131.690752:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254078080 00000100:00100000:2.0:1788835131.690769:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788835131.690777:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254077440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.690863:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254077440:12345-0@lo:400:kworker.0 Request processed in 86us (1617us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835131.690870:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 342 00000100:00100000:2.0:1788835131.690907:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788835131.690912:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729254077952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.690941:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729254077952:12345-0@lo:400:kworker.0 Request processed in 28us (1645us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835131.690946:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 343 00000100:00100000:2.0:1788835131.690956:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788835131.690961:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254078464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.690984:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254078464:12345-0@lo:400:kworker.0 Request processed in 23us (1640us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835131.690990:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 344 00000100:00100000:2.0:1788835131.691000:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788835131.691005:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729254078080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.691029:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729254078080:12345-0@lo:400:kworker.0 Request processed in 24us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835131.691034:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 345 00000100:00100000:2.0:1788835131.691058:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254077568 00000100:00100000:2.0:1788835131.691062:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254077568 00000100:00100000:2.0:1788835131.691084:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788835131.691091:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254077568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788835131.691110:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788835131.691142:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254077568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 53us (1749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835131.691148:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1788835131.691167:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254078592 00000100:00100000:2.0:1788835131.691171:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254078592 00000100:00100000:2.0:1788835131.691201:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788835131.691215:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254078592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.691247:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254078592:12345-0@lo:400:kworker.0 Request processed in 33us (688us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835131.691254:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1788835131.691306:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729254077312:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.691370:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835131.691399:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254077824:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.691428:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835131.691445:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254078336:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.691465:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835131.691486:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:2.0:1788835131.691493:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254077696:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.691517:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835131.691538:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254078208:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.691561:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835131.691579:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254078720:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.691601:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835131.691629:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254077312 00000100:00100000:2.0:1788835131.691632:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254077312 00000100:00100000:2.0:1788835131.691670:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1788835131.691676:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb7283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3615:x1875729254077312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.691709:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb7283c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3615:x1875729254077312:12345-0@lo:400:kworker.0 Request processed in 33us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835131.691716:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 394 00000100:00100000:2.0:1788835131.691747:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254077184 00000100:00100000:2.0:1788835131.691758:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254077184 00000100:00100000:2.0:1788835131.691785:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254077696 00000100:00100000:2.0:1788835131.691787:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254077696 00000100:00100000:2.0:1788835131.691800:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788835131.691805:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254077184:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788835131.691837:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788835131.691884:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254077184:12345-0@lo:41:osp-pre-1-0.0 Request processed in 79us (3851us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835131.691891:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1788835131.691902:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788835131.691908:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254077696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.691935:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254077696:12345-0@lo:400:kworker.0 Request processed in 27us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835131.691941:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1788835131.691968:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254078208 00000100:00100000:2.0:1788835131.691972:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254078208 00000100:00100000:2.0:1788835131.691991:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254078720 00000100:00100000:2.0:1788835131.691993:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254078720 00000100:00100000:2.0:1788835131.692014:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788835131.692021:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254078208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.692050:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254078208:12345-0@lo:400:kworker.0 Request processed in 29us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835131.692056:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1788835131.692067:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788835131.692073:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254078720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.692099:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254078720:12345-0@lo:400:kworker.0 Request processed in 26us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835131.692115:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1788835131.692137:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254077824 00000100:00100000:2.0:1788835131.692141:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254077824 00000100:00100000:2.0:1788835131.692159:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254078336 00000100:00100000:2.0:1788835131.692162:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254078336 00000100:00100000:2.0:1788835131.692176:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788835131.692182:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254077824:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.692213:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254077824:12345-0@lo:400:kworker.0 Request processed in 31us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835131.692220:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 346 00000100:00100000:2.0:1788835131.692230:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788835131.692237:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729254078336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.692261:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729254078336:12345-0@lo:400:kworker.0 Request processed in 26us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835131.692267:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 347 00000100:00100000:2.0:1788835131.692348:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254077568:0@lo:13:osp-pre-0-0.0 00010000:00080000:2.0:1788835131.692367:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc845ff100 x1875729254078080/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835131.692378:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729254078080:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.692389:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254078592:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.692402:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254077440:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.692414:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729254077952:0@lo:400:kworker.0 00010000:00080000:2.0:1788835131.692426:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc845fc380 x1875729254078464/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835147 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835131.692442:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254078464:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.692502:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254077696:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.692510:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254078208:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.692517:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 2 00000004:00080000:2.0:1788835131.692523:0:3615:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967326 committed transno 4294967326 00000100:00100000:2.0:1788835131.692542:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254078720:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.692551:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729254077312:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.692560:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254077824:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.692570:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254078336:0@lo:400:kworker.0 00000100:00100000:2.0:1788835131.692587:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254077184:0@lo:41:osp-pre-1-0.0 00000100:00080000:2.0:1788835131.692694:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788835131.692701:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788835131.692704:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788835131.692706:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788835131.697878:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254077056:12345-0@lo:13:osp-pre-0-1.0 Request processed in 9355us (10141us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835131.697896:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1788835131.701023:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254077056:0@lo:13:osp-pre-0-1.0 00010000:00010000:3.0:1788835131.880707:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835132.198365:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254078848:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788835132.198468:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835132.198612:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254078976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788835132.198633:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254078848 00000100:00100000:1.0:1788835132.198643:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254078848 00000100:00100000:3.0:1788835132.198652:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835132.198701:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254078976 00000100:00100000:1.0:1788835132.198705:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254078976 00000100:00100000:1.0:1788835132.198725:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1788835132.198735:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254078848:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788835132.198787:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788835132.198804:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1788835132.198817:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254078976:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788835132.198832:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 50732736 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788835132.198890:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254078976:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (237us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835132.198898:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1788835132.198972:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254078976:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788835132.199239:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254078848:12345-0@lo:13:osp-pre-1-1.0 Request processed in 504us (770us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835132.199256:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1788835132.203057:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254078848:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788835132.901534:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788835133.030287:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:02000400:3.0:1788835133.193256:0:14876:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:38:52 (1788835132) 00000100:00100000:3.0:1788835133.226812:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254079104:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788835133.226909:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835133.227180:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254079104 00000100:00100000:1.0:1788835133.227189:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254079104 00000100:00100000:1.0:1788835133.227244:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1788835133.227255:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254079104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788835133.227298:0:11555:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446260736 avail 1300021248 00000100:00100000:1.0:1788835133.227382:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254079104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 129us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835133.227390:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1788835133.227536:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254079104:0@lo:41:osp-pre-0-1.0 00000040:00080000:2.0:1788835133.477598:0:13768:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1788835133.477606:0:13768:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1788835133.477700:0:13768:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:2.0:1788835133.477709:0:13768:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1788835133.925584:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835134.949592:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835135.581713:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835135.581754:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835135.581792:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835135.581831:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835135.581851:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835135.581869:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835135.581888:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242503296 00000100:00100000:0.0:1788835135.581890:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835135.581897:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242503296 00000100:00100000:3.0:1788835135.581959:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242503168 00000100:00100000:3.0:1788835135.581963:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242503168 00000100:00080000:0.0:1788835135.582009:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788835135.582013:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1788835135.582077:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242502784 00000100:00100000:1.0:1788835135.582082:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242502784 00000100:00100000:3.0:1788835135.584469:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 133 00000100:00100000:3.0:1788835135.584492:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+7:2388:x1875729242503296:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835135.587183:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+7:2388:x1875729242503296:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 1830us (4518us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835135.587215:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 133 00000100:00100000:3.0:1788835135.587251:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 134 00000100:00100000:3.0:1788835135.587264:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2388:x1875729242503168:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835135.587308:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2388:x1875729242503168:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 49us (5437us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835135.587490:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242503040 00000100:00100000:0.0:1788835135.587499:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242503040 00000100:00100000:0.0:1788835135.587549:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242503552 00000100:00100000:0.0:1788835135.587553:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242503552 00000100:00100000:0.0:1788835135.587568:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242502912 00000100:00100000:0.0:1788835135.587570:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242502912 00000100:00100000:0.0:1788835135.587582:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242503424 00000100:00100000:0.0:1788835135.587584:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242503424 00000100:00100000:0.0:1788835135.587599:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 348 00000100:00100000:0.0:1788835135.587607:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2388:x1875729242503040:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835135.587639:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+5:2388:x1875729242503040:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 33us (5885us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835135.587645:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 348 00000100:00100000:0.0:1788835135.587658:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 349 00000100:00100000:0.0:1788835135.587663:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2388:x1875729242503552:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835135.587685:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2388:x1875729242503552:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 22us (5863us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835135.587691:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 349 00000100:00100000:0.0:1788835135.587709:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 350 00000100:00100000:0.0:1788835135.587715:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+18:2388:x1875729242502912:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835135.587741:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b8987b33-76f7-43a0-9448-1013c4af787f+18:2388:x1875729242502912:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 26us (5890us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835135.587748:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 350 00000100:00100000:0.0:1788835135.587758:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 351 00000100:00100000:0.0:1788835135.587764:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2388:x1875729242503424:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835135.587798:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2388:x1875729242503424:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 34us (5907us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835135.587803:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 351 00000100:00080000:0.0:1788835135.587837:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788835135.587841:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788835135.589607:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 134 00000100:00100000:1.0:1788835135.593199:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 395 00000100:00100000:1.0:1788835135.593219:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:2388:x1875729242502784:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835135.593895:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+13:2388:x1875729242502784:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 681us (12189us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835135.593904:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 395 00010000:00010000:3.0:1788835135.973650:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835136.805820:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254079232:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788835136.805901:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835136.806131:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254079232 00000100:00100000:2.0:1788835136.806139:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254079232 00000100:00100000:2.0:1788835136.806191:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788835136.806200:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254079232:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:2.0:1788835136.806230:0:6492:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446486016 avail 1300246528 00000100:00100000:2.0:1788835136.806276:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254079232:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835136.806284:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:2.0:1788835136.806357:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254079232:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835136.806562:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254079488:0@lo:400:kworker.0 00000100:00100000:3.0:1788835136.806594:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835136.806623:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729254080000:0@lo:400:kworker.0 00000100:00100000:3.0:1788835136.806644:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835136.806659:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254080512:0@lo:400:kworker.0 00000100:00100000:3.0:1788835136.806678:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835136.806773:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:3.0:1788835136.806780:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254079616:0@lo:400:kworker.0 00000100:00100000:3.0:1788835136.806805:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835136.806833:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254080128:0@lo:400:kworker.0 00000100:00100000:3.0:1788835136.806856:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835136.806870:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254080640:0@lo:400:kworker.0 00000100:00100000:3.0:1788835136.806887:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835136.806912:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254079616 00000100:00100000:3.0:1788835136.806916:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254079616 00000100:00100000:3.0:1788835136.806940:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788835136.806947:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254079616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835136.807000:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254079616:12345-0@lo:400:kworker.0 Request processed in 52us (193us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835136.807007:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1788835136.807026:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729254079360:0@lo:400:kworker.0 00000100:00100000:3.0:1788835136.807053:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835136.807073:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875729254079872:0@lo:400:kworker.0 00000100:00100000:3.0:1788835136.807106:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835136.807120:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254080384:0@lo:400:kworker.0 00000100:00100000:3.0:1788835136.807141:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835136.807156:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:3.0:1788835136.807160:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254079744:0@lo:400:kworker.0 00000100:00100000:3.0:1788835136.807179:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835136.807189:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254080256:0@lo:400:kworker.0 00000100:00100000:3.0:1788835136.807208:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835136.807221:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254080768:0@lo:400:kworker.0 00000100:00100000:3.0:1788835136.807238:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835136.807263:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254079488 00000100:00100000:3.0:1788835136.807267:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254079488 00000100:00100000:3.0:1788835136.807286:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254080000 00000100:00100000:3.0:1788835136.807289:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254080000 00000100:00100000:3.0:1788835136.807307:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254080512 00000100:00100000:3.0:1788835136.807310:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254080512 00000100:00100000:3.0:1788835136.807345:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254079872 00000100:00100000:3.0:1788835136.807348:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254079872 00000100:00100000:3.0:1788835136.807359:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254080384 00000100:00100000:3.0:1788835136.807360:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254080384 00000100:00100000:3.0:1788835136.807371:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788835136.807385:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254079488:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835136.807415:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254079488:12345-0@lo:400:kworker.0 Request processed in 32us (821us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835136.807422:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 352 00000100:00100000:3.0:1788835136.807434:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254079744 00000100:00100000:3.0:1788835136.807436:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254079744 00000100:00100000:3.0:1788835136.807449:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788835136.807455:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729254080000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835136.807480:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729254080000:12345-0@lo:400:kworker.0 Request processed in 25us (836us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835136.807486:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 353 00000100:00100000:3.0:1788835136.807497:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788835136.807503:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254080512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835136.807527:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254080512:12345-0@lo:400:kworker.0 Request processed in 24us (848us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835136.807532:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 354 00000100:00100000:3.0:1788835136.807541:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788835136.807546:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875729254079872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835136.807572:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875729254079872:12345-0@lo:400:kworker.0 Request processed in 26us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835136.807577:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 355 00000100:00100000:3.0:1788835136.807587:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788835136.807592:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729254080384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835136.807613:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729254080384:12345-0@lo:400:kworker.0 Request processed in 22us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835136.807628:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 356 00000100:00100000:3.0:1788835136.807640:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 357 00000100:00100000:3.0:1788835136.807645:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254079744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835136.807672:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e817100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254079744:12345-0@lo:400:kworker.0 Request processed in 27us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835136.807678:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 357 00000100:00100000:1.0:1788835136.808085:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254079616:0@lo:400:kworker.0 00000100:00100000:1.0:1788835136.808098:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254079488:0@lo:400:kworker.0 00010000:00080000:1.0:1788835136.808110:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfb93100 x1875729254080000/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835136.808120:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729254080000:0@lo:400:kworker.0 00010000:00080000:1.0:1788835136.808131:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83efe300 x1875729254080512/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835152 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835136.808139:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254080512:0@lo:400:kworker.0 00000100:00100000:1.0:1788835136.808181:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254080128 00000100:00100000:1.0:1788835136.808186:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254080128 00000100:00100000:1.0:1788835136.808209:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254080640 00000100:00100000:1.0:1788835136.808211:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254080640 00000100:00100000:1.0:1788835136.808233:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254080256 00000100:00100000:1.0:1788835136.808235:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254080256 00000100:00100000:1.0:1788835136.808245:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254080768 00000100:00100000:1.0:1788835136.808248:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254080768 00000100:00100000:1.0:1788835136.808262:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788835136.808268:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254080128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835136.808330:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83eff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254080128:12345-0@lo:400:kworker.0 Request processed in 46us (1457us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835136.808337:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:1.0:1788835136.808350:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788835136.808356:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254080640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835136.808386:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254080640:12345-0@lo:400:kworker.0 Request processed in 31us (1498us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835136.808392:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1788835136.808402:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788835136.808407:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e816a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254080256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835136.808433:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e816a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254080256:12345-0@lo:400:kworker.0 Request processed in 26us (1224us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835136.808439:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1788835136.808449:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788835136.808454:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254080768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835136.808478:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e814000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254080768:12345-0@lo:400:kworker.0 Request processed in 24us (1239us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835136.808483:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1788835136.808509:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254080128:0@lo:400:kworker.0 00000100:00100000:1.0:1788835136.808518:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254080640:0@lo:400:kworker.0 00000100:00100000:1.0:1788835136.808554:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254080896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788835136.808586:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835136.808613:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254079744:0@lo:400:kworker.0 00000100:00080000:0.0:1788835136.809237:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788835136.809242:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788835136.809245:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788835136.809248:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788835136.809507:0:6483:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254079360 00000100:00100000:2.0:1788835136.809513:0:6483:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254079360 00000100:00100000:2.0:1788835136.809550:0:6483:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1788835136.809558:0:6483:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3615:x1875729254079360:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835136.809607:0:6483:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3615:x1875729254079360:12345-0@lo:400:kworker.0 Request processed in 50us (2554us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835136.809613:0:6483:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 396 00000100:00100000:2.0:1788835136.809652:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254080896 00000100:00100000:2.0:1788835136.809656:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254080896 00000100:00100000:2.0:1788835136.809679:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788835136.809762:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254080896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788835136.809784:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788835136.809826:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254080896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (1239us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835136.809832:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1788835136.809851:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1788835136.809861:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254081024:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788835136.809900:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835136.809929:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254081024 00000100:00100000:2.0:1788835136.809933:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254081024 00000100:00100000:2.0:1788835136.809953:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788835136.809959:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254081024:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788835136.809968:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 42352320 pending 0 free 3923529728 avail 3692007424 00000100:00100000:2.0:1788835136.809995:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254081024:12345-0@lo:13:osp-pre-0-1.0 Request processed in 36us (95us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835136.810001:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1788835136.810033:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254081024:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835136.811024:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254080256:0@lo:400:kworker.0 00000100:00100000:1.0:1788835136.811052:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254080768:0@lo:400:kworker.0 00000100:00100000:1.0:1788835136.811062:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729254079360:0@lo:400:kworker.0 00000100:00100000:1.0:1788835136.811073:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875729254079872:0@lo:400:kworker.0 00000100:00100000:1.0:1788835136.811083:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254080384:0@lo:400:kworker.0 00000100:00100000:1.0:1788835136.811124:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254080896:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1788835136.997532:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835137.029297:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835137.029482:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242503808 00000100:00100000:3.0:1788835137.029491:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242503808 00000100:00100000:3.0:1788835137.029565:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00100000:3.0:1788835137.029575:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+18:13140:x1875729242503808:12345-192.168.203.22@tcp:35:umount.0 00000100:00100000:3.0:1788835137.029858:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+19:13140:x1875729242503808:12345-192.168.203.22@tcp:35:umount.0 Request processed in 283us (569us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1788835137.029865:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 66 00000100:00080000:0.0:1788835137.030701:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788835137.035713:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835137.035974:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242504064 00000100:00100000:2.0:1788835137.035986:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242504064 00000100:00100000:2.0:1788835137.036044:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:2.0:1788835137.036054:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+19:13140:x1875729242504064:12345-192.168.203.22@tcp:35:umount.0 00000100:00100000:2.0:1788835137.036389:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+20:13140:x1875729242504064:12345-192.168.203.22@tcp:35:umount.0 Request processed in 335us (685us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1788835137.036397:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 67 00000100:00100000:1.0:1788835137.040711:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835137.040924:0:6490:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242504320 00000100:00100000:2.0:1788835137.040933:0:6490:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242504320 00000100:00100000:2.0:1788835137.040986:0:6490:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:2.0:1788835137.040996:0:6490:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd84e67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+20:13140:x1875729242504320:12345-192.168.203.22@tcp:35:umount.0 00000100:00100000:2.0:1788835137.041355:0:6490:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd84e67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b8987b33-76f7-43a0-9448-1013c4af787f+21:13140:x1875729242504320:12345-192.168.203.22@tcp:35:umount.0 Request processed in 214us (507us total) trans 4294967525 rc 0/0 00000100:00100000:2.0:1788835137.041364:0:6490:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 68 00000100:00100000:1.0:1788835137.043996:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835137.047917:0:6491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242504576 00000100:00100000:0.0:1788835137.047931:0:6491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242504576 00000100:00100000:0.0:1788835137.047999:0:6491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:0.0:1788835137.048010:0:6491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+21:13140:x1875729242504576:12345-192.168.203.22@tcp:35:umount.0 00000100:00100000:0.0:1788835137.049027:0:6491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b8987b33-76f7-43a0-9448-1013c4af787f+22:13140:x1875729242504576:12345-192.168.203.22@tcp:35:umount.0 Request processed in 1015us (5035us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1788835137.049051:0:6491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 69 00000100:00100000:3.0:1788835137.060158:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835137.060201:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835137.060231:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835137.060273:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835137.060411:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242505088 00000100:00100000:2.0:1788835137.060434:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242505088 00000100:00100000:2.0:1788835137.060490:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242505344 00000100:00100000:2.0:1788835137.060494:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242505344 00000100:00100000:2.0:1788835137.060511:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242505216 00000100:00100000:2.0:1788835137.060514:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242505216 00000100:00100000:2.0:1788835137.060531:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:2.0:1788835137.060540:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e814380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8f7875b-4951-482c-9de0-d3888250010c+15:2387:x1875729242505088:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835137.060555:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835137.060575:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afc8374c600/0xdf60171e5a5d1b51 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03e9 expref: 15 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835137.060593:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835137.060641:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e814380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8f7875b-4951-482c-9de0-d3888250010c+14:2387:x1875729242505088:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 102us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835137.060648:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:2.0:1788835137.060678:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:2.0:1788835137.060685:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e814e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8f7875b-4951-482c-9de0-d3888250010c+13:2387:x1875729242505344:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835137.060692:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835137.060701:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e63800/0xdf60171e5a5d1dea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04c2 expref: 13 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835137.060709:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835137.060725:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e814e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8f7875b-4951-482c-9de0-d3888250010c+12:2387:x1875729242505344:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 41us (524us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835137.060731:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:2.0:1788835137.060744:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:2.0:1788835137.060749:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8f7875b-4951-482c-9de0-d3888250010c+11:2387:x1875729242505216:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835137.060775:0:7430:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835137.060785:0:7430:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd80031200/0xdf60171e5a5d1b12 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03aa expref: 11 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835137.060794:0:7430:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835137.061063:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e817b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e8f7875b-4951-482c-9de0-d3888250010c+10:2387:x1875729242505216:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 312us (830us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835137.061071:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:1.0:1788835137.061305:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242504960 00000100:00100000:1.0:1788835137.061310:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242504960 00000100:00100000:1.0:1788835137.061373:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 82 00000100:00100000:1.0:1788835137.061379:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+7:2384:x1875729242504960:12345-192.168.203.22@tcp:9:umount.0 00000020:00000080:1.0:1788835137.061401:0:8405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d2163 00000020:00010000:1.0:1788835137.061408:0:8405:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9afd82bff800: total 0 00000100:00080000:1.0:1788835137.061412:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9afd82bfd000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788835137.061938:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:1.0:1788835137.062100:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e816d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b8987b33-76f7-43a0-9448-1013c4af787f+5:2384:x1875729242504960:12345-192.168.203.22@tcp:9:umount.0 Request processed in 719us (1824us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835137.062108:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 82 00000020:00010000:1.0:1788835137.062145:0:6476:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9afd82bff800: total 0 00010000:00010000:1.0:1788835137.062168:0:6476:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9afd82bff800, canceled 0 locks, left on hash table 2. 00010000:00010000:1.0:1788835137.062213:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d69caee5/0xdf60171e5a5d251b lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06ac expref: 4 pid: 9814 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788835137.062975:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1788835137.063101:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000aa97d7b3/0xdf60171e5a5d2bea lrc: 0/0,0 mode: --/PR res: [0x2c0000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae088f expref: 3 pid: 8403 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835137.063121:0:6476:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9afd82bff800, canceled 2 locks, left on hash table 0. 00010000:00010000:1.0:1788835137.063142:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835137.063144:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835137.063146:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835137.068273:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835137.068528:0:8402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242505472 00000100:00100000:0.0:1788835137.068538:0:8402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242505472 00000100:00100000:0.0:1788835137.068604:0:8402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00100000:0.0:1788835137.068613:0:8402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2384:x1875729242505472:12345-192.168.203.22@tcp:9:umount.0 00000020:00000080:0.0:1788835137.068642:0:8402:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1eed 00000100:00080000:0.0:1788835137.068652:0:8402:0:(import.c:65:import_set_state_nolock()) ffff9afc83d65000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788835137.068900:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:0.0:1788835137.069006:0:8402:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:0.0:1788835137.069179:0:8402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e814700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b8987b33-76f7-43a0-9448-1013c4af787f+2:2384:x1875729242505472:12345-192.168.203.22@tcp:9:umount.0 Request processed in 565us (913us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835137.069188:0:8402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 83 00000100:00080000:2.0:1788835137.069303:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788835137.083457:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835137.083547:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242506496 00000100:00100000:3.0:1788835137.083557:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242506496 00000100:00100000:3.0:1788835137.083617:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 258 00000100:00100000:3.0:1788835137.083628:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+22:2384:x1875729242506496:12345-192.168.203.22@tcp:39:umount.0 00000020:00000080:3.0:1788835137.083661:0:9047:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1b20 00000020:00010000:3.0:1788835137.083690:0:9047:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9afc8337a800: total 0 00000100:00080000:3.0:1788835137.083695:0:9047:0:(import.c:65:import_set_state_nolock()) ffff9afc8337c800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788835137.083729:0:9047:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:3.0:1788835137.084034:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b8987b33-76f7-43a0-9448-1013c4af787f+21:2384:x1875729242506496:12345-192.168.203.22@tcp:39:umount.0 Request processed in 407us (584us total) trans 4294967527 rc 0/0 00000100:00100000:3.0:1788835137.084042:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 258 00000020:00010000:0.0:1788835137.085065:0:6477:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9afc8337a800: total 0 00010000:00010000:0.0:1788835137.085128:0:6477:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9afc8337a800, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1788835137.085166:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9afc810b8400) 00010000:00010000:0.0:1788835137.085169:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788835137.085178:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a000/0xdf60171e5a5d1e4c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04d0 expref: 20 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835137.085203:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:0.0:1788835137.085206:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788835137.085210:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374dc00/0xdf60171e5a5d2bab lrc: 0/0,0 mode: --/PR res: [0x200000402:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae087a expref: 19 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835137.085223:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:0.0:1788835137.085225:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788835137.085229:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d288d lrc: 0/0,0 mode: --/CR res: [0x200000402:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae07a8 expref: 18 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835137.085276:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afd93eb1c00) 00010000:00010000:0.0:1788835137.085279:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788835137.085283:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60600/0xdf60171e5a5d2584 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06c8 expref: 17 pid: 6487 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835137.085293:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:0.0:1788835137.085294:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788835137.085298:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374ce00/0xdf60171e5a5d2bd5 lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0888 expref: 16 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835137.085308:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:0.0:1788835137.085310:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788835137.085352:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e63000/0xdf60171e5a5d1ec3 lrc: 0/0,0 mode: --/PR res: [0x200000402:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04ec expref: 15 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835137.085368:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:0.0:1788835137.085370:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788835137.085374:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d24dc lrc: 0/0,0 mode: --/PR res: [0x200000402:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0697 expref: 14 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835137.085388:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xe:0x0].0x0 (ffff9afc810b8b00) 00010000:00010000:0.0:1788835137.085391:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788835137.085395:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afc8374d200/0xdf60171e5a5d2acb lrc: 0/0,0 mode: --/CR res: [0x200000402:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0842 expref: 13 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835137.085407:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:0.0:1788835137.085409:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1788835137.085423:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61a00/0xdf60171e5a5d2506 lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06a5 expref: 12 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835137.085438:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x3:0x0].0x0 (ffff9afda01ecf00) 00010000:00010000:0.0:1788835137.085440:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1788835137.085444:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d21be lrc: 0/0,0 mode: --/CR res: [0x200000402:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae05c5 expref: 11 pid: 6488 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835137.085460:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afc835ccc00) 00010000:00010000:0.0:1788835137.085462:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835137.085466:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d1e68 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04d7 expref: 10 pid: 6489 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835137.085481:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0xa:0x0].0x0 (ffff9afdb2e5e600) 00010000:00010000:0.0:1788835137.085483:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1788835137.085488:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884aa800/0xdf60171e5a5d25a0 lrc: 0/0,0 mode: --/PR res: [0x200000402:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae06cf expref: 9 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835137.085501:0:6477:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000402:0x7:0x0].0x0 (ffff9afc810b8600) 00010000:00010000:0.0:1788835137.085504:0:6477:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1788835137.085507:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd884ab800/0xdf60171e5a5d23fc lrc: 0/0,0 mode: --/CR res: [0x200000402:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae065f expref: 8 pid: 9047 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835137.085519:0:6477:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9afc8337a800, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1788835137.085536:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835137.085539:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835137.085541:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835137.098483:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835137.098582:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242506624 00000100:00100000:0.0:1788835137.098592:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242506624 00000100:00100000:0.0:1788835137.098685:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 259 00000100:00100000:0.0:1788835137.098694:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+5:2384:x1875729242506624:12345-192.168.203.22@tcp:39:umount.0 00000020:00000080:0.0:1788835137.098728:0:6487:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1b27 00000100:00080000:0.0:1788835137.098745:0:6487:0:(import.c:65:import_set_state_nolock()) ffff9afc8369a000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1788835137.098840:0:6487:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1788835137.099107:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b8987b33-76f7-43a0-9448-1013c4af787f+3:2384:x1875729242506624:12345-192.168.203.22@tcp:39:umount.0 Request processed in 414us (632us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1788835137.099116:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 259 00000100:00080000:2.0:1788835137.099264:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00010000:3.0:1788835137.099714:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835137.318112:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254081152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788835137.318178:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835137.318295:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254081152 00000100:00100000:1.0:1788835137.318303:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254081152 00000100:00100000:1.0:1788835137.318371:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788835137.318391:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254081152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788835137.318419:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:3.0:1788835137.318429:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788835137.318443:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254081280:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788835137.318482:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254081152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835137.318489:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1788835137.318534:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254081152:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788835137.319879:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835137.320258:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254081280 00000100:00100000:0.0:1788835137.320265:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254081280 00000100:00100000:0.0:1788835137.320312:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1788835137.320361:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254081280:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788835137.320381:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788835137.320434:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e815180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254081280:12345-0@lo:13:osp-pre-1-1.0 Request processed in 76us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835137.320441:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1788835137.320618:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254081280:0@lo:13:osp-pre-1-1.0 00010000:00010000:3.0:1788835138.025511:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835138.344750:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254081408:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788835138.344866:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835138.345069:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254081408 00000100:00100000:3.0:1788835138.345080:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254081408 00000100:00100000:3.0:1788835138.345144:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1788835138.345155:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254081408:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788835138.345200:0:6493:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446260736 avail 1300021248 00000100:00100000:3.0:1788835138.345266:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254081408:12345-0@lo:41:osp-pre-0-1.0 Request processed in 112us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835138.345273:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1788835138.345620:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254081408:0@lo:41:osp-pre-0-1.0 00000001:00100000:1.0:1788835138.862234:0:6467:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b8987b33-76f7-43a0-9448-1013c4af787f 00000001:00080000:1.0:1788835138.862260:0:6467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1788835138.862289:0:6467:0:(genops.c:885:class_export_put()) final put ffff9afc8337a800/b8987b33-76f7-43a0-9448-1013c4af787f 00000020:00000080:3.0:1788835138.862420:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc8337a800/b8987b33-76f7-43a0-9448-1013c4af787f for lustre-MDT0000 00000020:00000080:3.0:1788835138.862516:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afc8337c800 for lustre-MDT0000 00010000:00010000:0.0:1788835139.046130:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835139.175616:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835139.175659:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835139.175695:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835139.175726:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242506752 00000100:00100000:3.0:1788835139.175736:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242506752 00000100:00100000:3.0:1788835139.175782:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242507008 00000100:00100000:3.0:1788835139.175786:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242507008 00000100:00100000:2.0:1788835139.175790:0:6474:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242506880 00000100:00100000:2.0:1788835139.175793:0:6474:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242506880 00000100:00100000:2.0:1788835139.175835:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:2.0:1788835139.175844:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e815f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8f7875b-4951-482c-9de0-d3888250010c+12:2385:x1875729242506752:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835139.175858:0:6474:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835139.175946:0:6474:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afc8374c400/0xdf60171e5a5d1c23 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03fe expref: 12 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835139.175975:0:6474:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835139.176029:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e815f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:e8f7875b-4951-482c-9de0-d3888250010c+11:2385:x1875729242506752:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 185us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835139.176055:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:3.0:1788835139.176064:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e817480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8f7875b-4951-482c-9de0-d3888250010c+11:2385:x1875729242507008:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788835139.176072:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835139.176083:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e62a00/0xdf60171e5a5d1de3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae04bb expref: 11 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835139.176476:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835139.176501:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e817480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8f7875b-4951-482c-9de0-d3888250010c+10:2385:x1875729242507008:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 438us (841us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835139.176509:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:3.0:1788835139.176529:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:3.0:1788835139.176535:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaae6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8f7875b-4951-482c-9de0-d3888250010c+9:2385:x1875729242506880:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788835139.176543:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835139.176554:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e61600/0xdf60171e5a5d1c2a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae042f expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835139.176564:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835139.176581:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaae6a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:e8f7875b-4951-482c-9de0-d3888250010c+8:2385:x1875729242506880:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 46us (886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835139.176599:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:2.0:1788835139.178078:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:1.0:1788835139.187755:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835139.193582:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242507264 00000100:00100000:3.0:1788835139.193598:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242507264 00000100:00100000:3.0:1788835139.193697:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 260 00000100:00100000:3.0:1788835139.193706:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+6:2384:x1875729242507264:12345-192.168.203.22@tcp:39:umount.0 00000020:00000080:3.0:1788835139.193748:0:9806:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1c38 00000020:00010000:3.0:1788835139.193756:0:9806:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9afc837f6800: total 0 00000100:00080000:3.0:1788835139.193760:0:9806:0:(import.c:65:import_set_state_nolock()) ffff9afc837f6000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788835139.193849:0:9806:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00100000:3.0:1788835139.194013:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2384:x1875729242507264:12345-192.168.203.22@tcp:39:umount.0 Request processed in 307us (6266us total) trans 4294967528 rc 0/0 00000100:00100000:3.0:1788835139.194021:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 260 00000020:00010000:1.0:1788835139.194419:0:6476:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9afc837f6800: total 0 00010000:00010000:1.0:1788835139.194433:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835139.194480:0:6476:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9afc837f6800, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1788835139.194523:0:6476:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afd93eb1c00) 00010000:00010000:1.0:1788835139.194527:0:6476:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788835139.194535:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61e00/0xdf60171e5a5d2bf8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0896 expref: 4 pid: 9806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835139.194557:0:6476:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9afc837f6800, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1788835139.194568:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835139.194570:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835139.194572:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788835139.194722:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788835139.201006:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835139.201124:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242507392 00000100:00100000:1.0:1788835139.201134:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242507392 00000100:00100000:1.0:1788835139.201209:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 261 00000100:00100000:1.0:1788835139.201219:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+5:2384:x1875729242507392:12345-192.168.203.22@tcp:39:umount.0 00000020:00000080:1.0:1788835139.201258:0:6488:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1c3f 00000100:00080000:1.0:1788835139.201268:0:6488:0:(import.c:65:import_set_state_nolock()) ffff9afc837f5000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1788835139.201299:0:6488:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967299 00010000:00010000:0.0:1788835139.201445:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835139.201493:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e816680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e407b2f7-b5e2-4ec6-aa60-e6561b656d05+3:2384:x1875729242507392:12345-192.168.203.22@tcp:39:umount.0 Request processed in 275us (495us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1788835139.201510:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 261 00000100:00080000:2.0:1788835139.201604:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788835139.244712:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835139.246895:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242507648 00000100:00100000:1.0:1788835139.246908:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242507648 00000100:00100000:1.0:1788835139.247111:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 397 00000100:00100000:1.0:1788835139.247133:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+7:2384:x1875729242507648:12345-192.168.203.22@tcp:251:umount.0 00000020:00000080:1.0:1788835139.247177:0:6481:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1afd 00000020:00010000:1.0:1788835139.247185:0:6481:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9afc837f3000: total 0 00000100:00080000:1.0:1788835139.247189:0:6481:0:(import.c:65:import_set_state_nolock()) ffff9afc837f1800 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1788835139.247343:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:e8f7875b-4951-482c-9de0-d3888250010c+3:2384:x1875729242507648:12345-192.168.203.22@tcp:251:umount.0 Request processed in 185us (2612us total) trans 0 rc 0/0 00000020:00010000:0.0:1788835139.247383:0:6477:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9afc837f3000: total 0 00010000:00010000:0.0:1788835139.247446:0:6477:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9afc837f3000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1788835139.247480:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e61400/0xdf60171e5a5d1b58 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae03f0 expref: 3 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835139.247494:0:6477:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9afc837f3000, canceled 1 locks, left on hash table 0. 00010000:00010000:0.0:1788835139.247518:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835139.247520:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835139.247522:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835139.248238:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 397 00000020:00000080:1.0:1788835139.248251:0:6481:0:(genops.c:885:class_export_put()) final put ffff9afc837f3000/e8f7875b-4951-482c-9de0-d3888250010c 00000020:00000080:3.0:1788835139.248634:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc837f3000/e8f7875b-4951-482c-9de0-d3888250010c for MGS 00000020:00000080:3.0:1788835139.248676:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afc837f1800 for MGS 00010000:00010000:2.0:1788835140.079341:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1788835140.845393:0:15071:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:2.0:1788835140.857440:0:15071:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:2.0:1788835140.857504:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1beb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1bf2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835140.857519:0:15071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1beb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1bf2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835140.857528:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1beb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1bf2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835140.857535:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1beb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1bf2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835140.857570:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1788835140.857575:0:15071:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:2.0:1788835140.857597:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788835140.857601:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:2.0:1788835140.857608:0:15071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1788835140.857630:0:15071:0:(import.c:65:import_set_state_nolock()) ffff9afdb90c2000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788835140.857823:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788835140.857831:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1beb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1bf2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835140.857839:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80030c00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:1.0:1788835140.857842:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1beb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1bf2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835140.857850:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf60171e5a5d1bf2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788835140.857857:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1beb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf60171e5a5d1bf2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788835140.857863:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1788835140.857865:0:7429:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1788835140.857867:0:7429:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1788835140.857894:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1beb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1bf2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835140.857901:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788835140.857927:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1beb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1bf2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835140.857935:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd80030c00/0xdf60171e5a5d1beb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1bf2 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835140.857967:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835140.857969:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835140.857971:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835140.857979:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788835140.857997:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254081664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788835140.858061:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835140.858287:0:6473:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254081664 00000100:00100000:2.0:1788835140.858301:0:6473:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254081664 00000100:00100000:2.0:1788835140.858377:0:6473:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788835140.858386:0:6473:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3617:x1875729254081664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788835140.858397:0:6473:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835140.858413:0:6473:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e61800/0xdf60171e5a5d1bf2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d1beb expref: 24 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835140.858424:0:6473:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835140.858461:0:6473:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844abb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:3617:x1875729254081664:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (399us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835140.858468:0:6473:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788835140.858556:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254081664:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788835140.858641:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875729254081536:0@lo:39:umount.0 00000100:00100000:0.0:1788835140.858729:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835140.862304:0:6487:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254081536 00000100:00100000:1.0:1788835140.862519:0:6487:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254081536 00000100:00100000:0.0:1788835140.863306:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1788835140.863345:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1875729254081536:12345-0@lo:39:umount.0 00000020:00000080:0.0:1788835140.863379:0:6487:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1722 00000100:00080000:0.0:1788835140.863390:0:6487:0:(import.c:65:import_set_state_nolock()) ffff9afdb90ed800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1788835140.863489:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3613:x1875729254081536:12345-0@lo:39:umount.0 Request processed in 174us (4759us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835140.863497:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:00000080:0.0:1788835140.863506:0:6487:0:(genops.c:885:class_export_put()) final put ffff9afdb90ec800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:0.0:1788835140.863530:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788835140.863563:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdb90c2000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788835140.863576:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875729254081536:0@lo:39:umount.0 00000020:00000080:0.0:1788835140.863604:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdb90ec800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788835140.863691:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afdb90ed800 for lustre-MDT0000 00000100:00080000:3.0:1788835140.863912:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788835140.863916:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1788835140.863921:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1788835140.865926:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60a00/0xdf60171e5a5d1bf9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1c00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835140.865942:0:15071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60a00/0xdf60171e5a5d1bf9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1c00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835140.865950:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60a00/0xdf60171e5a5d1bf9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1c00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835140.865957:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60a00/0xdf60171e5a5d1bf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1c00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835140.865974:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788835140.865979:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62800/0xdf60171e5a5d1ab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1abe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835140.865986:0:15071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62800/0xdf60171e5a5d1ab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1abe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835140.866008:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62800/0xdf60171e5a5d1ab7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1abe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835140.866014:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62800/0xdf60171e5a5d1ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1abe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835140.866027:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1788835140.866033:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d1e1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1e22 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835140.866039:0:15071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d1e1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1e22 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835140.866044:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d1e1b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1e22 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835140.866049:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d1e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1e22 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835140.866059:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1788835140.866063:0:15071:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f4c00/0xdf60171e5a5d1673 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d167a expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835140.866068:0:15071:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f4c00/0xdf60171e5a5d1673 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d167a expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835140.866073:0:15071:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f4c00/0xdf60171e5a5d1673 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d167a expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835140.866089:0:15071:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9afd866f4c00/0xdf60171e5a5d1673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d167a expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835140.866097:0:15071:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:3.0:1788835140.866100:0:15071:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1788835140.866130:0:15071:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1788835140.866134:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1788835140.866138:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788835140.866144:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 4/11 00000020:00080000:3.0:1788835140.866150:0:15071:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9afc82603000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788835140.866156:0:15071:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9afc820d5800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788835140.866160:0:15071:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9afdaf450000 lustre-MDT0000-lwp-MDT0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788835140.866164:0:15071:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9afdaf565800 lustre-MDT0001-mdtlov_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 4294967298 stale:0 00000020:00080000:3.0:1788835140.866171:0:15071:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff9afc837f6800 e407b2f7-b5e2-4ec6-aa60-e6561b656d05 192.168.203.22@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788835140.866175:0:15071:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9afdb2ed8000) has exports, disconnecting them 00000020:00080000:3.0:1788835140.866180:0:15071:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9afc82603000), last request at 1788835136 00000020:00000080:3.0:1788835140.866187:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1a24 00000100:00080000:3.0:1788835140.866205:0:15071:0:(import.c:65:import_set_state_nolock()) ffff9afc82601800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788835140.866251:0:15071:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9afc82603000): rc 0 00000020:00000080:3.0:1788835140.866253:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afc82603000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1788835140.866261:0:15071:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9afc820d5800), last request at 1788835136 00000020:00000080:3.0:1788835140.866265:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d18fe 00000100:00080000:3.0:1788835140.866270:0:15071:0:(import.c:65:import_set_state_nolock()) ffff9afc820d6000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788835140.866276:0:15071:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9afc820d5800): rc 0 00000020:00000080:3.0:1788835140.866278:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afc820d5800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00080000:3.0:1788835140.866288:0:15071:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9afdaf450000), last request at 1788834913 00000020:00000080:3.0:1788835140.866291:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d17fb 00000100:00080000:3.0:1788835140.866295:0:15071:0:(import.c:65:import_set_state_nolock()) ffff9afd9e82e800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1788835140.866301:0:15071:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9afdaf450000): rc 0 00000020:00000080:3.0:1788835140.866303:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afdaf450000/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00080000:3.0:1788835140.866306:0:15071:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9afdaf565800), last request at 1788834912 00000020:00000080:3.0:1788835140.866309:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d17bc 00000100:00080000:3.0:1788835140.866312:0:15071:0:(import.c:65:import_set_state_nolock()) ffff9afdc136f800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788835140.866337:0:15071:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00010000:00010000:0.0:1788835140.866373:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1788835140.866380:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60a00/0xdf60171e5a5d1bf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1c00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.866387:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60a00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:0.0:1788835140.866391:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60a00/0xdf60171e5a5d1bf9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1c00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:3.0:1788835140.866397:0:15071:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9afdaf565800): rc 0 00010000:00010000:0.0:1788835140.866400:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60a00/0xdf60171e5a5d1bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf60171e5a5d1c00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00000080:3.0:1788835140.866403:0:15071:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffadff41c7fae0 10000000:00010000:0.0:1788835140.866407:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60a00/0xdf60171e5a5d1bf9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf60171e5a5d1c00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788835140.866418:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788835140.866422:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 3 10000000:01000000:0.0:1788835140.866422:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788835140.866424:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 10000000:01000000:0.0:1788835140.866426:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00010000:00010000:0.0:1788835140.866455:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60a00/0xdf60171e5a5d1bf9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1c00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.866462:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788835140.866483:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60a00/0xdf60171e5a5d1bf9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1c00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.866489:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60a00/0xdf60171e5a5d1bf9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1c00 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.866500:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1788835140.866503:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62800/0xdf60171e5a5d1ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1abe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.866508:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e62800 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:0.0:1788835140.866510:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62800/0xdf60171e5a5d1ab7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1abe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.866516:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62800/0xdf60171e5a5d1ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf60171e5a5d1abe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788835140.866522:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62800/0xdf60171e5a5d1ab7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf60171e5a5d1abe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788835140.866527:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1788835140.866529:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1788835140.866531:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1788835140.866551:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62800/0xdf60171e5a5d1ab7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1abe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.866558:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788835140.866575:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62800/0xdf60171e5a5d1ab7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1abe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.866581:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62800/0xdf60171e5a5d1ab7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1abe expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.866591:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788835140.866594:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d1e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1e22 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.866599:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60400 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:0.0:1788835140.866602:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d1e1b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1e22 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.866609:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d1e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf60171e5a5d1e22 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788835140.866615:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d1e1b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf60171e5a5d1e22 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788835140.866621:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788835140.866623:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788835140.866624:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1788835140.866635:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d1e1b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1e22 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.866639:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788835140.866645:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d1e1b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1e22 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.866656:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d1e1b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1e22 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.866665:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835140.866668:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd866f4c00/0xdf60171e5a5d1673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d167a expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.866673:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4c00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:0.0:1788835140.866675:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f4c00/0xdf60171e5a5d1673 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d167a expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.866681:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd866f4c00/0xdf60171e5a5d1673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf60171e5a5d167a expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788835140.866687:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f4c00/0xdf60171e5a5d1673 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf60171e5a5d167a expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788835140.866691:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:0.0:1788835140.866694:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:0.0:1788835140.866696:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:0.0:1788835140.866708:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd866f4c00/0xdf60171e5a5d1673 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d167a expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.866715:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788835140.866721:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd866f4c00/0xdf60171e5a5d1673 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d167a expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.866727:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd866f4c00/0xdf60171e5a5d1673 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d167a expref: -99 pid: 6464 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.866745:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835140.866747:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835140.866749:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1788835140.866758:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc82603000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788835140.866808:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc820d5800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1788835140.866827:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdaf450000/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1788835140.866849:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afc82601800 for lustre-MDT0000 00000020:00000080:0.0:1788835140.866852:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afc820d6000 for lustre-MDT0000 00000020:00000080:0.0:1788835140.866856:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afd9e82e800 for lustre-MDT0000 00000100:00100000:0.0:1788835140.866951:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729254081920:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788835140.867010:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835140.867052:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788835140.867058:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729254082048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788835140.867075:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835140.867119:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254081920 00000100:00100000:0.0:1788835140.867125:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254081920 00000100:00100000:0.0:1788835140.867160:0:6475:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254082048 00000100:00100000:0.0:1788835140.867163:0:6475:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254082048 00000100:00100000:0.0:1788835140.867180:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788835140.867188:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+24:3614:x1875729254081920:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788835140.867199:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835140.867212:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdc204b400/0xdf60171e5a5d1abe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d1ab7 expref: 24 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.867224:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835140.867254:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaab800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+23:3614:x1875729254081920:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835140.867266:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788835140.867280:0:6475:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788835140.867286:0:6475:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:3614:x1875729254082048:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788835140.867293:0:6475:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835140.867301:0:6475:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd80030a00/0xdf60171e5a5d1e22 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d1e1b expref: 22 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.867309:0:6475:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835140.867357:0:6475:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:3614:x1875729254082048:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835140.867364:0:6475:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788835140.867386:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254082176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788835140.867406:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835140.867427:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1788835140.867432:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254081792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788835140.867448:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835140.867467:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254082176 00000100:00100000:0.0:1788835140.867470:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254082176 00000100:00080000:3.0:1788835140.867477:0:15071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000100:00100000:0.0:1788835140.867488:0:9491:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254081792 00000100:00100000:0.0:1788835140.867491:0:9491:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254081792 00000100:00100000:0.0:1788835140.867507:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788835140.867512:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f0122c5-c616-4176-9ca1-6fdce4068f64+22:3616:x1875729254082176:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788835140.867518:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835140.867527:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd80030e00/0xdf60171e5a5d167a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d1673 expref: 22 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.867535:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835140.867567:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f0122c5-c616-4176-9ca1-6fdce4068f64+21:3616:x1875729254082176:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (160us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835140.867573:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788835140.867586:0:9491:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788835140.867592:0:9491:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f0122c5-c616-4176-9ca1-6fdce4068f64+20:3616:x1875729254081792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788835140.867599:0:9491:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835140.867607:0:9491:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afc8374ca00/0xdf60171e5a5d1c00 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d1bf9 expref: 20 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835140.867614:0:9491:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835140.867634:0:9491:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:3616:x1875729254081792:12345-0@lo:103:ldlm_bl.0 Request processed in 43us (185us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835140.867640:0:9491:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1788835140.867673:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254081792:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788835140.867682:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254082176:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788835140.867705:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729254082048:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788835140.867712:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:5f0122c5-c616-4176-9ca1-6fdce4068f64:3614:1875729254081920:0@lo:103:ldlm_bl.0 00000100:00080000:3.0:1788835140.867940:0:15071:0:(import.c:65:import_set_state_nolock()) ffff9afd9e82c800 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:1.0:1788835140.868059:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1788835140.868064:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00010000:00010000:1.0:1788835140.868066:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835140.868068:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 3 00000004:00080000:3.0:1788835140.868078:0:15071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1788835140.868133:0:15071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1788835140.868144:0:15071:0:(import.c:65:import_set_state_nolock()) ffff9afdbf96a800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1788835140.868150:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788835140.868152:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 3 00000004:00080000:3.0:1788835140.868168:0:15071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788835140.868182:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254082304:0@lo:39:umount.0 00000100:00080000:3.0:1788835140.868222:0:15071:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1788835140.868230:0:15071:0:(import.c:65:import_set_state_nolock()) ffff9afdb34c6000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1788835140.868251:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1788835140.868255:0:15071:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9afdb2ed8000) has no exports 00000100:00100000:0.0:1788835140.868279:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254082432:0@lo:9:umount.0 00000100:00100000:0.0:1788835140.868308:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835140.868354:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254082560:0@lo:9:umount.0 00000100:00100000:0.0:1788835140.868375:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835140.868816:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254082432 00000100:00100000:3.0:1788835140.868822:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254082432 00000100:00100000:3.0:1788835140.868997:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254082560 00000100:00100000:3.0:1788835140.869002:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254082560 00000100:00100000:3.0:1788835140.869023:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1788835140.869031:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3613:x1875729254082432:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788835140.869056:0:8405:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d19a6 00000100:00080000:3.0:1788835140.869063:0:8405:0:(import.c:65:import_set_state_nolock()) ffff9afdbf908800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788835140.869101:0:8405:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00100000:1.0:1788835140.869228:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1788835140.869229:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3613:x1875729254082432:12345-0@lo:9:umount.0 Request processed in 198us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835140.869236:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788835140.869238:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3613:x1875729254082560:12345-0@lo:9:umount.0 00000020:00000080:1.0:1788835140.869251:0:8403:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1ae8 00000100:00080000:1.0:1788835140.869257:0:8403:0:(import.c:65:import_set_state_nolock()) ffff9afc8337b800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1788835140.869275:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1788835140.869290:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:1.0:1788835140.869402:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3613:x1875729254082560:12345-0@lo:9:umount.0 Request processed in 166us (1025us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835140.869409:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:0.0:1788835140.870199:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788835140.870217:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788835140.870256:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdb34c6000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788835140.870279:0:3613:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788835140.870281:0:3613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788835140.870287:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254082560:0@lo:9:umount.0 00000100:00080000:0.0:1788835140.870300:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdbf96a800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788835140.870310:0:3613:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788835140.870311:0:3613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788835140.870329:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254082432:0@lo:9:umount.0 00010000:00010000:0.0:1788835140.870360:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835140.870437:0:6492:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254082304 00000100:00100000:2.0:1788835140.870443:0:6492:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254082304 00000100:00100000:2.0:1788835140.870485:0:6492:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1788835140.870493:0:6492:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3613:x1875729254082304:12345-0@lo:39:umount.0 00000020:00000080:2.0:1788835140.870515:0:6492:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1856 00000100:00080000:2.0:1788835140.870521:0:6492:0:(import.c:65:import_set_state_nolock()) ffff9afdba067000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788835140.870542:0:6492:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:2.0:1788835140.870929:0:6492:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+3:3613:x1875729254082304:12345-0@lo:39:umount.0 Request processed in 435us (2676us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1788835140.870937:0:6492:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00010000:00010000:2.0:1788835140.871030:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788835140.871051:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afd9e82c800 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1788835140.871056:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254082304:0@lo:39:umount.0 00000020:00080000:3.0:1788835140.887748:0:15071:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9afdb2ed8000) has no exports 00000020:00000080:3.0:1788835140.940078:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d16ce 00000020:00000080:3.0:1788835140.940094:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afdb90ed000/lustre-QMT0000_UUID 00000020:01000000:3.0:1788835140.940117:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1788835140.940199:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdb90ed000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1788835140.940286:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788835140.940295:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788835140.940299:0:15071:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9afdab4b99b8) has no exports 00000020:00000080:0.0:1788835140.940776:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d16c7 00000020:00000080:0.0:1788835140.940783:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afdb90c4800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1788835140.940845:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788835140.940852:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788835140.940855:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afdb90c3800/lustre-QMT0000_UUID 00000020:00000080:0.0:1788835140.940858:0:15071:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdb90c3800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1788835140.940866:0:15071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1788835140.941038:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdb90c4800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:00010000:3.0:1788835141.093591:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835141.925969:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729254083072:0@lo:400:kworker.0 00000100:00100000:2.0:1788835141.926043:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835141.926180:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254082688:0@lo:400:kworker.0 00000100:00100000:0.0:1788835141.926232:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835141.929095:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254082944:0@lo:400:kworker.0 00000100:00100000:1.0:1788835141.929167:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835141.929897:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254083584:0@lo:400:kworker.0 00000100:00100000:2.0:1788835141.929956:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835141.930045:0:9047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254083072 00000100:00100000:2.0:1788835141.930053:0:9047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254083072 00000100:00100000:0.0:1788835141.930426:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875729254083200:0@lo:400:kworker.0 00000100:00100000:0.0:1788835141.930460:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835141.930482:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254083712:0@lo:400:kworker.0 00000100:00100000:0.0:1788835141.930504:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835141.930533:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254082816:0@lo:400:kworker.0 00000100:00100000:3.0:1788835141.931818:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254082944 00000100:00100000:3.0:1788835141.931828:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254082944 00000100:00100000:0.0:1788835141.931829:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835141.931866:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254083584 00000100:00100000:3.0:1788835141.931869:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254083584 00000100:00100000:3.0:1788835141.931895:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254083200 00000100:00100000:3.0:1788835141.931899:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254083200 00000100:00100000:3.0:1788835141.931915:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 358 00000100:00100000:3.0:1788835141.931923:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254083584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835141.931990:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254083584:12345-0@lo:400:kworker.0 Request processed in 66us (2032us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835141.931997:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 358 00000100:00100000:0.0:1788835141.932007:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254083328:0@lo:400:kworker.0 00000100:00100000:3.0:1788835141.932014:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 359 00000100:00100000:3.0:1788835141.932019:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875729254083200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835141.932034:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835141.932053:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254083840:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788835141.932060:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875729254083200:12345-0@lo:400:kworker.0 Request processed in 41us (1601us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835141.932066:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 359 00000100:00100000:0.0:1788835141.932072:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835141.932094:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1788835141.932099:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875729254082944:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1788835141.932104:0:6489:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00080000:0.0:1788835141.932107:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788835141.932118:0:11555:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254082816 00000100:00100000:0.0:1788835141.932121:0:11555:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254082816 00000100:00100000:3.0:1788835141.932130:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3615:x1875729254082944:12345-0@lo:400:kworker.0 Request processed in 31us (2964us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788835141.932136:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1788835141.932143:0:11555:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1788835141.932148:0:11555:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3614:x1875729254082816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835141.932151:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254083712 00000020:00080000:0.0:1788835141.932152:0:11555:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1788835141.932154:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254083712 00000100:00100000:0.0:1788835141.932179:0:11555:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3614:x1875729254082816:12345-0@lo:400:kworker.0 Request processed in 30us (350us total) trans 0 rc -107/-107 00000100:00100000:3.0:1788835141.932181:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254083328 00000100:00100000:3.0:1788835141.932184:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254083328 00000100:00100000:0.0:1788835141.932185:0:11555:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1788835141.932204:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788835141.932210:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254083712:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835141.932242:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254083712:12345-0@lo:400:kworker.0 Request processed in 33us (1737us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835141.932249:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1788835141.932260:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788835141.932266:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254083328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835141.932292:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254083328:12345-0@lo:400:kworker.0 Request processed in 26us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835141.932298:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1788835141.932515:0:6482:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254082688 00000100:00100000:3.0:1788835141.932519:0:6482:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254082688 00000100:00100000:3.0:1788835141.932544:0:6482:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 398 00000100:00100000:3.0:1788835141.932551:0:6482:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:3617:x1875729254082688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835141.932592:0:6482:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e47c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:3617:x1875729254082688:12345-0@lo:400:kworker.0 Request processed in 41us (6359us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835141.932598:0:6482:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 398 00010000:00080000:3.0:1788835141.932651:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83efdc00 x1875729254083584/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835141.932665:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254083584:0@lo:400:kworker.0 00000100:00080000:3.0:1788835141.933240:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788835141.933245:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788835141.933276:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254083840 00000100:00100000:0.0:1788835141.933281:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254083840 00000100:00100000:2.0:1788835141.933353:0:9047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1788835141.933361:0:9047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1875729254083072:12345-0@lo:400:kworker.0 00000020:00080000:2.0:1788835141.933368:0:9047:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:2.0:1788835141.933412:0:9047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3616:x1875729254083072:12345-0@lo:400:kworker.0 Request processed in 51us (7369us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788835141.933419:0:9047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00080000:2.0:1788835141.933447:0:3616:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788835141.933452:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9afdb34c0000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1788835141.933457:0:3616:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788835141.936929:0:3615:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1788835141.936936:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9afdaf454800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1788835141.936958:0:3615:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:1.0:1788835141.936964:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9afdaf454800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788835141.936968:0:3615:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 155 00000100:00080000:1.0:1788835141.936978:0:3615:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9afdaf454800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788835141.937012:0:3615:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afc83efe300 x1875729254083968/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788835141.937043:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254082944:0@lo:400:kworker.0 00000100:00100000:1.0:1788835141.937052:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254083456:0@lo:400:kworker.0 00000100:00100000:1.0:1788835141.937184:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835141.937261:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254083456 00000100:00100000:1.0:1788835141.937267:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254083456 00000100:00100000:1.0:1788835141.937301:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788835141.937308:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3615:x1875729254083456:12345-0@lo:400:kworker.0 00000020:00080000:1.0:1788835141.937333:0:6488:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:1.0:1788835141.941180:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3615:x1875729254083456:12345-0@lo:400:kworker.0 Request processed in 3861us (3986us total) trans 0 rc -107/-107 00000100:00100000:1.0:1788835141.941197:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1788835141.941255:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875729254083968:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788835141.941329:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835141.941386:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254083968 00000100:00100000:1.0:1788835141.941395:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254083968 00000100:00100000:1.0:1788835141.941424:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1788835141.941430:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875729254083968:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:1.0:1788835141.941447:0:6488:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788835141.942299:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788835141.942327:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254083840:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788835141.942359:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835141.942413:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254083840:12345-0@lo:13:osp-pre-0-1.0 Request processed in 105us (10338us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835141.942420:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1788835141.942991:0:3614:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-osp-MDT0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788835141.942997:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9afdc1217000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788835141.943001:0:3614:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-osp-MDT0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788835141.943007:0:3614:0:(import.c:65:import_set_state_nolock()) ffff9afdc1217000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788835141.943011:0:3614:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 154 00000100:00100000:3.0:1788835141.943029:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254082688:0@lo:400:kworker.0 00000100:00080000:0.0:1788835141.943036:0:3614:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9afdc1217000 using connection 192.168.203.122@tcp/0@lo 00010000:00080000:3.0:1788835141.943065:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdba36d880 x1875729254083200/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835157 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835141.943072:0:3614:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbfaaa680 x1875729254084096/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788835141.943101:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875729254083200:0@lo:400:kworker.0 00000100:00100000:0.0:1788835141.943122:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254082816:0@lo:400:kworker.0 00000100:00100000:3.0:1788835141.943128:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83eff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254083712:0@lo:400:kworker.0 00000100:00100000:0.0:1788835141.943153:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254083328:0@lo:400:kworker.0 00000100:00100000:0.0:1788835141.943175:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254083840:0@lo:13:osp-pre-0-1.0 00000100:00080000:0.0:1788835141.943381:0:3615:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1788835141.943385:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9afc82607800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788835141.943388:0:3615:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788835141.943391:0:3615:0:(import.c:65:import_set_state_nolock()) ffff9afc82607800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788835141.943394:0:3615:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 197 00000100:00080000:0.0:1788835141.943398:0:3615:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9afc82607800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1788835141.943413:0:3615:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbfaa8000 x1875729254084224/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788835141.943424:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254083456:0@lo:400:kworker.0 00000100:00100000:0.0:1788835141.943448:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254084096:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788835141.943487:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835141.943508:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875729254084224:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1788835141.943528:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835141.943556:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254084096 00000100:00100000:0.0:1788835141.943561:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254084096 00000100:00100000:0.0:1788835141.943585:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1788835141.943591:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875729254084096:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1788835141.943611:0:6493:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788835141.943644:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875729254084096:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 52us (157us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788835141.943651:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00080000:0.0:1788835141.943677:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdc1217000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788835141.943682:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788835141.943685:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaaa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254084096:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:0.0:1788835141.943708:0:6489:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254084224 00000100:00100000:0.0:1788835141.943711:0:6489:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254084224 00000100:00100000:0.0:1788835141.943731:0:6489:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1788835141.943736:0:6489:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3613:x1875729254084224:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:0.0:1788835141.943743:0:6489:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788835141.943771:0:6489:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3613:x1875729254084224:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 34us (242us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788835141.943789:0:6489:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00080000:0.0:1788835141.943814:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc82607800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788835141.943817:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788835141.943821:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875729254084224:0@lo:38:ptlrpcd_00_01.0 00000100:00080000:0.0:1788835141.969628:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdaf454800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:1.0:1788835141.969630:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875729254083968:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 28191us (28309us total) trans 0 rc -19/-19 00000100:00080000:0.0:1788835141.969644:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788835141.969658:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875729254083968:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1788835141.969674:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00080000:2.0:1788835141.982295:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9afdb34c0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788835141.982308:0:3616:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 175 00000100:00080000:2.0:1788835141.982408:0:3616:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9afdb34c0000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788835141.987643:0:3616:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afc844aa680 x1875729254084352/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788835141.987679:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729254083072:0@lo:400:kworker.0 00000100:00100000:0.0:1788835141.987845:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875729254084352:0@lo:38:ptlrpcd_00_02.0 00000100:00100000:0.0:1788835141.987913:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835141.988145:0:9806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254084352 00000100:00100000:1.0:1788835141.988153:0:9806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254084352 00000100:00100000:1.0:1788835141.988204:0:9806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1788835141.988210:0:9806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3613:x1875729254084352:12345-0@lo:38:ptlrpcd_00_02.0 00010000:02000000:1.0:1788835141.988274:0:9806:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:1.0:1788835141.988350:0:9806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3613:x1875729254084352:12345-0@lo:38:ptlrpcd_00_02.0 Request processed in 138us (436us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788835141.988357:0:9806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00080000:3.0:1788835141.988411:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdb34c0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788835141.988418:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1788835141.988422:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875729254084352:0@lo:38:ptlrpcd_00_02.0 00010000:00010000:0.0:1788835142.119767:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835142.440428:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254084480:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788835142.440513:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835142.440679:0:13371:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254084480 00000100:00100000:2.0:1788835142.440688:0:13371:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254084480 00000100:00100000:2.0:1788835142.440742:0:13371:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1788835142.440752:0:13371:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254084480:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788835142.440789:0:13371:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:2.0:1788835142.440849:0:13371:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254084480:12345-0@lo:13:osp-pre-1-1.0 Request processed in 99us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835142.440857:0:13371:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788835142.440994:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254084480:0@lo:13:osp-pre-1-1.0 00000001:00100000:1.0:1788835142.952942:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788835142.953025:0:8398:0:(genops.c:885:class_export_put()) final put ffff9afdbf90a000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1788835142.953054:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b8987b33-76f7-43a0-9448-1013c4af787f 00000020:00000080:1.0:1788835142.953057:0:8398:0:(genops.c:885:class_export_put()) final put ffff9afc83d67000/b8987b33-76f7-43a0-9448-1013c4af787f 00000001:00100000:3.0:1788835142.953145:0:7417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1788835142.953158:0:7417:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967301 is committed 00000020:00000080:3.0:1788835142.953163:0:7417:0:(genops.c:885:class_export_put()) final put ffff9afdc136d000/lustre-MDT0000-mdtlov_UUID 00000001:00100000:3.0:1788835142.953170:0:7417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of e407b2f7-b5e2-4ec6-aa60-e6561b656d05 00000001:00080000:3.0:1788835142.953177:0:7417:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967300 is committed 00000020:00000080:3.0:1788835142.953180:0:7417:0:(genops.c:885:class_export_put()) final put ffff9afc837f4000/e407b2f7-b5e2-4ec6-aa60-e6561b656d05 00000001:00100000:3.0:1788835142.953350:0:7417:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of b8987b33-76f7-43a0-9448-1013c4af787f 00000001:00080000:3.0:1788835142.953355:0:7417:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0001: transno 4294967299 is committed 00000020:00000080:3.0:1788835142.953358:0:7417:0:(genops.c:885:class_export_put()) final put ffff9afc8369a800/b8987b33-76f7-43a0-9448-1013c4af787f 00000001:00100000:0.0:1788835142.953614:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1788835142.953618:0:9481:0:(genops.c:885:class_export_put()) final put ffff9afc83378800/lustre-MDT0000-mdtlov_UUID 00000001:00100000:0.0:1788835142.953628:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b8987b33-76f7-43a0-9448-1013c4af787f 00000020:00000080:0.0:1788835142.953630:0:9481:0:(genops.c:885:class_export_put()) final put ffff9afd82bff800/b8987b33-76f7-43a0-9448-1013c4af787f 00000020:00000080:2.0:1788835142.953818:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdbf90a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788835142.953878:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc83d67000/b8987b33-76f7-43a0-9448-1013c4af787f for lustre-OST0000 00000020:00000080:2.0:1788835142.953895:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdc136d000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001 00000020:00000080:2.0:1788835142.953941:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc837f4000/e407b2f7-b5e2-4ec6-aa60-e6561b656d05 for lustre-MDT0001 00000020:00000080:2.0:1788835142.954257:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc8369a800/b8987b33-76f7-43a0-9448-1013c4af787f for lustre-MDT0001 00000020:00000080:2.0:1788835142.954279:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc83378800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:2.0:1788835142.954295:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afd82bff800/b8987b33-76f7-43a0-9448-1013c4af787f for lustre-OST0001 00000020:00000080:2.0:1788835142.954499:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afdbf908800 for lustre-OST0000 00000020:00000080:2.0:1788835142.954504:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afc83d65000 for lustre-OST0000 00000020:00000080:2.0:1788835142.954508:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afdba067000 for lustre-MDT0001 00000020:00000080:2.0:1788835142.954510:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afc837f5000 for lustre-MDT0001 00000020:00000080:2.0:1788835142.954514:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afc8369a000 for lustre-MDT0001 00000020:00000080:2.0:1788835142.954517:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afc8337b800 for lustre-OST0001 00000020:00000080:2.0:1788835142.954521:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afd82bfd000 for lustre-OST0001 00010000:00010000:2.0:1788835143.141832:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788835143.272232:0:13771:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788835144.166229:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1788835145.006389:0:6467:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788835145.006429:0:6467:0:(genops.c:885:class_export_put()) final put ffff9afdaf565800/lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788835145.006460:0:6467:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e407b2f7-b5e2-4ec6-aa60-e6561b656d05 00000001:00080000:2.0:1788835145.006468:0:6467:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967528 is committed 00000020:00000080:2.0:1788835145.006471:0:6467:0:(genops.c:885:class_export_put()) final put ffff9afc837f6800/e407b2f7-b5e2-4ec6-aa60-e6561b656d05 00000020:00000080:3.0:1788835145.006574:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdaf565800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000 00000020:00000080:3.0:1788835145.009482:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc837f6800/e407b2f7-b5e2-4ec6-aa60-e6561b656d05 for lustre-MDT0000 00000020:00000080:3.0:1788835145.009540:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afdc136f800 for lustre-MDT0000 00000020:00000080:3.0:1788835145.009544:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afc837f6000 for lustre-MDT0000 00010000:00010000:0.0:1788835145.189681:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835146.213678:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1788835146.981446:0:15071:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9afc822f5ae0 - data ffff9afda5f7b510/ffff9afdbf919400 00000020:01000000:3.0:1788835146.981660:0:15071:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9afdb911bea0 - data ffff9afda5caa510/ffff9afdb9263000 00000001:00000004:3.0:1788835146.990189:0:15071:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967528 00000100:00080000:2.0:1788835147.046825:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788835147.046832:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788835147.046835:0:8:0:(import.c:65:import_set_state_nolock()) ffff9afdc1217000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788835147.046842:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 383 00000100:00080000:2.0:1788835147.046848:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-osp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788835147.046854:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9afdc1217000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788835147.046877:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afc845fce00 x1875729254084736/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788835147.046914:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788835147.046917:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788835147.046919:0:8:0:(import.c:65:import_set_state_nolock()) ffff9afdaf454800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788835147.046922:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 383 00000100:00080000:2.0:1788835147.046925:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788835147.046929:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9afdaf454800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788835147.046943:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afc845fca80 x1875729254084864/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788835147.046952:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788835147.046955:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788835147.046957:0:8:0:(import.c:65:import_set_state_nolock()) ffff9afdb34c0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788835147.046960:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 384 00000100:00080000:2.0:1788835147.046962:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788835147.046966:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9afdb34c0000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788835147.046977:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afc845fea00 x1875729254084992/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788835147.047008:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788835147.047012:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788835147.047013:0:8:0:(import.c:65:import_set_state_nolock()) ffff9afc82607800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788835147.047016:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 383 00000100:00080000:2.0:1788835147.047019:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788835147.047022:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9afc82607800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788835147.047034:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afc845ffb80 x1875729254085376/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788835147.047125:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875729254085120:0@lo:400:kworker.0 00000100:00100000:2.0:1788835147.047194:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835147.047258:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788835147.047265:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254084608:0@lo:400:kworker.0 00000100:00100000:2.0:1788835147.047295:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835147.047338:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254085632:0@lo:400:kworker.0 00000100:00100000:2.0:1788835147.047410:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835147.047440:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254084736:0@lo:38:kworker.0 00000100:00100000:2.0:1788835147.047483:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835147.047500:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875729254084864:0@lo:38:kworker.0 00000100:00100000:2.0:1788835147.047521:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835147.047534:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875729254084992:0@lo:38:kworker.0 00000100:00100000:2.0:1788835147.047554:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835147.047572:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875729254085376:0@lo:38:kworker.0 00000100:00100000:2.0:1788835147.047591:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835147.047617:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875729254085504:0@lo:400:kworker.0 00000100:00100000:2.0:1788835147.047638:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835147.047654:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788835147.047659:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254085248:0@lo:400:kworker.0 00000100:00100000:2.0:1788835147.047678:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835147.047710:0:6481:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254084608 00000100:00100000:2.0:1788835147.047717:0:6481:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254084608 00000100:00100000:2.0:1788835147.047774:0:6481:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1788835147.047782:0:6481:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb2e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:3617:x1875729254084608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835147.047840:0:6481:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb2e44850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:5f0122c5-c616-4176-9ca1-6fdce4068f64+19:3617:x1875729254084608:12345-0@lo:400:kworker.0 Request processed in 58us (543us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835147.047847:0:6481:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 399 00000100:00100000:2.0:1788835147.047881:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254085632 00000100:00100000:2.0:1788835147.047886:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254085632 00000100:00100000:2.0:1788835147.047919:0:8405:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254085248 00000100:00100000:2.0:1788835147.047922:0:8405:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254085248 00000100:00100000:2.0:1788835147.047941:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788835147.047948:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254085632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835147.047981:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254085632:12345-0@lo:400:kworker.0 Request processed in 33us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835147.047987:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1788835147.047999:0:8405:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1788835147.048005:0:8405:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254085248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835147.048036:0:8405:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254085248:12345-0@lo:400:kworker.0 Request processed in 31us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835147.048041:0:8405:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00080000:2.0:1788835147.048063:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788835147.048067:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788835147.048098:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254085248:0@lo:400:kworker.0 00000100:00100000:2.0:1788835147.048119:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:3617:1875729254084608:0@lo:400:kworker.0 00000100:00100000:2.0:1788835147.048126:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254085632:0@lo:400:kworker.0 00000100:00100000:2.0:1788835147.048163:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254085120 00000100:00100000:2.0:1788835147.048166:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254085120 00000100:00080000:2.0:1788835147.048178:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788835147.048193:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254084864 00000100:00100000:2.0:1788835147.048201:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254084864 00000100:00100000:2.0:1788835147.048210:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254084992 00000100:00100000:2.0:1788835147.048212:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254084992 00000100:00100000:2.0:1788835147.048217:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254085376 00000100:00100000:2.0:1788835147.048219:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254085376 00000100:00100000:2.0:1788835147.048224:0:6488:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254085504 00000100:00100000:2.0:1788835147.048226:0:6488:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254085504 00000100:00080000:2.0:1788835147.048236:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788835147.048247:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 360 00000100:00100000:2.0:1788835147.048252:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875729254085120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835147.048281:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3617:x1875729254085120:12345-0@lo:400:kworker.0 Request processed in 29us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835147.048287:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 360 00010000:00080000:2.0:1788835147.048307:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc845fdc00 x1875729254085120/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835147.048339:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0000_UUID:3617:1875729254085120:0@lo:400:kworker.0 00000100:00100000:2.0:1788835147.048356:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 361 00000100:00100000:2.0:1788835147.048361:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875729254085504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835147.048388:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3615:x1875729254085504:12345-0@lo:400:kworker.0 Request processed in 27us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835147.048394:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 361 00010000:00080000:2.0:1788835147.048411:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc845fd180 x1875729254085504/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835147.048420:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875729254085504:0@lo:400:kworker.0 00000100:00100000:2.0:1788835147.048433:0:6488:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1788835147.048438:0:6488:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875729254084864:12345-0@lo:38:kworker.0 00010000:02000000:2.0:1788835147.048458:0:6488:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788835147.049255:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788835147.049264:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875729254084992:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788835147.049276:0:6487:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788835147.049345:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875729254084992:12345-0@lo:38:kworker.0 Request processed in 81us (1790us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788835147.049352:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1788835147.049371:0:6487:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788835147.049375:0:6487:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875729254085376:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788835147.049383:0:6487:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788835147.049409:0:6487:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875729254085376:12345-0@lo:38:kworker.0 Request processed in 32us (1816us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788835147.049415:0:6487:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:0.0:1788835147.049435:0:6493:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254084736 00000100:00100000:0.0:1788835147.049441:0:6493:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254084736 00000100:00100000:0.0:1788835147.049477:0:6493:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:0.0:1788835147.049481:0:6493:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875729254084736:12345-0@lo:38:kworker.0 00010000:02000000:0.0:1788835147.049489:0:6493:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1788835147.049516:0:6493:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875729254084736:12345-0@lo:38:kworker.0 Request processed in 33us (2033us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788835147.049523:0:6493:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00080000:0.0:1788835147.049603:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdc1217000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788835147.049616:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788835147.049621:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254084736:0@lo:38:kworker.0 00000100:00080000:0.0:1788835147.049634:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdb34c0000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788835147.049638:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788835147.049641:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875729254084992:0@lo:38:kworker.0 00000100:00080000:0.0:1788835147.049650:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc82607800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788835147.049653:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788835147.049656:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875729254085376:0@lo:38:kworker.0 00000100:00100000:0.0:1788835147.049694:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254085760:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788835147.049729:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835147.049776:0:8407:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254085760 00000100:00100000:0.0:1788835147.049780:0:8407:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254085760 00000100:00100000:0.0:1788835147.049810:0:8407:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788835147.049817:0:8407:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254085760:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788835147.049838:0:8407:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923529728 avail 3692007424 00000100:00100000:0.0:1788835147.049874:0:8407:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254085760:12345-0@lo:13:osp-pre-0-1.0 Request processed in 57us (144us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835147.049880:0:8407:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1788835147.049912:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254085760:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788835147.069031:0:6488:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875729254084864:12345-0@lo:38:kworker.0 Request processed in 20582us (21499us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788835147.069047:0:6488:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00080000:1.0:1788835147.073353:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdaf454800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788835147.073589:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788835147.073596:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875729254084864:0@lo:38:kworker.0 00000100:00080000:1.0:1788835147.090436:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788835147.090449:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 4 00000100:00100000:1.0:1788835147.090469:0:15071:0:(client.c:3163:ptlrpc_free_committed()) @@@ free request with old gen req@ffff9afd9e814380 x1875729254082304/t4294967301(4294967301) o39->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 224/224 e 0 to 0 dl 1788835150 ref 1 fl Complete:RNQU/204/0 rc 0/0 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835147.090509:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:1.0:1788835147.093918:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788835147.093945:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 4 00000004:00080000:1.0:1788835147.093969:0:15071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788835147.093973:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788835147.094791:0:8608:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788835147.094799:0:8608:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:2.0:1788835147.094812:0:8608:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1788835147.097190:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788835147.097198:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 4 00000004:00080000:1.0:1788835147.097217:0:15071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788835147.097220:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1788835147.097736:0:9812:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1788835147.097741:0:9812:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1788835147.097762:0:9812:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:3.0:1788835147.099273:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1696 00000020:00000080:3.0:1788835147.100802:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afdb34e9800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788835147.102189:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdb34e9800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788835147.106031:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d16ab 00000020:00000080:3.0:1788835147.106046:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afd9e82f000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1788835147.106112:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1788835147.106118:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788835147.106127:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1788835147.106131:0:15071:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9afdb2edb370) has no exports 00000004:01000000:3.0:1788835147.106382:0:15071:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1788835147.106392:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1ae1 00000020:00000080:3.0:1788835147.106474:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afc8346b800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788835147.111156:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afd9e82f000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1788835147.111433:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788835147.111444:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788835147.111459:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788835147.111464:0:15071:0:(genops.c:1558:class_disconnect_exports()) OBD device 28 (ffff9afc82370000) has no exports 00000020:00000080:3.0:1788835147.111473:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1ada 00000020:00000080:3.0:1788835147.111481:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afdb34c2000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788835147.112235:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc8346b800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00010000:01000000:3.0:1788835147.112897:0:15071:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788835147.112901:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788835147.112917:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967326 gen 5 00000004:00080000:3.0:1788835147.112923:0:15071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788835147.112925:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788835147.113160:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdb34c2000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788835147.113241:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788835147.113253:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788835147.113272:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d199f 00000020:00000080:3.0:1788835147.113279:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afdbf96d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788835147.113389:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afdb34c6000 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1788835147.113397:0:37:0:(genops.c:885:class_export_put()) final put ffff9afc83119800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788835147.113399:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc83119800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1788835147.113404:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788835147.113591:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1788835147.113596:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788835147.113603:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788835147.113607:0:15071:0:(genops.c:1558:class_disconnect_exports()) OBD device 22 (ffff9afdbf93b370) has no exports 00000020:00000080:3.0:1788835147.113613:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1998 00000020:00000080:3.0:1788835147.113617:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afc82602000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788835147.113636:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdbf96d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00010000:01000000:3.0:1788835147.114042:0:15071:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1788835147.114046:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788835147.114048:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967311 gen 5 00000004:00080000:3.0:1788835147.114052:0:15071:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788835147.114055:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788835147.114210:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc82602000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1788835147.114292:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788835147.114299:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000004:01000000:3.0:1788835147.114348:0:15071:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:3.0:1788835147.114354:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d184f 00000020:00000080:3.0:1788835147.114360:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afdba237800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788835147.114577:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afdbf96a800 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1788835147.114584:0:37:0:(genops.c:885:class_export_put()) final put ffff9afc82600800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788835147.114586:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc82600800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1788835147.114591:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1788835147.114691:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osp-MDT0000 (flags='') 00000020:00000080:3.0:1788835147.114695:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788835147.114701:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osp-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1788835147.114704:0:15071:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9afdb71599b8) has no exports 00000020:00000080:3.0:1788835147.114708:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1848 00000020:00000080:3.0:1788835147.114712:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afd9e82f800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788835147.114724:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdba237800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:00000080:2.0:1788835147.115873:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afd9e82f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1788835147.116377:0:15071:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-osp-MDT0000: client import never connected 00000100:00080000:2.0:1788835147.116390:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:2.0:1788835147.116393:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 4294967298 gen 5 00000100:00100000:2.0:1788835147.116400:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788835147.116448:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788835147.116457:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788835147.116482:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788835147.116484:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788835147.116488:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afdb34ea800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1788835147.116491:0:15071:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdb34ea800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1788835147.116496:0:15071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1788835147.116589:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d16b2 00000020:00000080:2.0:1788835147.116595:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afd9e82a000/lustre-MDD0000_UUID 00000020:01000000:2.0:1788835147.116599:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1788835147.116602:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788835147.116608:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1788835147.116611:0:15071:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9afdb2ed99b8) has no exports 00000020:00000080:2.0:1788835147.116631:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788835147.116634:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1788835147.116638:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d16b9 00000020:00000080:2.0:1788835147.116641:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afd9e828000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1788835147.116649:0:15071:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afd85554000 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1788835147.116652:0:15071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afd85554000 3 00000020:01000004:2.0:1788835147.116656:0:15071:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9afd85554000 from lustre-MDT0000 00000020:00000080:2.0:1788835147.116672:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788835147.116675:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1788835147.116677:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afdb34ec800/lustre-MDT0000_UUID 00000020:00000080:2.0:1788835147.116680:0:15071:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdb34ec800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1788835147.116686:0:15071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1788835147.116714:0:15071:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 3 references. 00000020:01000004:2.0:1788835147.116717:0:15071:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1788835147.116720:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1788835147.116723:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788835147.116732:0:15071:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788835147.116739:0:15071:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9afd9098c000 5f0122c5-c616-4176-9ca1-6fdce4068f64 0@lo 18 (0 0 13) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788835147.116756:0:15071:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9afdb2edcd28) has exports, disconnecting them 00000020:00080000:2.0:1788835147.116761:0:15071:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9afd9098c000), last request at 1788834892 00000020:00000080:2.0:1788835147.116779:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1657 00000020:00010000:2.0:1788835147.116784:0:15071:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9afd9098c000: total 2 00000100:00080000:2.0:1788835147.116788:0:15071:0:(import.c:65:import_set_state_nolock()) ffff9afd90988000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1788835147.116802:0:15071:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9afd9098c000): rc 0 00000020:00080000:2.0:1788835147.116807:0:15071:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9afdb2edcd28) has no exports 00000100:00100000:2.0:1788835147.116871:0:6481:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9afd83335000:6481] 0 exiting: rc = 1 00000100:00100000:2.0:1788835147.116960:0:6482:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9afd83334a00:6482] 1 exiting: rc = 0 00000020:00000080:1.0:1788835147.117186:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afd9e82c800 for lustre-MDT0001-osp-MDT0000 00000020:00000080:1.0:1788835147.117195:0:37:0:(genops.c:885:class_export_put()) final put ffff9afdaf451000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1788835147.117197:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdaf451000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0001-osp-MDT0000 00000020:01000000:1.0:1788835147.117205:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osp-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788835147.117280:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afd9e82a000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1788835147.117284:0:37:0:(genops.c:885:class_export_put()) final put ffff9afdb34ee800/lustre-MDD0000_UUID 00000020:00000080:1.0:1788835147.117285:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdb34ee800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1788835147.117288:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1788835147.117338:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afd9e828000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:2.0:1788835147.119545:0:6476:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9afd9098c000: total 0 00010000:00010000:2.0:1788835147.119610:0:6476:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9afd9098c000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1788835147.119647:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d1bc8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d1bc1 expref: 14 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835147.119668:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e61c00/0xdf60171e5a5d1e06 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d1dff expref: 13 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835147.119678:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d1bd6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d1bcf expref: 12 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835147.119688:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e62e00/0xdf60171e5a5d1e14 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d1e0d expref: 11 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835147.119698:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdc204ac00/0xdf60171e5a5d1a78 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d1a71 expref: 10 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835147.119712:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afc8374de00/0xdf60171e5a5d1b82 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d1b7b expref: 9 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835147.119758:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afc8374c800/0xdf60171e5a5d1b74 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d1b6d expref: 8 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835147.119771:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd866f5200/0xdf60171e5a5d1753 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d174c expref: 7 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835147.119783:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afc8374d400/0xdf60171e5a5d1b9e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d1b97 expref: 6 pid: 6483 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835147.119794:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd80031600/0xdf60171e5a5d1c1c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d1c15 expref: 5 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835147.119804:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd80030000/0xdf60171e5a5d1bac lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d1ba5 expref: 4 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835147.119817:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd866f5c00/0xdf60171e5a5d1761 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d175a expref: 3 pid: 6481 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835147.119830:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd80030800/0xdf60171e5a5d1df8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xdf60171e5a5d1df1 expref: 2 pid: 6482 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835147.119840:0:6476:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9afd9098c000, canceled 13 locks, left on hash table 0. 00000020:00000080:2.0:1788835147.119856:0:6476:0:(genops.c:885:class_export_put()) final put ffff9afd9098c000/5f0122c5-c616-4176-9ca1-6fdce4068f64 00010000:00010000:2.0:1788835147.119870:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835147.119872:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835147.119874:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1788835147.123195:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afd9098c000/5f0122c5-c616-4176-9ca1-6fdce4068f64 for MGS 00000020:00000080:1.0:1788835147.123624:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afd90988000 for MGS 00000100:00100000:2.0:1788835147.124489:0:6483:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9afd84ee7c00:6483] 2 exiting: rc = 0 00000100:00100000:1.0:1788835147.125024:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125033:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125041:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125048:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125054:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125060:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125066:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125072:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125078:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125084:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125091:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125097:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125102:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125124:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125129:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125135:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125140:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125145:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125149:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125154:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125160:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125165:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125171:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125177:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125183:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125189:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125195:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125200:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125205:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125211:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125216:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125221:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125227:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125232:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125238:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125244:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125248:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125253:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125269:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125274:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125279:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125284:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125289:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125294:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125299:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125304:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125309:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125336:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125351:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125357:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125362:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125367:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125372:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125377:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125382:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125388:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125393:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125398:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125403:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125408:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125413:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125419:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125424:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835147.125430:0:15071:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:01000000:1.0:1788835147.128974:0:15071:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9afc83285060 - data ffff9afc81c38af8/ffff9afc837d3000 00000020:01000000:1.0:1788835147.129122:0:15071:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9afd916a86c0 - data ffff9afda5ca8288/ffff9afdaaf3bc00 00000020:00000080:1.0:1788835147.129598:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d163b 00000020:00000080:1.0:1788835147.129608:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afd85551000/lustre-MDT0000-osd_UUID 00000020:01000004:1.0:1788835147.129630:0:15071:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afd85554000 from MGS, refs=2 00000020:01000004:1.0:1788835147.129633:0:15071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afd85554000 2 00000020:01000004:1.0:1788835147.129636:0:15071:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9afd85554000 from MGS 00000020:00000080:1.0:1788835147.129656:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788835147.129663:0:15071:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:1.0:1788835147.129665:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afdab6c8800/MGS 00000020:00000080:1.0:1788835147.129668:0:15071:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdab6c8800/MGS for MGS 00000020:00000080:2.0:1788835147.129670:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afd85551000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:1.0:1788835147.129677:0:15071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:1.0:1788835147.129752:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:1.0:1788835147.129756:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788835147.129761:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:1.0:1788835147.129768:0:15071:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9afdb90c1000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1788835147.129773:0:15071:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9afdab4bcd28) has exports, disconnecting them 00000020:00080000:1.0:1788835147.129788:0:15071:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9afdb90c1000), last request at 1788834892 00000020:00000080:1.0:1788835147.129793:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1706 00000020:00080000:1.0:1788835147.129803:0:15071:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9afdb90c1000): rc 0 00000020:00000080:1.0:1788835147.129809:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afdb90c1000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788835147.129888:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdb90c1000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1788835147.135615:0:15071:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1788835147.135624:0:15071:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788835147.135629:0:15071:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788835147.135636:0:15071:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788835147.135666:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afdb90c2000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1788835147.135873:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788835147.135882:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1788835147.135888:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afdb90ef800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1788835147.135892:0:15071:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdb90ef800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1788835147.135898:0:15071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1788835147.135968:0:15071:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afd85554000 1 00000020:00000080:2.0:1788835147.135974:0:15071:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d162d 00000020:00000080:2.0:1788835147.135979:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afdab6cb000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1788835147.135988:0:15071:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1788835147.135995:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdab6cb000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1788835147.136003:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788835147.136008:0:15071:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788835147.136011:0:15071:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9afdab4f0000) has no exports 00000020:00000080:2.0:1788835147.226117:0:15071:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788835147.226129:0:15071:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1788835147.226135:0:15071:0:(genops.c:885:class_export_put()) final put ffff9afd85557000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1788835147.226140:0:15071:0:(genops.c:844:class_export_destroy()) destroying export ffff9afd85557000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1788835147.226146:0:15071:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1788835147.226253:0:15071:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9afd85553800 00000020:02000400:2.0:1788835147.227531:0:15071:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1788835147.250158:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835147.558341:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788835147.558361:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254085888:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788835147.558457:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835147.558517:0:8406:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254085888 00000100:00100000:0.0:1788835147.558523:0:8406:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254085888 00000100:00100000:0.0:1788835147.558561:0:8406:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788835147.558577:0:8406:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254085888:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788835147.558605:0:8406:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923521536 avail 3691999232 00000100:00100000:0.0:1788835147.558645:0:8406:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254085888:12345-0@lo:13:osp-pre-1-1.0 Request processed in 69us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835147.558652:0:8406:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1788835147.558707:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254085888:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788835148.262571:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835149.287588:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835150.315984:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788835150.581714:0:15274:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788835150.596681:0:15274:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0001 00010000:00010000:1.0:1788835150.596745:0:15274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d1bc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1bc8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.596761:0:15274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d1bc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1bc8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.596769:0:15274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d1bc1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1bc8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.596777:0:15274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d1bc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1bc8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.596835:0:15274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788835150.596841:0:15274:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788835150.596865:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788835150.596870:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788835150.596876:0:15274:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788835150.596882:0:15274:0:(import.c:65:import_set_state_nolock()) ffff9afdaf454800 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:1.0:1788835150.596886:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788835150.596889:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788835150.596892:0:15274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788835150.597822:0:15274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1bcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1bd6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.597848:0:15274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1bcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1bd6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.597855:0:15274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1bcf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1bd6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.597862:0:15274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1bcf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1bd6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835150.599200:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788835150.599211:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d1bc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1bc8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835150.599238:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374c200 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788835150.599243:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d1bc1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1bc8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835150.599251:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d1bc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf60171e5a5d1bc8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788835150.599257:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d1bc1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf60171e5a5d1bc8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835150.599263:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788835150.599265:0:7429:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788835150.599268:0:7429:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788835150.599306:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d1bc1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1bc8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835150.599328:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788835150.599354:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d1bc1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1bc8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835150.599361:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d1bc1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1bc8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835150.599376:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835150.599379:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1bd6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835150.599384:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80031e00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788835150.599387:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1bcf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1bd6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835150.599400:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1bcf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf60171e5a5d1bd6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788835150.599407:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1bcf lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf60171e5a5d1bd6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835150.599412:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788835150.599414:0:7429:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0001: stopping, won't requeue 00000100:00100000:0.0:1788835150.599423:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729254086016:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788835150.599428:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1bcf lrc: 3/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1bd6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835150.599435:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788835150.599451:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1bcf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1bd6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835150.599459:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835150.599461:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835150.599463:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835150.599464:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254086144:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788835150.599499:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835150.599776:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835150.600038:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254086016 00000100:00100000:0.0:1788835150.600045:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254086016 00000100:00100000:0.0:1788835150.600075:0:7430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254086144 00000100:00100000:0.0:1788835150.600077:0:7430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254086144 00000100:00100000:0.0:1788835150.600093:0:7430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788835150.600099:0:7430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3615:x1875729254086016:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1788835150.600106:0:7430:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788835150 with bad export cookie 16095890487354660439 00000100:00100000:2.0:1788835150.600452:0:6474:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788835150.600458:0:6474:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdaae68c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3616:x1875729254086144:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1788835150.600464:0:6474:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1788835150 with bad export cookie 16095890487354660439 00000100:00100000:2.0:1788835150.600529:0:6474:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdaae68c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3616:x1875729254086144:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (754us total) trans 0 rc -107/-107 00000100:00100000:2.0:1788835150.600537:0:6474:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1788835150.600573:0:3616:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.122@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1788835150.600578:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9afd84ea2800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1788835150.600581:0:3616:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.122@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:1.0:1788835150.603781:0:15274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1788835150.603797:0:15274:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd80031e00/0xdf60171e5a5d1bcf lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1bd6 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.603823:0:15274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d1a71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1a78 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.603831:0:15274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d1a71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1a78 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.603838:0:15274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d1a71 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1a78 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.603846:0:15274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d1a71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1a78 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.603868:0:15274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788835150.603886:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788835150.603892:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d1a71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1a78 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.603914:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80031000 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:1.0:1788835150.603918:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d1a71 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1a78 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.603926:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d1a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf60171e5a5d1a78 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788835150.603932:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d1a71 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf60171e5a5d1a78 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788835150.603938:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:1.0:1788835150.603941:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:1.0:1788835150.603943:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1788835150.603978:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835150.608202:0:7430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3615:x1875729254086016:12345-0@lo:103:ldlm_bl.0 Request processed in 8087us (8688us total) trans 0 rc -107/-107 00000100:00100000:0.0:1788835150.608215:0:7430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00010000:0.0:1788835150.608459:0:15274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1e0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1e14 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835150.608530:0:15274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1e0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1e14 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835150.608537:0:15274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1e0d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1e14 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835150.608544:0:15274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1e0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1e14 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835150.608575:0:15274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788835150.608583:0:15274:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdc204be00/0xdf60171e5a5d175a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1761 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835150.608590:0:15274:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdc204be00/0xdf60171e5a5d175a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1761 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835150.608596:0:15274:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdc204be00/0xdf60171e5a5d175a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1761 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835150.608602:0:15274:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9afdc204be00/0xdf60171e5a5d175a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1761 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1788835150.608615:0:3615:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.122@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:0.0:1788835150.608616:0:15274:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1788835150.608624:0:15274:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0001 10000000:01000000:0.0:1788835150.608628:0:15274:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0001 (0) 00000020:01000004:0.0:1788835150.608752:0:15274:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0001 00000020:01000000:0.0:1788835150.608756:0:15274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001 (flags='F') 00000020:00000080:0.0:1788835150.608761:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788835150.608767:0:15274:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001: forcing exports to disconnect: 2/5 00000020:00080000:0.0:1788835150.608773:0:15274:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9afc8346f800 lustre-MDT0001-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788835150.608779:0:15274:0:(genops.c:1819:print_export_data()) lustre-MDT0001: ACTIVE ffff9afdaf450800 lustre-MDT0001-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788835150.608783:0:15274:0:(genops.c:1553:class_disconnect_exports()) OBD device 11 (ffff9afdaf558000) has exports, disconnecting them 00000020:00080000:0.0:1788835150.608788:0:15274:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9afc8346f800), last request at 1788835147 00000020:00000080:0.0:1788835150.608794:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1a39 00000100:00080000:0.0:1788835150.608809:0:15274:0:(import.c:65:import_set_state_nolock()) ffff9afc8346c000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788835150.608849:0:15274:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9afc8346f800): rc 0 00000020:00000080:0.0:1788835150.608852:0:15274:0:(genops.c:885:class_export_put()) final put ffff9afc8346f800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00080000:0.0:1788835150.608870:0:15274:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001: disconnecting export at 0@lo (ffff9afdaf450800), last request at 1788835147 00000020:00000080:0.0:1788835150.608873:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1913 00000100:00080000:0.0:1788835150.608879:0:15274:0:(import.c:65:import_set_state_nolock()) ffff9afc82605000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1788835150.608887:0:15274:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9afdaf450800): rc 0 00000020:00000080:0.0:1788835150.608889:0:15274:0:(genops.c:885:class_export_put()) final put ffff9afdaf450800/lustre-MDT0001-lwp-OST0000_UUID 00000004:00000080:0.0:1788835150.608895:0:15274:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=400866e7 len=0 karg=ffffadff40f6fae0 00000100:00080000:0.0:1788835150.608913:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788835150.608916:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 3 00000100:00080000:0.0:1788835150.613362:0:15274:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788835150.613372:0:15274:0:(import.c:65:import_set_state_nolock()) ffff9afdc1217000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00010000:00010000:0.0:1788835150.616460:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788835150.616472:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1e0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1e14 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835150.616483:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60200 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:0.0:1788835150.616487:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1e0d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1e14 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835150.616497:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1e0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf60171e5a5d1e14 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788835150.616505:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1e0d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf60171e5a5d1e14 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788835150.616511:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1788835150.616513:0:7429:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1788835150.616516:0:7429:0:(mgc_request.c:130:config_log_put()) dropping config log params 00000100:00080000:2.0:1788835150.627488:0:3616:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.122@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1788835150.627677:0:3616:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1788835150.627687:0:3616:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afdbf9b9f80 x1875729254086016/t0(0) o103->MGC192.168.203.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788835166 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835150.627703:0:3616:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afdbf9baa00 x1875729254086144/t0(0) o103->MGC192.168.203.122@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1788835166 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1788835150.630810:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1788835150.630819:0:3616:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1788835150.630821:0:3616:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00010000:00010000:1.0:1788835150.632403:0:6477:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d1a71 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1a78 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.632420:0:6477:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788835150.632449:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d1a71 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1a78 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.632457:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd80031000/0xdf60171e5a5d1a71 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1a78 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.632481:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788835150.632486:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdc204be00/0xdf60171e5a5d175a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1761 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.632493:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204be00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:1.0:1788835150.632498:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdc204be00/0xdf60171e5a5d175a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1761 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.632591:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdc204be00/0xdf60171e5a5d175a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf60171e5a5d1761 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788835150.632599:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdc204be00/0xdf60171e5a5d175a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf60171e5a5d1761 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788835150.632605:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1788835150.632608:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1788835150.632611:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1788835150.632624:0:6477:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9afd84ea2800 00010000:00010000:1.0:1788835150.632628:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdc204be00/0xdf60171e5a5d175a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf60171e5a5d1761 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.632635:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdc204be00/0xdf60171e5a5d175a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf60171e5a5d1761 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835150.632647:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835150.632649:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835150.632651:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835150.632750:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:5f0122c5-c616-4176-9ca1-6fdce4068f64:0:1875729254086272:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1788835150.633433:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788835150.633438:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 3 00000004:00080000:1.0:1788835150.633458:0:15274:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1788835150.633523:0:15274:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:1.0:1788835150.633543:0:15274:0:(import.c:65:import_set_state_nolock()) ffff9afc820d4000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1788835150.633557:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788835150.633559:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 3 00000004:00080000:1.0:1788835150.633567:0:15274:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788835150.633642:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254086400:0@lo:9:umount.0 00000100:00100000:1.0:1788835150.633731:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788835150.633782:0:15274:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:1.0:1788835150.633793:0:15274:0:(import.c:65:import_set_state_nolock()) ffff9afc830f8800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1788835150.633810:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254086528:0@lo:9:umount.0 00000100:00100000:1.0:1788835150.633836:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1788835150.634088:0:15274:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9afdaf558000) has no exports 00000100:00080000:3.0:1788835150.637191:0:3615:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff9afd84ea2800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1788835150.637221:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:3615:1875729254086016:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1788835150.637256:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc8346f800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001 00000020:00000080:3.0:1788835150.637450:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdaf450800/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001 00000020:00000080:3.0:1788835150.637612:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afc8346c000 for lustre-MDT0001 00000020:00000080:3.0:1788835150.637618:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afc82605000 for lustre-MDT0001 00010000:00010000:3.0:1788835150.637629:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835150.646436:0:7429:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1e0d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1e14 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835150.646472:0:7429:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788835150.646516:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1e0d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1e14 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835150.646524:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60200/0xdf60171e5a5d1e0d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xdf60171e5a5d1e14 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835150.646549:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788835150.646569:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:5f0122c5-c616-4176-9ca1-6fdce4068f64:0:1875729254086656:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788835150.647031:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835150.647035:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835150.647037:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835150.649177:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254086400 00000100:00100000:3.0:1788835150.649192:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254086400 00000100:00100000:3.0:1788835150.649268:0:9814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254086528 00000100:00100000:3.0:1788835150.649272:0:9814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254086528 00000100:00100000:3.0:1788835150.649297:0:9814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1788835150.649307:0:9814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3613:x1875729254086400:12345-0@lo:9:umount.0 00000020:00000080:3.0:1788835150.649353:0:9814:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1960 00000100:00080000:3.0:1788835150.649362:0:9814:0:(import.c:65:import_set_state_nolock()) ffff9afc820d7800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1788835150.649421:0:9814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967311 00000100:00080000:2.0:1788835150.649585:0:3616:0:(import.c:65:import_set_state_nolock()) ffff9afd84ea2800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788835150.649592:0:3616:0:(import.c:510:import_select_connection()) MGC192.168.203.122@tcp: connect to NID 0@lo last attempt 134 00000100:00080000:2.0:1788835150.649598:0:3616:0:(import.c:624:import_select_connection()) MGC192.168.203.122@tcp: import ffff9afd84ea2800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788835150.649606:0:9814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+2:3613:x1875729254086400:12345-0@lo:9:umount.0 Request processed in 301us (15875us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835150.649614:0:9814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1788835150.649627:0:8403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788835150.649635:0:8403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3613:x1875729254086528:12345-0@lo:9:umount.0 00000020:00000080:2.0:1788835150.649650:0:8403:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1aa2 00000100:00080000:2.0:1788835150.649655:0:8403:0:(import.c:65:import_set_state_nolock()) ffff9afc83468800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1788835150.649686:0:8403:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967326 00000100:00100000:3.0:1788835150.649701:0:3616:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afd9e817480 x1875729254086784/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788835150.649737:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:5f0122c5-c616-4176-9ca1-6fdce4068f64:3616:1875729254086144:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788835150.649791:0:8403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+2:3613:x1875729254086528:12345-0@lo:9:umount.0 Request processed in 156us (15953us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835150.649798:0:8403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00010000:00010000:2.0:1788835150.649825:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788835150.650035:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788835150.650040:0:6484:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1788835150.650058:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835150.650076:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5f0122c5-c616-4176-9ca1-6fdce4068f64:3613:1875729254086784:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:0.0:1788835150.650109:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729254086784 offset 0 length 520: 4 00000100:00080000:0.0:1788835150.650151:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc830f8800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788835150.650174:0:3613:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788835150.650176:0:3613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788835150.650179:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254086528:0@lo:9:umount.0 00000100:00080000:0.0:1788835150.650191:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc820d4000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1788835150.650206:0:3613:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1788835150.650208:0:3613:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1788835150.650211:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254086400:0@lo:9:umount.0 00000020:00080000:3.0:1788835150.662039:0:15274:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9afdaf558000) has no exports 00000020:01000000:2.0:1788835150.725082:0:15274:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9afdc131aae0 - data ffff9afda5effbd0/ffff9afc83c44800 00000020:01000000:2.0:1788835150.725226:0:15274:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9afd84fbede0 - data ffff9afda5dbc870/ffff9afdc11f8000 00000001:00000004:2.0:1788835150.734664:0:15274:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 1, last_transno is 4294967301 00000100:00080000:3.0:1788835150.792425:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1788835150.792434:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 4 00000100:00100000:3.0:1788835150.792455:0:15274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000100:00080000:3.0:1788835150.794089:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1788835150.794095:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 4 00000004:00080000:3.0:1788835150.794115:0:15274:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788835150.794118:0:15274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788835150.794358:0:8602:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788835150.794363:0:8602:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 1 count 1 00000040:00080000:0.0:1788835150.794387:0:8602:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:3.0:1788835150.795605:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1788835150.795612:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 4 00000004:00080000:3.0:1788835150.795681:0:15274:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1788835150.795684:0:15274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1788835150.797063:0:9802:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1788835150.797070:0:9802:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 1 count 1 00000040:00080000:0.0:1788835150.797082:0:9802:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1788835150.798854:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d177d 00000020:00000080:0.0:1788835150.798864:0:15274:0:(genops.c:885:class_export_put()) final put ffff9afdaf563800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788835150.799597:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdaf563800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:1.0:1788835150.801146:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1792 00000020:00000080:1.0:1788835150.801156:0:15274:0:(genops.c:885:class_export_put()) final put ffff9afdaf563000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788835150.801206:0:15274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-mdtlov (flags='') 00000020:00000080:1.0:1788835150.801212:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788835150.801221:0:15274:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1788835150.801226:0:15274:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9afdaf55b370) has no exports 00000004:01000000:1.0:1788835150.801435:0:15274:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:1.0:1788835150.801443:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1a9b 00000020:00000080:1.0:1788835150.801448:0:15274:0:(genops.c:885:class_export_put()) final put ffff9afc830fc000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788835150.806018:0:15274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788835150.806051:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788835150.806067:0:15274:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788835150.806072:0:15274:0:(genops.c:1558:class_disconnect_exports()) OBD device 27 (ffff9afdab4f3370) has no exports 00000020:00000080:1.0:1788835150.806082:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1a94 00000020:00000080:1.0:1788835150.806090:0:15274:0:(genops.c:885:class_export_put()) final put ffff9afc830fd800/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788835150.806491:0:15274:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788835150.806495:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1788835150.806499:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 4294967298 gen 5 00000004:00080000:1.0:1788835150.806505:0:15274:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788835150.806507:0:15274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788835150.806551:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788835150.806558:0:15274:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:1.0:1788835150.806565:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1959 00000020:00000080:1.0:1788835150.806570:0:15274:0:(genops.c:885:class_export_put()) final put ffff9afc820d1800/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788835150.806586:0:15274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0001 (flags='') 00000020:00000080:1.0:1788835150.806594:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788835150.806598:0:15274:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788835150.806601:0:15274:0:(genops.c:1558:class_disconnect_exports()) OBD device 21 (ffff9afc820c8000) has no exports 00000020:00000080:1.0:1788835150.806605:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1952 00000020:00000080:1.0:1788835150.806608:0:15274:0:(genops.c:885:class_export_put()) final put ffff9afc820d7000/lustre-MDT0001-osd_UUID 00010000:01000000:1.0:1788835150.807051:0:15274:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0001: client import never connected 00000100:00080000:1.0:1788835150.807055:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1788835150.807057:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 4294967297 gen 5 00000004:00080000:1.0:1788835150.807061:0:15274:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1788835150.807062:0:15274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788835150.807100:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788835150.807105:0:15274:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000004:01000000:1.0:1788835150.807118:0:15274:0:(lod_lov.c:59:lod_putref()) destroying 1 ltd desc 00000020:00000080:1.0:1788835150.807123:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d17b5 00000020:00000080:1.0:1788835150.807127:0:15274:0:(genops.c:885:class_export_put()) final put ffff9afdc1368000/lustre-MDT0001-mdtlov_UUID 00000020:01000000:1.0:1788835150.807133:0:15274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osp-MDT0001 (flags='F') 00000020:00000080:1.0:1788835150.807141:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788835150.807145:0:15274:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osp-MDT0001: forcing exports to disconnect: 0/3 00000020:00080000:1.0:1788835150.807147:0:15274:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9afdab4f19b8) has no exports 00000020:00000080:1.0:1788835150.807151:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d17ae 00000020:00000080:1.0:1788835150.807153:0:15274:0:(genops.c:885:class_export_put()) final put ffff9afdc1215000/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788835150.808829:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdaf563000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:00000080:3.0:1788835150.808847:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc830fc000/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788835150.808853:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc830fd800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788835150.808859:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afc830f8800 for lustre-OST0001-osc-MDT0001 00000020:00000080:3.0:1788835150.808866:0:479:0:(genops.c:885:class_export_put()) final put ffff9afc830ff800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788835150.808869:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc830ff800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001-osc-MDT0001 00000020:01000000:3.0:1788835150.808873:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788835150.808948:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc820d1800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788835150.808952:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc820d7000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788835150.808958:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afc820d4000 for lustre-OST0000-osc-MDT0001 00000020:00000080:3.0:1788835150.808962:0:479:0:(genops.c:885:class_export_put()) final put ffff9afc820d2800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788835150.808963:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc820d2800/lustre-MDT0001-mdtlov_UUID for lustre-OST0000-osc-MDT0001 00000020:01000000:3.0:1788835150.808966:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788835150.808988:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdc1368000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788835150.808992:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdc1215000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00010000:01000000:0.0:1788835150.809366:0:15274:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-osp-MDT0001: client import never connected 00000100:00080000:0.0:1788835150.809371:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788835150.809374:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 4294967298 gen 5 00000100:00100000:0.0:1788835150.809381:0:15274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788835150.809435:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788835150.809444:0:15274:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788835150.809471:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788835150.809474:0:15274:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788835150.809477:0:15274:0:(genops.c:885:class_export_put()) final put ffff9afdaf567800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:0.0:1788835150.809481:0:15274:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdaf567800/lustre-MDT0001-mdtlov_UUID for lustre-MDT0001-mdtlov 00000020:01000000:0.0:1788835150.809485:0:15274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-mdtlov (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:0.0:1788835150.809628:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1799 00000020:00000080:0.0:1788835150.809635:0:15274:0:(genops.c:885:class_export_put()) final put ffff9afdaf561800/lustre-MDD0001_UUID 00000020:01000000:0.0:1788835150.809640:0:15274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0001 (flags='') 00000020:00000080:0.0:1788835150.809644:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788835150.809659:0:15274:0:(obd_config.c:956:class_cleanup()) lustre-MDD0001: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1788835150.809669:0:15274:0:(genops.c:1558:class_disconnect_exports()) OBD device 12 (ffff9afdaf5599b8) has no exports 00000020:00000080:0.0:1788835150.809688:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788835150.809691:0:15274:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000020:00000080:0.0:1788835150.809695:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d17a0 00000020:00000080:0.0:1788835150.809699:0:15274:0:(genops.c:885:class_export_put()) final put ffff9afdaf564800/lustre-MDT0001-osd_UUID 00000020:01000004:0.0:1788835150.809707:0:15274:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afdb279f000 from lustre-MDT0001, refs=2 00000020:01000004:0.0:1788835150.809710:0:15274:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afdb279f000 2 00000020:01000004:0.0:1788835150.809713:0:15274:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9afdb279f000 from lustre-MDT0001 00000020:00000080:0.0:1788835150.809749:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788835150.809753:0:15274:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:00000080:0.0:1788835150.809764:0:15274:0:(genops.c:885:class_export_put()) final put ffff9afdaf560000/lustre-MDT0001_UUID 00000020:00000080:0.0:1788835150.809767:0:15274:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdaf560000/lustre-MDT0001_UUID for lustre-MDT0001 00000020:01000000:0.0:1788835150.809773:0:15274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001 (lustre-MDT0001_UUID) 00000020:01000004:0.0:1788835150.809804:0:15274:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000000:0.0:1788835150.809807:0:15274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0001 (flags='F') 00000020:00000080:0.0:1788835150.809810:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788835150.809814:0:15274:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788835150.809819:0:15274:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0001: ACTIVE ffff9afdaf455000 lustre-MDT0000-lwp-MDT0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788835150.809825:0:15274:0:(genops.c:1553:class_disconnect_exports()) OBD device 14 (ffff9afdb7158000) has exports, disconnecting them 00000020:00080000:0.0:1788835150.809829:0:15274:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0001: disconnecting export at 0@lo (ffff9afdaf455000), last request at 1788834913 00000020:00000080:0.0:1788835150.809833:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d17f4 00000020:00080000:0.0:1788835150.809845:0:15274:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9afdaf455000): rc 0 00000020:00000080:0.0:1788835150.809848:0:15274:0:(genops.c:885:class_export_put()) final put ffff9afdaf455000/lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788835150.810749:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afdc1217000 for lustre-MDT0000-osp-MDT0001 00000020:00000080:3.0:1788835150.810760:0:479:0:(genops.c:885:class_export_put()) final put ffff9afdb9275000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788835150.810763:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdb9275000/lustre-MDT0001-mdtlov_UUID for lustre-MDT0000-osp-MDT0001 00000020:01000000:3.0:1788835150.810778:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osp-MDT0001 (lustre-MDT0001-mdtlov_UUID) 00000020:00000080:3.0:1788835150.810883:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdaf561800/lustre-MDD0001_UUID for lustre-MDD0001 00000020:00000080:3.0:1788835150.810887:0:479:0:(genops.c:885:class_export_put()) final put ffff9afdaf561000/lustre-MDD0001_UUID 00000020:00000080:3.0:1788835150.810889:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdaf561000/lustre-MDD0001_UUID for lustre-MDD0001 00000020:01000000:3.0:1788835150.810892:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0001 (lustre-MDD0001_UUID) 00000020:00000080:3.0:1788835150.811040:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdaf564800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788835150.811044:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdaf455000/lustre-MDT0000-lwp-MDT0001 for lustre-MDT0000-lwp-MDT0001 00010000:01000000:1.0:1788835150.826289:0:15274:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0001: client import never connected 00000100:00080000:1.0:1788835150.826297:0:15274:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788835150.826302:0:15274:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1788835150.826309:0:15274:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1788835150.826629:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1788835150.826638:0:15274:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000004:1.0:1788835150.826781:0:15274:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afdb279f000 1 00000020:00000080:1.0:1788835150.826790:0:15274:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1730 00000020:00000080:1.0:1788835150.826799:0:15274:0:(genops.c:885:class_export_put()) final put ffff9afd9e82a800/lustre-MDT0001-osd_UUID 00000020:00000080:3.0:1788835150.826821:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afdaf454800 for lustre-MDT0000-lwp-MDT0001 00000020:00000080:3.0:1788835150.826829:0:479:0:(genops.c:885:class_export_put()) final put ffff9afdaf453800/lustre-MDT0000-lwp-MDT0001_UUID 00000020:00000080:3.0:1788835150.826832:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdaf453800/lustre-MDT0000-lwp-MDT0001_UUID for lustre-MDT0000-lwp-MDT0001 00000020:01000000:3.0:1788835150.826843:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0001 (lustre-MDT0000-lwp-MDT0001_UUID) 00000020:01000000:1.0:1788835150.827544:0:15274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-osd (flags='') 00000020:00000080:3.0:1788835150.827619:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afd9e82a800/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:00000080:3.0:1788835150.827634:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788835150.827640:0:15274:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788835150.827783:0:15274:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9afdb715b370) has no exports 00000020:00000080:0.0:1788835150.964061:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788835150.964074:0:15274:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00000020:00000080:0.0:1788835150.964080:0:15274:0:(genops.c:885:class_export_put()) final put ffff9afdb90e9000/lustre-MDT0001-osd_UUID 00000020:00000080:0.0:1788835150.964084:0:15274:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdb90e9000/lustre-MDT0001-osd_UUID for lustre-MDT0001-osd 00000020:01000000:0.0:1788835150.964095:0:15274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-osd (lustre-MDT0001-osd_UUID) 00000020:01000004:0.0:1788835150.964216:0:15274:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9afdb90e8800 00000020:01000000:0.0:1788835150.964237:0:15274:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1788835150.964241:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788835150.964245:0:15274:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788835150.964250:0:15274:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9afdab4b8000) has no exports 00000100:00100000:2.0:1788835150.964593:0:6487:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9afd84ecf400:6487] 0 exiting: rc = 1 00000100:00100000:2.0:1788835150.966549:0:6488:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9afd84ece000:6488] 1 exiting: rc = 0 00000100:00100000:0.0:1788835150.966821:0:9806:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff9afc826a0a00:9806] 4 exiting: rc = 0 00000100:00100000:3.0:1788835150.967001:0:6489:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9afd83336600:6489] 2 exiting: rc = 0 00000100:00100000:1.0:1788835150.967196:0:9047:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9afc82320400:9047] 3 exiting: rc = 0 00000100:00100000:0.0:1788835150.969154:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969164:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969170:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969175:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969181:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969186:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969192:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969209:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969215:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969220:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969226:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969232:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969237:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969496:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969503:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969508:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969514:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969519:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969524:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969528:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969534:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969539:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969544:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969549:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969562:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969567:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969572:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969578:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969583:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969588:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969593:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969598:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969603:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969745:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969753:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969758:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969763:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969768:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969774:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969780:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969786:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969792:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969803:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969808:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969813:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969818:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969824:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969829:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969834:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969840:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969845:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969850:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969855:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969860:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969864:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969869:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969874:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969880:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969885:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969890:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969895:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969900:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969904:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.969915:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.972998:0:6490:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9afdb2e85a00:6490] 0 exiting: rc = 1 00000100:00100000:0.0:1788835150.973156:0:6491:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9afd9133e800:6491] 1 exiting: rc = 0 00000100:00100000:1.0:1788835150.973257:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973266:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973271:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973277:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973282:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973288:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973294:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973298:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973304:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973309:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973481:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973489:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973495:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973500:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973505:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973509:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973514:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973519:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973525:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973530:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973536:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973542:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973546:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973551:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973556:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973561:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973566:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973571:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973576:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973581:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973587:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973593:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973598:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973628:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973633:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973638:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973643:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973649:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973655:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973660:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973800:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973807:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973813:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973818:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973824:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973829:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973834:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973840:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973846:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973851:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973857:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973863:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973869:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973874:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973879:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973884:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973889:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973895:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973900:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973906:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973911:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973916:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973922:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.973927:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835150.974456:0:6493:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9afd9133ee00:6493] 1 exiting: rc = 0 00000100:00100000:0.0:1788835150.974543:0:11555:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff9afc83380c00:11555] 2 exiting: rc = 0 00000100:00100000:0.0:1788835150.974621:0:6492:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9afdb7237400:6492] 0 exiting: rc = 1 00000100:00100000:1.0:1788835150.975121:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975149:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975158:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975163:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975181:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975186:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975192:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975198:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975205:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975212:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975219:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975237:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975244:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975249:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975255:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975261:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975267:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975273:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975280:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975285:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975290:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975295:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975301:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975570:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975579:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975586:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975592:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975599:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975605:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975622:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975629:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975636:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975644:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975650:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975657:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975690:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975698:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975703:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975710:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975733:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975739:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975746:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975751:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975757:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975762:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975768:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975779:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975802:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975809:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975815:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975821:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975827:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975833:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975839:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975845:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975852:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975858:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975870:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975877:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975899:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975907:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975913:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975919:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835150.975925:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835151.000954:0:6494:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9afdb7236600:6494] 0 exiting: rc = 1 00000100:00100000:2.0:1788835151.000998:0:6495:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9afd9133de00:6495] 1 exiting: rc = 0 00000100:00100000:0.0:1788835151.001093:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001100:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001106:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001111:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001117:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001122:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001126:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001131:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001151:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001156:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001161:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001166:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001171:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001177:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001182:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001188:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001193:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001197:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001202:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001207:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001212:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001216:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001222:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001227:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001232:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001238:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001242:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001248:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001253:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001258:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001263:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001268:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001273:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001277:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001283:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001288:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001293:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001298:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001303:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001308:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001678:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001688:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001693:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001706:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001711:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001727:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001733:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001738:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001743:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001748:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001753:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001757:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001762:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001768:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001773:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001778:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001783:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001789:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001794:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001799:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001804:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001809:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001814:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835151.001819:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.011963:0:6496:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9afdb7233a00:6496] 0 exiting: rc = 1 00000100:00100000:1.0:1788835151.012538:0:6497:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9afd9133d600:6497] 1 exiting: rc = 0 00000100:00100000:3.0:1788835151.012891:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.012898:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.012904:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.012908:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.012914:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.012919:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.012924:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.012929:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.012937:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.012942:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.012947:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.012952:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.012957:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.012976:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.012981:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.012987:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013855:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013859:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013864:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013869:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013874:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013878:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013883:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013888:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013893:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013898:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013903:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013908:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013913:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013918:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013923:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013927:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013931:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013936:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013940:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013945:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013949:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013955:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013961:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013966:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013972:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013977:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013982:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.013986:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.014002:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.014262:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.014271:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.014276:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.014295:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.014299:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.014304:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.014308:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.014312:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.014337:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.014341:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.014346:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.014351:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.014355:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.014360:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.014366:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.014371:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.014376:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.014381:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.014387:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835151.015170:0:6499:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9afdb71d3200:6499] 1 exiting: rc = 0 00000100:00100000:3.0:1788835151.015338:0:6498:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9afdb71d3800:6498] 0 exiting: rc = 1 00000100:00100000:3.0:1788835151.015390:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015397:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015402:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015406:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015411:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015416:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015421:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015426:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015431:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015437:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015442:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015447:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015452:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015456:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015462:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015467:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015472:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015476:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015493:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015498:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015503:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015507:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015512:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015517:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015521:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015525:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015530:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015534:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015539:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015543:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015548:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015553:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015557:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015562:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015567:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015572:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015578:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015583:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015587:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015593:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015598:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015602:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015607:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015612:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015618:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015622:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015627:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015631:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015636:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015641:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015645:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015650:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015656:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015668:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015673:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015678:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015684:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015688:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015693:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015698:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015702:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015707:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015711:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.015727:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.019679:0:6502:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9afdb71d3000:6502] 2 exiting: rc = 0 00000100:00100000:2.0:1788835151.019865:0:6501:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9afd9133a600:6501] 1 exiting: rc = 0 00000100:00100000:1.0:1788835151.020024:0:6500:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9afd9133b800:6500] 0 exiting: rc = 1 00000100:00100000:3.0:1788835151.020396:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020404:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020409:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020415:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020421:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020447:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020454:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020459:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020464:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020469:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020474:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020479:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020484:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020489:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020494:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020499:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020504:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020509:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020515:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020520:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020526:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020532:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020537:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020554:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020560:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020566:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020571:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020576:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020583:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020602:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020608:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020614:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020619:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020624:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020629:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020634:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020640:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020645:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020650:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020655:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020660:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020665:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020670:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020675:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020680:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020686:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020691:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020696:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020701:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020707:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020713:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020753:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020760:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020846:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020854:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020860:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020867:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020876:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020887:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020892:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020897:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020902:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020907:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835151.020912:0:15274:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788835151.031895:0:15274:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788835151.031908:0:15274:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1788835151.031914:0:15274:0:(genops.c:885:class_export_put()) final put ffff9afd84ea1000/MDS_uuid 00000020:00000080:3.0:1788835151.031919:0:15274:0:(genops.c:844:class_export_destroy()) destroying export ffff9afd84ea1000/MDS_uuid for MDS 00000020:01000000:3.0:1788835151.031929:0:15274:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1788835151.032114:0:15274:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0001 complete 00010000:00010000:2.0:1788835151.337910:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788835152.166572:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5f0122c5-c616-4176-9ca1-6fdce4068f64->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788835152.166580:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5f0122c5-c616-4176-9ca1-6fdce4068f64->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788835152.166583:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788835152.166587:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788835152.166590:0:479:0:(import.c:65:import_set_state_nolock()) ffff9afdb34c0000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788835152.166597:0:479:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 389 00000100:00080000:2.0:1788835152.166603:0:479:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788835152.166610:0:479:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9afdb34c0000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788835152.166654:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbf9b9180 x1875729254086912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788835152.166740:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875729254086912:0@lo:38:kworker.0 00000400:00000100:3.0:1788835152.166790:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875729254086912 offset 0 length 520: 4 00000100:00100000:3.0:1788835152.166897:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00080000:2.0:1788835152.166915:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788835152.166918:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1788835152.166920:0:479:0:(import.c:65:import_set_state_nolock()) ffff9afc82607800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788835152.166924:0:479:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 389 00000100:00080000:2.0:1788835152.166927:0:479:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 10s 00000100:00080000:2.0:1788835152.166931:0:479:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9afc82607800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788835152.166945:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbf9ba300 x1875729254087168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788835152.167057:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788835152.167067:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254087296:0@lo:400:kworker.0 00000400:00000100:1.0:1788835152.167090:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875729254087296 offset 0 length 224: 4 00000100:00100000:3.0:1788835152.167156:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254087040:0@lo:400:kworker.0 00000400:00000100:3.0:1788835152.167177:0:3614:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875729254087040 offset 0 length 224: 4 00000100:00100000:3.0:1788835152.167196:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875729254087168:0@lo:38:kworker.0 00000400:00000100:3.0:1788835152.167208:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875729254087168 offset 0 length 520: 4 00010000:00010000:2.0:1788835152.358701:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835153.384005:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835154.408246:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788835154.431233:0:15474:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:1.0:1788835154.455067:0:15474:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1788835154.455160:0:15474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63c00/0xdf60171e5a5d1b97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1b9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835154.455179:0:15474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63c00/0xdf60171e5a5d1b97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1b9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835154.455187:0:15474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63c00/0xdf60171e5a5d1b97 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1b9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835154.455195:0:15474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63c00/0xdf60171e5a5d1b97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1b9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835154.455224:0:15474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1788835154.455231:0:15474:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1788835154.455263:0:15474:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788835154.455277:0:15474:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afdbf9b9180 x1875729254086912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788835172 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835154.455304:0:15474:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788835154.455312:0:15474:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788835154.455339:0:15474:0:(import.c:65:import_set_state_nolock()) ffff9afdb34c0000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1788835154.455346:0:15474:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1788835154.455350:0:15474:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afdbf9b9180 x1875729254086912/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788835172 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835154.455359:0:15474:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788835154.455362:0:15474:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 24s for inflight to error out 00010000:00010000:2.0:1788835154.455432:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835154.455441:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63c00/0xdf60171e5a5d1b97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1b9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835154.455451:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e63c00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788835154.455462:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63c00/0xdf60171e5a5d1b97 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1b9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835154.455472:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63c00/0xdf60171e5a5d1b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf60171e5a5d1b9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788835154.455480:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63c00/0xdf60171e5a5d1b97 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf60171e5a5d1b9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835154.455486:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788835154.455489:0:6476:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1788835154.455492:0:6476:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1788835154.455509:0:6476:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9afd84ea2800 00010000:00010000:2.0:1788835154.455514:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63c00/0xdf60171e5a5d1b97 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf60171e5a5d1b9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835154.455522:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63c00/0xdf60171e5a5d1b97 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf60171e5a5d1b9e expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835154.455534:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835154.455536:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835154.455537:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835154.455778:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875729254086912:0@lo:38:kworker.0 00000100:00080000:1.0:1788835154.456790:0:15474:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788835154.456803:0:15474:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afdbf9b8a80 x1875729254087040/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835168 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835154.456827:0:15474:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1788835154.456849:0:15474:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000100:00080000:1.0:1788835154.456876:0:15474:0:(import.c:65:import_set_state_nolock()) ffff9afdba066000 lustre-MDT0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1788835154.457043:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254087040:0@lo:400:kworker.0 00000100:00100000:0.0:1788835154.457167:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875729254087424:0@lo:39:umount.0 00000400:00000100:0.0:1788835154.457233:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875729254087424 offset 0 length 224: 4 00000100:00080000:2.0:1788835155.173493:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5f0122c5-c616-4176-9ca1-6fdce4068f64->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788835155.173508:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5f0122c5-c616-4176-9ca1-6fdce4068f64->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788835155.173511:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788835155.173515:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788835155.173786:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254087552:0@lo:400:kworker.0 00000400:00000100:1.0:1788835155.173869:0:3617:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875729254087552 offset 0 length 224: 4 00010000:00010000:2.0:1788835155.430538:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1788835155.751377:0:8398:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:1.0:1788835155.751391:0:8398:0:(genops.c:885:class_export_put()) final put ffff9afc820d1000/lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788835155.751485:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc820d1000/lustre-MDT0001-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1788835155.751558:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afc820d7800 for lustre-OST0000 00000001:00100000:2.0:1788835155.756225:0:9481:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000020:00000080:2.0:1788835155.756239:0:9481:0:(genops.c:885:class_export_put()) final put ffff9afc8346d800/lustre-MDT0001-mdtlov_UUID 00000020:00000080:3.0:1788835155.756480:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc8346d800/lustre-MDT0001-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1788835155.756742:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afc83468800 for lustre-OST0001 00010000:00010000:2.0:1788835156.453636:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1788835157.221937:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5f0122c5-c616-4176-9ca1-6fdce4068f64->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788835157.221950:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5f0122c5-c616-4176-9ca1-6fdce4068f64->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788835157.221953:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1788835157.221957:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788835157.222195:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788835157.222224:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875729254087680:0@lo:400:kworker.0 00000400:00000100:1.0:1788835157.222298:0:3615:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875729254087680 offset 0 length 224: 4 00010000:00010000:2.0:1788835157.480204:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835158.503502:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835159.525995:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835160.549833:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835160.613854:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788835150/real 1788835150] req@ffff9afd9e817480 x1875729254086784/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788835160 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835160.613923:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9afd9e817480 x1875729254086784/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1788835160 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788835160.613951:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afd84ea2800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788835160.613984:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:0.0:1788835160.613989:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5f0122c5-c616-4176-9ca1-6fdce4068f64:3613:1875729254086784:0@lo:250:ptlrpcd_00_02.0 00000100:00080000:3.0:1788835160.617271:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5f0122c5-c616-4176-9ca1-6fdce4068f64->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788835160.617286:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1788835160.617292:0:479:0:(import.c:65:import_set_state_nolock()) ffff9afd84ea2800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788835160.617303:0:479:0:(import.c:510:import_select_connection()) MGC192.168.203.122@tcp: connect to NID 0@lo last attempt 392 00000100:00080000:3.0:1788835160.617310:0:479:0:(import.c:589:import_select_connection()) MGC192.168.203.122@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788835160.617347:0:479:0:(import.c:624:import_select_connection()) MGC192.168.203.122@tcp: import ffff9afd84ea2800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788835160.617401:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afd9e815f80 x1875729254087808/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788835160.617457:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1788835160.617462:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788835160.617584:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5f0122c5-c616-4176-9ca1-6fdce4068f64:3613:1875729254087808:0@lo:250:kworker.0 00000400:00000100:0.0:1788835160.617667:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1875729254087808 offset 0 length 520: 4 00000100:00100000:1.0:1788835160.617902:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875729254087936:0@lo:400:kworker.0 00000400:00000100:1.0:1788835160.617937:0:3615:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875729254087936 offset 0 length 224: 4 00010000:00010000:2.0:1788835161.575444:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835162.597694:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835163.621537:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835164.647643:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835164.711568:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788835154/real 1788835154] req@ffff9afdbfb92300 x1875729254087424/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788835164 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835164.711610:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9afdbfb92300 x1875729254087424/t0(0) o39->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788835164 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788835164.711646:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdba066000 lustre-MDT0001_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1788835164.711669:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875729254087424:0@lo:39:umount.0 00000100:00080000:1.0:1788835164.712573:0:15474:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:1.0:1788835164.712581:0:15474:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1788835164.712589:0:15474:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1788835164.713581:0:15474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031800/0xdf60171e5a5d1ba5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1bac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835164.713601:0:15474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031800/0xdf60171e5a5d1ba5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1bac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835164.713609:0:15474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031800/0xdf60171e5a5d1ba5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1bac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835164.713617:0:15474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9afd80031800/0xdf60171e5a5d1ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1bac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835164.713653:0:15474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788835164.713682:0:15474:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1dff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1e06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835164.713689:0:15474:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1dff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1e06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835164.713696:0:15474:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1dff lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1e06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835164.713702:0:15474:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1dff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1e06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835164.713731:0:15474:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1788835164.713737:0:15474:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1788835164.713770:0:15474:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1788835164.713777:0:15474:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1788835164.713782:0:15474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1788835164.713789:0:15474:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1788835164.713794:0:15474:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9afc820cb370) has no exports 00010000:00010000:2.0:1788835164.713815:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788835164.713825:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd80031800/0xdf60171e5a5d1ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1bac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1788835164.713825:0:15474:0:(genops.c:1558:class_disconnect_exports()) OBD device 18 (ffff9afc820cb370) has no exports 00010000:00010000:2.0:1788835164.713832:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80031800 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788835164.713837:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd80031800/0xdf60171e5a5d1ba5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1bac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835164.713847:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd80031800/0xdf60171e5a5d1ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf60171e5a5d1bac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788835164.713855:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd80031800/0xdf60171e5a5d1ba5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf60171e5a5d1bac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835164.713862:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1788835164.713864:0:7429:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:2.0:1788835164.713866:0:7429:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:2.0:1788835164.713882:0:7429:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9afd84ea2800 00010000:00010000:2.0:1788835164.713893:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd80031800/0xdf60171e5a5d1ba5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf60171e5a5d1bac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835164.713900:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd80031800/0xdf60171e5a5d1ba5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf60171e5a5d1bac expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835164.713917:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835164.713920:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1dff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1e06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835164.713926:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e62200 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788835164.713928:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1dff lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1e06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835164.713935:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1dff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf60171e5a5d1e06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788835164.713942:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1dff lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf60171e5a5d1e06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835164.714082:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788835164.714084:0:7429:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788835164.714086:0:7429:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788835164.714092:0:7429:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9afd84ea2800 00010000:00010000:2.0:1788835164.714095:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1dff lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf60171e5a5d1e06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835164.714102:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62200/0xdf60171e5a5d1dff lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf60171e5a5d1e06 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835164.714111:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835164.714118:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835164.714120:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788835164.715517:0:15474:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9afdc131a000 - data ffff9afda5f45a20/ffff9afc83c44000 00010000:00010000:3.0:1788835164.715775:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1788835164.716826:0:15474:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9afc822f52a0 - data ffff9afda5d6b798/ffff9afc820dac00 00100000:10000000:1.0:1788835164.723591:0:15474:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1788835164.748120:0:15474:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d18cd 00000020:00000080:3.0:1788835164.748140:0:15474:0:(genops.c:885:class_export_put()) final put ffff9afc820d5000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1788835164.748167:0:15474:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afdba102000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1788835164.748171:0:15474:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afdba102000 2 00000020:01000004:3.0:1788835164.748175:0:15474:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9afdba102000 from lustre-OST0000 00000020:00000080:3.0:1788835164.748211:0:15474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788835164.748211:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc820d5000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1788835164.748226:0:15474:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1788835164.748232:0:15474:0:(genops.c:885:class_export_put()) final put ffff9afc820d6800/lustre-OST0000_UUID 00000020:00000080:3.0:1788835164.748236:0:15474:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc820d6800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1788835164.748246:0:15474:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1788835164.748385:0:15474:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1788835164.748391:0:15474:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1788835164.748396:0:15474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788835164.748402:0:15474:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1788835164.748411:0:15474:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9afdbf90c000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1788835164.748417:0:15474:0:(genops.c:1553:class_disconnect_exports()) OBD device 19 (ffff9afc823719b8) has exports, disconnecting them 00000020:00080000:3.0:1788835164.748423:0:15474:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9afdbf90c000), last request at 1788834933 00000020:00000080:3.0:1788835164.748428:0:15474:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d18f7 00000020:00080000:3.0:1788835164.748440:0:15474:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9afdbf90c000): rc 0 00000020:00000080:3.0:1788835164.748447:0:15474:0:(genops.c:885:class_export_put()) final put ffff9afdbf90c000/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788835164.748489:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdbf90c000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1788835164.750169:0:15474:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1788835164.750178:0:15474:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788835164.750183:0:15474:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788835164.750190:0:15474:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788835164.750282:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afdb34c0000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1788835164.750452:0:15474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788835164.750464:0:15474:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:2.0:1788835164.750470:0:15474:0:(genops.c:885:class_export_put()) final put ffff9afdbf90f000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:2.0:1788835164.750474:0:15474:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdbf90f000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:2.0:1788835164.750480:0:15474:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000000:2.0:1788835164.750549:0:15474:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1788835164.750553:0:15474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788835164.750558:0:15474:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788835164.750565:0:15474:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0000: ACTIVE ffff9afdb34c4800 lustre-MDT0001-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788835164.750571:0:15474:0:(genops.c:1553:class_disconnect_exports()) OBD device 20 (ffff9afc82374d28) has exports, disconnecting them 00000020:00080000:2.0:1788835164.750575:0:15474:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0000: disconnecting export at 0@lo (ffff9afdb34c4800), last request at 1788834933 00000020:00000080:2.0:1788835164.750579:0:15474:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d190c 00000020:00080000:2.0:1788835164.750593:0:15474:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9afdb34c4800): rc 0 00000020:00000080:2.0:1788835164.750598:0:15474:0:(genops.c:885:class_export_put()) final put ffff9afdb34c4800/lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788835164.751304:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdb34c4800/lustre-MDT0001-lwp-OST0000 for lustre-MDT0001-lwp-OST0000 00010000:01000000:0.0:1788835164.759931:0:15474:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0000: client import never connected 00000100:00080000:0.0:1788835164.759944:0:15474:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788835164.759958:0:15474:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1788835164.759968:0:15474:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1788835164.760012:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afdba066000 for lustre-MDT0001-lwp-OST0000 00000020:00000080:0.0:1788835164.760269:0:15474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788835164.760282:0:15474:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000020:00000080:0.0:1788835164.760289:0:15474:0:(genops.c:885:class_export_put()) final put ffff9afdbf90d000/lustre-MDT0001-lwp-OST0000_UUID 00000020:00000080:0.0:1788835164.760311:0:15474:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdbf90d000/lustre-MDT0001-lwp-OST0000_UUID for lustre-MDT0001-lwp-OST0000 00000020:01000000:0.0:1788835164.760341:0:15474:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0000 (lustre-MDT0001-lwp-OST0000_UUID) 00000020:01000004:0.0:1788835164.760428:0:15474:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afdba102000 1 00000020:00000080:0.0:1788835164.760436:0:15474:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1895 00000020:00000080:0.0:1788835164.760444:0:15474:0:(genops.c:885:class_export_put()) final put ffff9afdba231800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1788835164.760454:0:15474:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1788835164.760462:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdba231800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1788835164.760481:0:15474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788835164.760487:0:15474:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788835164.760491:0:15474:0:(genops.c:1558:class_disconnect_exports()) OBD device 16 (ffff9afdaf55cd28) has no exports 00000020:00000080:3.0:1788835164.884833:0:15474:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788835164.884851:0:15474:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1788835164.884859:0:15474:0:(genops.c:885:class_export_put()) final put ffff9afdba101000/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1788835164.884865:0:15474:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdba101000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1788835164.884886:0:15474:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1788835164.885060:0:15474:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9afdba105800 00000020:02000400:3.0:1788835164.885192:0:15474:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1788835165.672427:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788835165.989640:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5f0122c5-c616-4176-9ca1-6fdce4068f64->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788835165.989652:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5f0122c5-c616-4176-9ca1-6fdce4068f64->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788835165.989656:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1788835165.989660:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788835165.990030:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254088064:0@lo:400:kworker.0 00000400:00000100:2.0:1788835165.990104:0:3616:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875729254088064 offset 0 length 224: 4 00010000:00010000:2.0:1788835166.697710:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835167.717529:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00000400:0.0:1788835168.549420:0:3617:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788835152/real 1788835152] req@ffff9afdbf9bb480 x1875729254087296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788835168 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835168.585201:0:3617:0:(client.c:2547:ptlrpc_expire_one_request()) @@@ TIMEOUT-NORESEND: req@ffff9afdbf9bb480 x1875729254087296/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1788835168 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788835168.585218:0:3617:0:(import.c:65:import_set_state_nolock()) ffff9afc8346e000 lustre-MDT0001_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1788835168.585223:0:3617:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0001-lwp-OST0001: Connection to lustre-MDT0001 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1788835168.604731:0:3617:0:(import.c:418:ptlrpc_pinger_force()) lustre-MDT0001_UUID: waking up pinger s:DISCONN 00000100:00080000:1.0:1788835168.605094:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) 5f0122c5-c616-4176-9ca1-6fdce4068f64->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788835168.605101:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) 5f0122c5-c616-4176-9ca1-6fdce4068f64->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788835168.605105:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788835168.605108:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788835168.605110:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1788835168.605137:0:479:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788835168.605141:0:479:0:(import.c:65:import_set_state_nolock()) ffff9afc8346e000 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788835168.605151:0:479:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 197 00000100:00080000:1.0:1788835168.605161:0:479:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9afc8346e000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788835168.605214:0:479:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbfb90700 x1875729254088192/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788835168.605286:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254087296:0@lo:400:kworker.0 00000100:00100000:3.0:1788835168.605577:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875729254088192:0@lo:38:kworker.0 00000400:00000100:3.0:1788835168.605661:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1875729254088192 offset 0 length 520: 4 00010000:00010000:2.0:1788835168.741819:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788835168.824903:0:15676:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:0.0:1788835168.845968:0:15676:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1788835168.846085:0:15676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63600/0xdf60171e5a5d1b6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1b74 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835168.846103:0:15676:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63600/0xdf60171e5a5d1b6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1b74 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835168.846112:0:15676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63600/0xdf60171e5a5d1b6d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1b74 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835168.846119:0:15676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63600/0xdf60171e5a5d1b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1b74 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835168.846165:0:15676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788835168.846172:0:15676:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1788835168.846203:0:15676:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788835168.846219:0:15676:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afdbf9ba300 x1875729254087168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788835172 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835168.846239:0:15676:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788835168.846247:0:15676:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1788835168.846254:0:15676:0:(import.c:65:import_set_state_nolock()) ffff9afc82607800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1788835168.846261:0:15676:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1788835168.846265:0:15676:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afdbf9ba300 x1875729254087168/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788835172 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835168.846272:0:15676:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788835168.846275:0:15676:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 5s for inflight to error out 00010000:00010000:0.0:1788835168.846302:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835168.846308:0:7429:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63600/0xdf60171e5a5d1b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1b74 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835168.846338:0:7429:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e63600 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:0.0:1788835168.846342:0:7429:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63600/0xdf60171e5a5d1b6d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1b74 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835168.846351:0:7429:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63600/0xdf60171e5a5d1b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf60171e5a5d1b74 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788835168.846358:0:7429:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63600/0xdf60171e5a5d1b6d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf60171e5a5d1b74 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788835168.846364:0:7429:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788835168.846374:0:7429:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1788835168.846376:0:7429:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1788835168.846394:0:7429:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9afd84ea2800 00010000:00010000:0.0:1788835168.846398:0:7429:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63600/0xdf60171e5a5d1b6d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf60171e5a5d1b74 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835168.846405:0:7429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e63600/0xdf60171e5a5d1b6d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf60171e5a5d1b74 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835168.846417:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835168.846419:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835168.846420:0:7429:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835168.846465:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875729254087168:0@lo:38:kworker.0 00000100:00080000:0.0:1788835168.847418:0:15676:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788835168.847429:0:15676:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afdbf9b8a80 x1875729254087552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835171 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835168.847458:0:15676:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afdbfa2ea00 x1875729254087680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835173 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835168.847472:0:15676:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afd9e814a80 x1875729254087936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835176 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835168.847479:0:15676:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afdbf9ba680 x1875729254088064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835181 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835168.847493:0:15676:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afdbfb90700 x1875729254088192/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1788835178 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835168.847504:0:15676:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1788835168.847540:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc8346e000 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788835168.847545:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-5) 00000100:00100000:0.0:1788835168.847550:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875729254088192:0@lo:38:kworker.0 00000100:00080000:0.0:1788835168.847587:0:15676:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:0.0:1788835168.847591:0:15676:0:(import.c:65:import_set_state_nolock()) ffff9afc8346e000 lustre-MDT0001_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:0.0:1788835168.847608:0:15676:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:0.0:1788835168.847613:0:15676:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afdbf9b8a80 x1875729254087552/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835171 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835168.847622:0:15676:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afdbfa2ea00 x1875729254087680/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835173 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835168.847630:0:15676:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afd9e814a80 x1875729254087936/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835176 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835168.847636:0:15676:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afdbf9ba680 x1875729254088064/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835181 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835168.847644:0:15676:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1788835168.847647:0:15676:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00000100:00100000:0.0:1788835168.848169:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254087552:0@lo:400:kworker.0 00000100:00100000:0.0:1788835168.848229:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875729254087936:0@lo:400:kworker.0 00000100:00100000:0.0:1788835168.848239:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0001_UUID:3615:1875729254087680:0@lo:400:kworker.0 00000100:00100000:0.0:1788835168.850091:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ba680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254088064:0@lo:400:kworker.0 00010000:00010000:0.0:1788835168.854903:0:15676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1b7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1b82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835168.854928:0:15676:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1b7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1b82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835168.854937:0:15676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1b7b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1b82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835168.854967:0:15676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1b82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835168.855055:0:15676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788835168.855074:0:15676:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1df1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d1df8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835168.855082:0:15676:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1df1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d1df8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835168.855088:0:15676:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1df1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1df8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835168.855096:0:15676:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1df1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xdf60171e5a5d1df8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835168.855466:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1788835168.855477:0:6476:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1b82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835168.855485:0:6476:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e62600 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:3.0:1788835168.855490:0:6476:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1b7b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1b82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835168.855500:0:6476:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf60171e5a5d1b82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1788835168.855507:0:6476:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1b7b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf60171e5a5d1b82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788835168.855513:0:6476:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1788835168.855516:0:6476:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:3.0:1788835168.855531:0:6476:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9afd84ea2800 00010000:00010000:3.0:1788835168.855536:0:6476:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1b7b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf60171e5a5d1b82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835168.855552:0:6476:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62600/0xdf60171e5a5d1b7b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf60171e5a5d1b82 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835168.855838:0:15676:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1788835168.855845:0:15676:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:0.0:1788835168.855850:0:15676:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1788835168.855887:0:15676:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1788835168.855891:0:15676:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1788835168.855900:0:15676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788835168.855906:0:15676:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1788835168.855911:0:15676:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9afc82373370) has no exports 00000020:00080000:0.0:1788835168.855939:0:15676:0:(genops.c:1558:class_disconnect_exports()) OBD device 24 (ffff9afc82373370) has no exports 00010000:00010000:2.0:1788835168.856440:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835168.856449:0:6477:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1df1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1df8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835168.856458:0:6477:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e62400 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788835168.856461:0:6477:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1df1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xdf60171e5a5d1df8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835168.856470:0:6477:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1df1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf60171e5a5d1df8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788835168.856477:0:6477:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1df1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf60171e5a5d1df8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835168.856484:0:6477:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1788835168.856486:0:6477:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1788835168.856488:0:6477:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1788835168.856501:0:6477:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9afd84ea2800 00010000:00010000:2.0:1788835168.856504:0:6477:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1df1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf60171e5a5d1df8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835168.856512:0:6477:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e62400/0xdf60171e5a5d1df1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf60171e5a5d1df8 expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835168.856528:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835168.856530:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835168.856532:0:6477:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835168.858187:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835168.858196:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835168.858199:0:6476:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1788835168.859944:0:15676:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9afc822f50c0 - data ffff9afda5f7b000/ffff9afdbf9e9400 00000020:01000000:0.0:1788835168.860220:0:15676:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9afc834e9f00 - data ffff9afda5f61e58/ffff9afc83461400 00100000:10000000:0.0:1788835168.878093:0:15676:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1788835168.891674:0:15676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d19f3 00000020:00000080:0.0:1788835168.891704:0:15676:0:(genops.c:885:class_export_put()) final put ffff9afc8311e000/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1788835168.891718:0:15676:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afc82611000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1788835168.891722:0:15676:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afc82611000 2 00000020:01000004:0.0:1788835168.891726:0:15676:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9afc82611000 from lustre-OST0001 00000020:00000080:0.0:1788835168.891757:0:15676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788835168.891771:0:15676:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1788835168.891774:0:15676:0:(genops.c:885:class_export_put()) final put ffff9afc8311b800/lustre-OST0001_UUID 00000020:00000080:0.0:1788835168.891777:0:15676:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc8311b800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1788835168.891785:0:15676:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1788835168.891944:0:15676:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 5f0122c5-c616-4176-9ca1-6fdce4068f64->MGS 00010000:00010000:0.0:1788835168.891966:0:15676:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd866f4200/0xdf60171e5a5d174c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf60171e5a5d1753 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788835168.891980:0:15676:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f4200/0xdf60171e5a5d174c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf60171e5a5d1753 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788835168.891987:0:15676:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1788835168.891991:0:15676:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1788835168.891995:0:15676:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1788835168.892014:0:15676:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9afd84ea2800 00010000:00010000:0.0:1788835168.892018:0:15676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd866f4200/0xdf60171e5a5d174c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf60171e5a5d1753 expref: -99 pid: 7416 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835168.892036:0:15676:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd80030400/0xdf60171e5a5d1c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xdf60171e5a5d1c1c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788835168.892044:0:15676:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd80030400/0xdf60171e5a5d1c15 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xdf60171e5a5d1c1c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788835168.892049:0:15676:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1788835168.892051:0:15676:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1788835168.892053:0:15676:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1788835168.892073:0:15676:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9afd84ea2800 00010000:00010000:0.0:1788835168.892077:0:15676:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd80030400/0xdf60171e5a5d1c15 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xdf60171e5a5d1c1c expref: -99 pid: 6485 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1788835168.892098:0:15676:0:(import.c:65:import_set_state_nolock()) ffff9afd84ea2800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1788835168.892103:0:15676:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1788835168.892105:0:15676:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1788835168.892107:0:15676:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1788835168.892112:0:15676:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1788835168.892126:0:15676:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9afd9e815f80 x1875729254087808/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1788835175 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1788835168.892155:0:15676:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788835168.892164:0:15676:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1788835168.892573:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:5f0122c5-c616-4176-9ca1-6fdce4068f64:3613:1875729254087808:0@lo:250:kworker.0 10000000:01000000:0.0:1788835168.892912:0:15676:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788835168.892923:0:15676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1649 00000020:00000080:0.0:1788835168.892931:0:15676:0:(genops.c:885:class_export_put()) final put ffff9afd84ea3800/5f0122c5-c616-4176-9ca1-6fdce4068f64 00000020:01000000:0.0:1788835168.892940:0:15676:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.122@tcp (flags='') 00000020:00000080:0.0:1788835168.892947:0:15676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788835168.892953:0:15676:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.122@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1788835168.892957:0:15676:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9afdab4bb370) has no exports 00000020:00000080:2.0:1788835168.893049:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc8311e000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1788835168.893066:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afd84ea3800/5f0122c5-c616-4176-9ca1-6fdce4068f64 for MGC192.168.203.122@tcp 10000000:01000000:3.0:1788835168.897606:0:6485:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1788835168.898398:0:15676:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.122@tcp: client import never connected 00000100:00080000:0.0:1788835168.898409:0:15676:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1788835168.898414:0:15676:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1788835168.898431:0:15676:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1788835168.898435:0:15676:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1788835168.898521:0:15676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1788835168.898534:0:15676:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.122@tcp (uuid 5f0122c5-c616-4176-9ca1-6fdce4068f64) 00000020:01000000:0.0:1788835168.898552:0:15676:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1788835168.898561:0:15676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1788835168.898568:0:15676:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1788835168.898578:0:15676:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9afc82606800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1788835168.898587:0:15676:0:(genops.c:1553:class_disconnect_exports()) OBD device 25 (ffff9afdbf938000) has exports, disconnecting them 00000020:00080000:0.0:1788835168.898622:0:15676:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9afc82606800), last request at 1788834955 00000020:00000080:0.0:1788835168.898629:0:15676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1a1d 00000020:00000080:3.0:1788835168.898643:0:479:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afd84ea2800 for MGC192.168.203.122@tcp 00000020:00080000:0.0:1788835168.898653:0:15676:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9afc82606800): rc 0 00000020:00000080:3.0:1788835168.898659:0:479:0:(genops.c:885:class_export_put()) final put ffff9afd84ea0000/5f0122c5-c616-4176-9ca1-6fdce4068f64 00000020:00000080:0.0:1788835168.898661:0:15676:0:(genops.c:885:class_export_put()) final put ffff9afc82606800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788835168.898669:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afd84ea0000/5f0122c5-c616-4176-9ca1-6fdce4068f64 for MGC192.168.203.122@tcp 00000020:01000000:3.0:1788835168.898684:0:479:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.122@tcp (5f0122c5-c616-4176-9ca1-6fdce4068f64) 00000020:00000080:3.0:1788835168.899551:0:479:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc82606800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1788835168.914729:0:15676:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1788835168.914742:0:15676:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1788835168.914748:0:15676:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1788835168.914756:0:15676:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1788835168.915013:0:15676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788835168.915025:0:15676:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000000:2.0:1788835168.915040:0:15676:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0001-lwp-OST0001 (flags='F') 00000020:00000080:2.0:1788835168.915049:0:15676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788835168.915054:0:15676:0:(obd_config.c:956:class_cleanup()) lustre-MDT0001-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1788835168.915065:0:15676:0:(genops.c:1819:print_export_data()) lustre-MDT0001-lwp-OST0001: ACTIVE ffff9afc8346e800 lustre-MDT0001-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1788835168.915074:0:15676:0:(genops.c:1553:class_disconnect_exports()) OBD device 26 (ffff9afdbf9399b8) has exports, disconnecting them 00000020:00080000:2.0:1788835168.915080:0:15676:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0001-lwp-OST0001: disconnecting export at 0@lo (ffff9afc8346e800), last request at 1788834955 00000020:00000080:2.0:1788835168.915085:0:15676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d1a32 00000020:00080000:2.0:1788835168.915106:0:15676:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9afc8346e800): rc 0 00000020:00000080:2.0:1788835168.915114:0:15676:0:(genops.c:885:class_export_put()) final put ffff9afc8346e800/lustre-MDT0001-lwp-OST0001 00000020:00000080:3.0:1788835168.915452:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afc82607800 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1788835168.915472:0:8:0:(genops.c:885:class_export_put()) final put ffff9afc82606000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1788835168.915476:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc82606000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1788835168.915486:0:8:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1788835168.915563:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc8346e800/lustre-MDT0001-lwp-OST0001 for lustre-MDT0001-lwp-OST0001 00010000:01000000:3.0:1788835168.916511:0:15676:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0001-lwp-OST0001: client import never connected 00000100:00080000:3.0:1788835168.916517:0:15676:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0001_UUID INVALID 00000100:00100000:3.0:1788835168.916522:0:15676:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:3.0:1788835168.916528:0:15676:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1788835168.916552:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9afc8346e000 for lustre-MDT0001-lwp-OST0001 00010000:00010000:0.0:1788835168.919545:0:7429:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1788835168.919843:0:6477:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:3.0:1788835168.977455:0:6476:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:3.0:1788835168.977711:0:6471:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9afd873c7a00:6471] 0 exiting: rc = 1 00000100:00100000:3.0:1788835168.977790:0:7440:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff9afdaf504600:7440] 2 exiting: rc = 0 00000100:00100000:0.0:1788835168.981014:0:6472:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9afd873c7000:6472] 1 exiting: rc = 0 00000100:00100000:3.0:1788835168.981589:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.981966:0:6474:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9afd85564a00:6474] 1 exiting: rc = 0 00000100:00100000:0.0:1788835168.983789:0:7430:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9afdb92d8200:7430] 3 exiting: rc = 0 00000100:00100000:0.0:1788835168.983900:0:6473:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9afd85564200:6473] 0 exiting: rc = 1 00000100:00100000:0.0:1788835168.983969:0:6475:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9afd8b6e2c00:6475] 2 exiting: rc = 0 00000100:00100000:0.0:1788835168.984120:0:9491:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9afc83051400:9491] 4 exiting: rc = 0 00000100:00100000:3.0:1788835168.984365:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984376:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984386:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984393:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984400:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984406:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984428:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984434:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984440:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984446:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984452:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984458:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984466:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984473:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984480:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984485:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984491:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984498:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984505:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984513:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984519:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984524:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984530:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984536:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984542:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984548:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984554:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984560:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984567:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984577:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984582:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984589:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984605:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984611:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984616:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984622:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984627:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984632:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984638:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984643:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984649:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984662:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984667:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984673:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984678:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984688:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984693:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984699:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984705:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984710:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984716:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984725:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984732:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984738:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984744:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984750:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984758:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984764:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984770:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984776:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984782:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984791:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984797:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835168.984802:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1788835168.986084:0:15676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1788835168.986098:0:15676:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000020:00000080:3.0:1788835168.986105:0:15676:0:(genops.c:885:class_export_put()) final put ffff9afc82604800/lustre-MDT0001-lwp-OST0001_UUID 00000020:00000080:3.0:1788835168.986110:0:15676:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc82604800/lustre-MDT0001-lwp-OST0001_UUID for lustre-MDT0001-lwp-OST0001 00000020:01000000:3.0:1788835168.986117:0:15676:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0001-lwp-OST0001 (lustre-MDT0001-lwp-OST0001_UUID) 00000020:01000004:3.0:1788835168.986183:0:15676:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afc82611000 1 00000020:00000080:3.0:1788835168.986190:0:15676:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0xdf60171e5a5d19c2 00000020:00000080:3.0:1788835168.986203:0:15676:0:(genops.c:885:class_export_put()) final put ffff9afc82616800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1788835168.986222:0:15676:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1788835168.986237:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc82616800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1788835168.986253:0:15676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1788835168.986275:0:15676:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1788835168.986280:0:15676:0:(genops.c:1558:class_disconnect_exports()) OBD device 23 (ffff9afdab4f4d28) has no exports 00000020:00000080:2.0:1788835169.119640:0:15676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788835169.119659:0:15676:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1788835169.119667:0:15676:0:(genops.c:885:class_export_put()) final put ffff9afc82617000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1788835169.119673:0:15676:0:(genops.c:844:class_export_destroy()) destroying export ffff9afc82617000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1788835169.119684:0:15676:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1788835169.120098:0:15676:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9afc82610000 00000020:01000000:2.0:1788835169.120127:0:15676:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1788835169.120132:0:15676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1788835169.120138:0:15676:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1788835169.120143:0:15676:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9afdb715cd28) has no exports 00000020:00000080:2.0:1788835169.120167:0:15676:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1788835169.120173:0:15676:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1788835169.120176:0:15676:0:(genops.c:885:class_export_put()) final put ffff9afdba234800/OSS_uuid 00000020:00000080:2.0:1788835169.120191:0:15676:0:(genops.c:844:class_export_destroy()) destroying export ffff9afdba234800/OSS_uuid for OSS 00000020:01000000:2.0:1788835169.120196:0:15676:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1788835169.120293:0:8403:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9afdb92aee00:8403] 1 exiting: rc = 0 00000100:00100000:2.0:1788835169.120434:0:9814:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9afc83075a00:9814] 3 exiting: rc = 0 00000100:00100000:2.0:1788835169.120569:0:8405:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9afd83f12800:8405] 2 exiting: rc = 0 00000100:00080000:0.0:1788835169.120796:0:6484:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1788835169.120934:0:8402:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9afdb92d0c00:8402] 0 exiting: rc = 1 00000100:00100000:2.0:1788835169.121083:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121092:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121100:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121106:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121113:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121118:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121124:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121134:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121140:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121146:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121152:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121158:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121163:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121169:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121175:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121181:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121188:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121193:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121199:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121208:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121214:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121219:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121225:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121231:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121236:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121241:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121247:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121252:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121258:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121275:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121281:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121287:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121293:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121298:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121304:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121310:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121613:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121619:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121625:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121631:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121636:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121642:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121648:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121653:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121659:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121665:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121671:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121677:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121683:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121688:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121693:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121699:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121705:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121710:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121715:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121721:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121727:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121732:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121739:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121746:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121752:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121758:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121764:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.121778:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835169.126373:0:8406:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9afdba33e800:8406] 0 exiting: rc = 1 00000100:00100000:1.0:1788835169.126488:0:13371:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_002: service thread [ffff9afc826a1800:13371] 2 exiting: rc = 0 00000100:00100000:1.0:1788835169.126574:0:8407:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9afdba33f600:8407] 1 exiting: rc = 0 00000100:00100000:2.0:1788835169.126757:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126773:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126794:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126801:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126806:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126812:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126817:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126823:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126828:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126833:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126839:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126844:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126857:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126865:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126870:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126876:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126882:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126887:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126893:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126898:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126904:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126910:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126915:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126922:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126927:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126933:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126938:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126944:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126951:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126960:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126974:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126984:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.126990:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127000:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127007:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127034:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127039:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127045:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127050:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127055:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127061:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127067:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127072:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127078:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127087:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127094:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127100:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127106:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127111:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127117:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127124:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127130:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127134:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127140:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127146:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127151:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127162:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127170:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127175:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127180:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127185:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127191:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127196:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1788835169.127206:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1788835169.130710:0:8410:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9afdba124200:8410] 2 exiting: rc = 0 00000100:00100000:0.0:1788835169.130847:0:8409:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9afdc15d9000:8409] 1 exiting: rc = 0 00000100:00100000:2.0:1788835169.131989:0:8408:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9afdc15d9c00:8408] 0 exiting: rc = 1 00000100:00100000:0.0:1788835169.138945:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.138957:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.138962:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.138968:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.138973:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.138986:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.138993:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139000:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139005:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139011:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139018:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139024:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139029:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139035:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139041:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139046:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139052:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139057:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139064:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139088:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139094:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139099:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139122:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139129:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139137:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139143:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139149:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139154:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139160:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139166:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139172:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139178:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139184:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139189:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139195:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139201:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139206:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139212:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139218:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139225:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139230:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139236:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139242:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139247:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139253:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139259:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139279:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139285:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139292:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139297:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139303:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139309:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139603:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139612:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139627:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139634:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139642:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139648:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139653:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139660:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139666:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139673:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139679:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.139700:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162241:0:8412:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9afdc15db000:8412] 1 exiting: rc = 0 00000100:00100000:3.0:1788835169.162268:0:8411:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9afdba33ec00:8411] 0 exiting: rc = 1 00000100:00100000:0.0:1788835169.162668:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162678:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162684:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162689:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162695:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162700:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162705:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162711:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162716:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162721:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162726:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162733:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162738:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162744:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162750:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162755:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162762:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162768:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162774:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162779:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162784:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162790:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162795:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162801:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162821:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162826:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162833:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162838:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162844:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162850:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162856:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162861:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162867:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162872:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162877:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162883:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162888:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162893:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162898:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162903:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162909:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162915:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162919:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162925:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162930:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162935:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162941:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162948:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162954:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162960:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162965:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162971:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162977:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162983:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162988:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.162994:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.163000:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.163005:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.163010:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.163023:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.163028:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.163034:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.163039:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1788835169.163045:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.168159:0:8413:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9afdc1223400:8413] 0 exiting: rc = 1 00000100:00100000:3.0:1788835169.168301:0:8414:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9afdc1222400:8414] 1 exiting: rc = 0 00000100:00100000:3.0:1788835169.169551:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169576:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169616:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169625:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169631:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169637:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169644:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169652:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169658:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169665:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169672:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169679:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169686:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169692:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169715:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169723:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169729:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169735:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169742:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169749:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169757:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169764:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169770:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169777:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169783:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169789:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169811:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169820:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169826:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169850:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169856:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169863:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169869:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169875:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169881:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169888:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169894:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169902:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169923:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169932:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169938:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169945:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169953:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169959:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169966:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169973:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169980:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169986:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169992:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.169999:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.170020:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.170028:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.170035:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.170044:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.170051:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.170058:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.170065:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.170072:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.170078:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.170085:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.170092:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.170099:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.170106:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1788835169.170120:0:15676:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1788835169.186712:0:15676:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1788835188.695383:0:16440:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1788835198.916894:0:17039:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788835198.916902:0:17039:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds1_flakey 00000020:01000004:1.0:1788835198.916904:0:17039:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:1.0:1788835198.917040:0:17039:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9afc8447d000 00000020:01000004:1.0:1788835198.917059:0:17039:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-ldiskfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1788835198.917068:0:17039:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788835198.917084:0:17039:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9afdab4f4d28) 00000020:00000080:1.0:1788835198.917099:0:17039:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788835199.049698:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:2.0:1788835199.050093:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788835199.051994:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:2.0:1788835199.052484:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:2.0:1788835199.052810:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x30:0x0] (24/16) registered 00100000:10000000:2.0:1788835199.052986:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:2.0:1788835199.053145:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:2.0:1788835199.053477:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:2.0:1788835199.053674:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x22:0x0] (16/1) registered 00100000:10000000:2.0:1788835199.054232:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2f:0x0] (24/16) registered 00100000:10000000:2.0:1788835199.054937:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:2.0:1788835199.055139:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:2.0:1788835199.055548:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:2.0:1788835199.055824:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x32:0x0] (24/16) registered 00100000:10000000:2.0:1788835199.056060:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:2.0:1788835199.056250:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x33:0x0] (24/16) registered 00100000:10000000:2.0:1788835199.058096:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x31:0x0] (24/16) registered 00100000:10000000:2.0:1788835199.058832:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:2.0:1788835199.059073:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x34:0x0] (24/16) registered 00100000:10000000:2.0:1788835199.059275:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:2.0:1788835199.059912:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1f:0x0] (16/1) registered 00100000:10000000:2.0:1788835199.060128:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:2.0:1788835199.060515:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1e:0x0] (16/1) registered 00100000:10000000:2.0:1788835199.060715:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:2.0:1788835199.061022:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:2.0:1788835199.061245:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:2.0:1788835199.061830:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:2.0:1788835199.062084:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x23:0x0] (16/1) registered 00100000:10000000:2.0:1788835199.062289:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:2.0:1788835199.062725:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:2.0:1788835199.063031:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x20:0x0] (16/1) registered 00100000:10000000:2.0:1788835199.063252:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:2.0:1788835199.069618:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:2.0:1788835199.070074:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x21:0x0] (16/1) registered 00100000:10000000:2.0:1788835199.072034:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/32) registered 00100000:10000000:2.0:1788835199.072246:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/32) registered 00100000:10000000:3.0:1788835199.073207:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:3.0:1788835199.074034:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:3.0:1788835199.074942:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:3.0:1788835199.075838:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788835199.076977:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788835199.078153:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/32) registered 00100000:10000000:3.0:1788835199.078560:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:3.0:1788835199.079384:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x9:0x0] (8/32) registered 00100000:10000000:3.0:1788835199.080475:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/32) registered 00100000:10000000:3.0:1788835199.081000:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/32) registered 00100000:10000000:3.0:1788835199.086072:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000003:0x2:0x0] (8/32) registered 00100000:10000000:3.0:1788835199.092455:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/32) registered 00100000:10000000:3.0:1788835199.095863:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/32) registered 00100000:10000000:3.0:1788835199.096986:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/32) registered 00100000:10000000:3.0:1788835199.097878:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/32) registered 00100000:10000000:3.0:1788835199.098130:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/32) registered 00100000:10000000:3.0:1788835199.098518:0:17039:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/32) registered 00080000:01000000:3.0:1788835199.099837:0:17039:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788835199.100106:0:17039:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1788835199.100115:0:17039:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788835199.100130:0:17039:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf60171e5a5d2c06 00000020:01000004:3.0:1788835199.100138:0:17039:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device /dev/mapper/mds1_flakey 00000020:01000000:3.0:1788835199.100144:0:17039:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1788835199.100150:0:17039:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9afc8447d000 from MGS 00000020:01000004:3.0:1788835199.100154:0:17039:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1788835199.100167:0:17039:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9afc82373370) 00000020:00000080:3.0:1788835199.100178:0:17039:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1788835199.100293:0:17039:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afc8447d000 from MGS, refs=2 00080000:01000000:3.0:1788835199.100299:0:17039:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788835199.100306:0:17039:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf60171e5a5d2c14 00000100:00100000:3.0:1788835199.100485:0:17039:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1788835199.100632:0:17039:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1788835199.100638:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1788835199.102898:0:17039:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1788835199.102911:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1788835199.104279:0:17039:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788835199.104709:0:17039:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1788835199.104716:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1788835199.106451:0:17039:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1788835199.106464:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1788835199.107056:0:17039:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1788835199.107065:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1788835199.108080:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835199.108084:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835199.108086:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835199.108632:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835199.108635:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835199.108637:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835199.109756:0:17039:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1788835199.116377:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1788835199.118975:0:17039:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 10000000:01000000:2.0:1788835199.122021:0:17051:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1788835199.122096:0:17039:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1788835199.122166:0:17039:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788835199.123153:0:17039:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1788835199.123604:0:17039:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788835199.123822:0:17039:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1788835199.123831:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1788835199.134475:0:17039:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1788835199.134667:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1788835199.141620:0:17039:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1788835199.141649:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1788835199.143526:0:17039:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1788835199.143556:0:17039:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.122@tcp' 00000020:01000004:2.0:1788835199.143558:0:17039:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1788835199.143595:0:17039:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.122@tcp (typ=mgc) 00000020:00000080:2.0:1788835199.143612:0:17039:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.122@tcp (ffff9afdbf93b370) 00000020:00000080:2.0:1788835199.143630:0:17039:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1788835199.143729:0:17039:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afd82bfb000@MGC192.168.203.122@tcp: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1788835199.143908:0:17039:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.122@tcp-0 is initialized 00000040:01000000:2.0:1788835199.143916:0:17039:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 1 is initialized 10000000:01000000:1.0:1788835199.146660:0:17057:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1788835199.146792:0:17039:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.122@tcp (uuid cb888812-a79c-4531-9a69-89c757e37463) 00000020:00000080:2.0:1788835199.146823:0:17039:0:(genops.c:1385:class_connect()) connect: client cb888812-a79c-4531-9a69-89c757e37463, cookie 0xdf60171e5a5d2c22 00000100:00080000:2.0:1788835199.146838:0:17039:0:(import.c:510:import_select_connection()) MGC192.168.203.122@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788835199.146845:0:17039:0:(import.c:624:import_select_connection()) MGC192.168.203.122@tcp: import ffff9afd82bfb000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788835199.146885:0:17039:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbf9b8000 x1875729254088320/t0(0) o250->MGC192.168.203.122@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788835199.146942:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cb888812-a79c-4531-9a69-89c757e37463:3613:1875729254088320:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1788835199.147030:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835199.147110:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254088320 00000100:00100000:2.0:1788835199.147119:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254088320 00000100:00100000:2.0:1788835199.147186:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788835199.147195:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8304b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3613:x1875729254088320:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1788835199.147224:0:17053:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from cb888812-a79c-4531-9a69-89c757e37463@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:2.0:1788835199.147251:0:17053:0:(genops.c:1385:class_connect()) connect: client cb888812-a79c-4531-9a69-89c757e37463, cookie 0xdf60171e5a5d2c29 00000100:00080000:2.0:1788835199.147608:0:17053:0:(import.c:65:import_set_state_nolock()) ffff9afd82bff800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788835199.147673:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8304b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+5:3613:x1875729254088320:12345-0@lo:250:mount.lustre.0 Request processed in 477us (642us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835199.147681:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788835199.147740:0:3613:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.122@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1788835199.147750:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.122@tcp: connect to target with instance 0 00000100:00080000:2.0:1788835199.147757:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.122@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1788835199.147762:0:3613:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1788835199.147765:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afd82bfb000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1788835199.147767:0:3613:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1788835199.147813:0:3613:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1788835199.147820:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:cb888812-a79c-4531-9a69-89c757e37463:3613:1875729254088320:0@lo:250:mount.lustre.0 00000100:00080000:2.0:1788835199.147843:0:17039:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import cb888812-a79c-4531-9a69-89c757e37463->MGS 00000020:01000004:2.0:1788835199.147870:0:17039:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1788835199.147896:0:17039:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1788835199.147914:0:17039:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9afdbf93cd28) 00000020:00000080:2.0:1788835199.147925:0:17039:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00080000:1.0:1788835199.156307:0:17056:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1788835199.175501:0:17039:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788835199.175768:0:17039:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1788835199.175775:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1788835199.182526:0:17039:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1788835199.182547:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1788835199.183013:0:17039:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1788835199.183021:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1788835199.183923:0:17039:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788835199.184175:0:17039:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1788835199.184188:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1788835199.186722:0:17039:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1788835199.186737:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:3.0:1788835199.256555:0:17039:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788835199.257126:0:17039:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:3.0:1788835199.257132:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1788835199.259205:0:17039:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1788835199.259215:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1788835199.259917:0:17039:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788835199.260093:0:17039:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788835199.260098:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1788835199.269404:0:17039:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788835199.269422:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1788835199.271242:0:17039:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788835199.271488:0:17039:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788835199.271495:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1788835199.272630:0:17039:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788835199.272640:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1788835199.273377:0:17039:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788835199.273738:0:17039:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1788835199.273744:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1788835199.274269:0:17039:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1788835199.274276:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1788835199.302987:0:17039:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788835199.303202:0:17039:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788835199.303208:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1788835199.305235:0:17039:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1788835199.305248:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1788835199.306218:0:17039:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1788835199.306227:0:17039:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1788835199.307069:0:17039:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1788835199.307095:0:17039:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds1_flakey 10000000:01000000:2.0:1788835199.307102:0:17039:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1788835199.307199:0:17039:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788835199.307240:0:17039:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.122@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1788835199.307244:0:17039:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788835199.307246:0:17039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788835199.307247:0:17039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788835199.307248:0:17039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788835199.307249:0:17039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788835199.307251:0:17039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788835199.307252:0:17039:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788835199.307253:0:17039:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788835199.307255:0:17039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788835199.307256:0:17039:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788835199.307259:0:17039:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1788835199.307261:0:17039:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788835199.307262:0:17039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788835199.307263:0:17039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788835199.307264:0:17039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788835199.307266:0:17039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788835199.307267:0:17039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788835199.307267:0:17039:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788835199.307268:0:17039:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788835199.307269:0:17039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788835199.307270:0:17039:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788835199.307293:0:17039:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1788835199.307311:0:17039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254088448:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788835199.307516:0:17039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835199.307565:0:17039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf58f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788835199.307707:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254088448 00000100:00100000:3.0:1788835199.307714:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254088448 00000100:00100000:3.0:1788835199.307754:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788835199.307763:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+5:17039:x1875729254088448:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788835199.307808:0:17055:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788835199.307811:0:17055:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1788835199.307814:0:17055:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1788835199.308271:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:2.0:1788835199.308912:0:17055:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 6 20000000:01000000:2.0:1788835199.312888:0:17078:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1788835199.312895:0:17078:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 1 20000000:01000000:2.0:1788835199.312898:0:17078:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1788835199.312901:0:17078:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1788835199.313587:0:17078:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 20000000:01000000:3.0:1788835199.313831:0:17055:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1788835199.313842:0:17055:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1788835199.324303:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+5:17039:x1875729254088448:12345-0@lo:253:mount.lustre.0 Request processed in 16533us (16778us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835199.324350:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788835199.326177:0:17039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254088448:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788835199.326197:0:17039:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1788835199.326200:0:17039:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788835199.326202:0:17039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1788835199.326203:0:17039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788835199.326204:0:17039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788835199.326205:0:17039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788835199.326207:0:17039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788835199.326208:0:17039:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788835199.326209:0:17039:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1788835199.326210:0:17039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788835199.326212:0:17039:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788835199.326241:0:17039:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9afc8447d000 from lustre-MDT0000 10000000:01000000:2.0:1788835199.326285:0:17039:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:2.0:1788835199.326289:0:17039:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788835199.326293:0:17039:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9afdbf93b370 10000000:01000000:2.0:1788835199.326297:0:17039:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788835199.326306:0:17039:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9afdbf93b370 from 1 10000000:01000000:2.0:1788835199.326309:0:17039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1788835199.326368:0:17039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374d000/0xdf60171e5a5d2c37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835199.326379:0:17039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afc8374d000/0xdf60171e5a5d2c37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835199.326713:0:17039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afc8374d000/0xdf60171e5a5d2c37 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835199.326746:0:17039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254088576:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788835199.326837:0:17039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835199.326904:0:17039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf589c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788835199.327019:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254088576 00000100:00100000:0.0:1788835199.327026:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254088576 00000100:00100000:0.0:1788835199.327074:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788835199.327090:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+5:17039:x1875729254088576:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788835199.327171:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835199.327193:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd866f4e00/0xdf60171e5a5d2c3e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2c37 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.327224:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd866f4e00/0xdf60171e5a5d2c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2c37 expref: 6 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.327234:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd866f4e00/0xdf60171e5a5d2c3e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2c37 expref: 6 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.327242:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f4e00, rc 0) 00000100:00100000:0.0:1788835199.327345:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+6:17039:x1875729254088576:12345-0@lo:101:mount.lustre.0 Request processed in 228us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835199.327362:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788835199.327683:0:17039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254088576:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788835199.327698:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afc8374d000/0xdf60171e5a5d2c37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2c3e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835199.327711:0:17039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afc8374d000/0xdf60171e5a5d2c37 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2c3e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835199.327784:0:17039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254088704:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788835199.328207:0:17039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835199.328239:0:17039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf589c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788835199.328304:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254088704 00000100:00100000:1.0:1788835199.328355:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254088704 00000100:00100000:1.0:1788835199.328431:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788835199.328441:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+6:17039:x1875729254088704:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788835199.328612:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+6:17039:x1875729254088704:12345-0@lo:501:mount.lustre.0 Request processed in 172us (405us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788835199.328621:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788835199.328871:0:17039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254088704:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788835199.328908:0:17039:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1788835199.328930:0:17039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374d000/0xdf60171e5a5d2c37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2c3e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835199.328939:0:17039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afc8374d000/0xdf60171e5a5d2c37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2c3e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835199.328949:0:17039:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9afc8447d000 10000000:01000000:2.0:1788835199.328954:0:17039:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788835199.328959:0:17039:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9afc8447d000 10000000:01000000:2.0:1788835199.328962:0:17039:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1788835199.328966:0:17039:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9afc8447d000 from 1 10000000:01000000:2.0:1788835199.328969:0:17039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1788835199.328994:0:17039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374c000/0xdf60171e5a5d2c45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835199.329013:0:17039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afc8374c000/0xdf60171e5a5d2c45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835199.329023:0:17039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afc8374c000/0xdf60171e5a5d2c45 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835199.329039:0:17039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254088832:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788835199.329075:0:17039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835199.329205:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254088832 00000100:00100000:1.0:1788835199.329212:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254088832 00000100:00100000:1.0:1788835199.329244:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788835199.329252:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8304a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+6:17039:x1875729254088832:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788835199.329264:0:17054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835199.329287:0:17054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e60e00/0xdf60171e5a5d2c4c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2c45 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835199.329404:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e60e00/0xdf60171e5a5d2c4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2c45 expref: 7 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835199.329421:0:17054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e60e00/0xdf60171e5a5d2c4c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2c45 expref: 7 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835199.329431:0:17054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60e00, rc 0) 00000100:00100000:1.0:1788835199.329476:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8304a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+7:17039:x1875729254088832:12345-0@lo:101:mount.lustre.0 Request processed in 225us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835199.329483:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788835199.329581:0:17039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf589c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788835199.329602:0:17039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254088832:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788835199.329616:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afc8374c000/0xdf60171e5a5d2c45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2c4c expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835199.329626:0:17039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afc8374c000/0xdf60171e5a5d2c45 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2c4c expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835199.329639:0:17039:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1788835199.329645:0:17039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374c000/0xdf60171e5a5d2c45 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2c4c expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835199.329653:0:17039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afc8374c000/0xdf60171e5a5d2c45 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2c4c expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835199.329660:0:17039:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1788835199.329665:0:17039:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788835199.329671:0:17039:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9afc8447d000 10000000:01000000:2.0:1788835199.329675:0:17039:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1788835199.329687:0:17039:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1788835199.329689:0:17039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1788835199.329708:0:17039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374ca00/0xdf60171e5a5d2c53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835199.329715:0:17039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afc8374ca00/0xdf60171e5a5d2c53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835199.329723:0:17039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afc8374ca00/0xdf60171e5a5d2c53 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835199.329735:0:17039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254088960:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788835199.329772:0:17039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835199.329797:0:17039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf589c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788835199.329870:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254088960 00000100:00100000:1.0:1788835199.329876:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254088960 00000100:00100000:1.0:1788835199.329936:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788835199.329945:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+7:17039:x1875729254088960:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788835199.329953:0:17054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835199.329965:0:17054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e60c00/0xdf60171e5a5d2c5a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2c53 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835199.329998:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e60c00/0xdf60171e5a5d2c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2c53 expref: 8 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835199.330008:0:17054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e60c00/0xdf60171e5a5d2c5a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2c53 expref: 8 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835199.330015:0:17054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60c00, rc 0) 00000100:00100000:1.0:1788835199.330067:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+8:17039:x1875729254088960:12345-0@lo:101:mount.lustre.0 Request processed in 123us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835199.330073:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788835199.333871:0:17039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254088960:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788835199.333907:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afc8374ca00/0xdf60171e5a5d2c53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2c5a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835199.333942:0:17039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afc8374ca00/0xdf60171e5a5d2c53 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2c5a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835199.334036:0:17039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254089088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788835199.334094:0:17039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835199.334136:0:17039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd91672600 going to sleep for 11 seconds 00000100:00100000:2.0:1788835199.334459:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254089088 00000100:00100000:2.0:1788835199.334475:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254089088 00000100:00100000:2.0:1788835199.334543:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788835199.334556:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8304b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+8:17039:x1875729254089088:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788835199.335960:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8304b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+9:17039:x1875729254089088:12345-0@lo:501:mount.lustre.0 Request processed in 1397us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835199.335975:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788835199.340582:0:17039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254089088:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788835199.340680:0:17039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254089216:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788835199.341263:0:17039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835199.341492:0:17039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd91672600 going to sleep for 11 seconds 00000100:00100000:2.0:1788835199.348688:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254089216 00000100:00100000:2.0:1788835199.348710:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254089216 00000100:00100000:3.0:1788835199.352871:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788835199.352889:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+9:17039:x1875729254089216:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788835199.354151:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+9:17039:x1875729254089216:12345-0@lo:503:mount.lustre.0 Request processed in 1260us (12883us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835199.354165:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788835199.354351:0:17039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254089216:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788835199.355272:0:17079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb888812-a79c-4531-9a69-89c757e37463:17079:1875729254089344:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788835199.355665:0:17079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835199.355753:0:17079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf58900 going to sleep for 11 seconds 00000100:00100000:2.0:1788835199.359665:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254089344 00000100:00100000:2.0:1788835199.359687:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254089344 00000100:00100000:3.0:1788835199.364267:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788835199.364285:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+9:17079:x1875729254089344:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788835199.366625:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+9:17079:x1875729254089344:12345-0@lo:502:llog_process_th.0 Request processed in 2332us (10948us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835199.366641:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788835199.370503:0:17079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb888812-a79c-4531-9a69-89c757e37463:17079:1875729254089344:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788835199.370572:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788835199.370595:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835199.370598:0:17079:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788835199.370604:0:17079:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1788835199.370611:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788835199.370635:0:17079:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9afc820c99b8) 00000020:00000080:0.0:1788835199.370662:0:17079:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1788835199.370670:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1788835199.371023:0:17079:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:0.0:1788835199.371034:0:17079:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf60171e5a5d2c68 00000020:00000080:0.0:1788835199.372296:0:17079:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1788835199.372308:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788835199.372342:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835199.372355:0:17079:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1788835199.372361:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788835199.372368:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835199.372369:0:17079:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1788835199.372374:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788835199.372400:0:17079:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9afc820ccd28) 00000020:00000080:0.0:1788835199.372422:0:17079:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1788835199.372432:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1788835199.372434:0:17079:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1788835199.372438:0:17079:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1788835199.372446:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788835199.372547:0:17079:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afc8447d000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1788835199.372563:0:17079:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9afc820cb370) 00000020:00000080:0.0:1788835199.372571:0:17079:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1788835199.372632:0:17079:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1788835199.372640:0:17079:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf60171e5a5d2c7d 00000020:00000080:0.0:1788835199.372958:0:17079:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1788835199.372968:0:17079:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1788835199.372973:0:17079:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xdf60171e5a5d2c84 00080000:01000000:0.0:1788835199.372980:0:17079:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:0.0:1788835199.372983:0:17079:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf60171e5a5d2c8b 00010000:00010000:1.0:1788835199.505667:0:17079:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1788835199.506262:0:17079:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967528 00000001:00080000:1.0:1788835199.506712:0:17079:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1788835199.507134:0:17079:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9afdab4f19b8) 00000020:00000080:1.0:1788835199.507150:0:17079:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1788835199.507228:0:17079:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:1.0:1788835199.507235:0:17079:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf60171e5a5d2c99 00000020:00000080:3.0:1788835199.511195:0:17079:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1788835199.514756:0:17079:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xdf60171e5a5d2ca0 00000020:00000080:0.0:1788835199.516154:0:17079:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:0.0:1788835199.516167:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788835199.516177:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835199.516179:0:17079:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:0.0:1788835199.516183:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788835199.516186:0:17079:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:0.0:1788835199.516188:0:17079:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788835199.516190:0:17079:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788835199.516191:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788835199.516194:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835199.516196:0:17079:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788835199.516200:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788835199.516205:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835199.516207:0:17079:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:0.0:1788835199.516213:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:0.0:1788835199.516257:0:17079:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:0.0:1788835199.516273:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788835199.516277:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835199.516279:0:17079:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:0.0:1788835199.516282:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788835199.516286:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835199.516288:0:17079:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-MDT0001 add osp 00000020:00000080:0.0:1788835199.516292:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1788835199.516297:0:17079:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:00000080:0.0:1788835199.519813:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788835199.519835:0:17079:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osp-MDT0000 (ffff9afc820c8000) 00000020:00000080:0.0:1788835199.519865:0:17079:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:0.0:1788835199.519884:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1788835199.519972:0:17079:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0001-osp-MDT0000: connect to lustre-MDT0000-osd (lustre-MDT0001-osp-MDT0000) 00080000:01000000:0.0:1788835199.519978:0:17079:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:0.0:1788835199.519986:0:17079:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf60171e5a5d2cae 00010000:00080000:0.0:1788835199.520023:0:17079:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afdbf96e800@lustre-MDT0001-osp-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:0.0:1788835199.527255:0:17079:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-osp-MDT0000-1 is initialized 00000020:00000080:1.0:1788835199.545233:0:17079:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osp-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1788835199.545250:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:1.0:1788835199.545294:0:17079:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0001_UUID idx:1 gen:1 00000020:00000080:1.0:1788835199.545345:0:17079:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf60171e5a5d2cb5 00000100:00080000:1.0:1788835199.545356:0:17079:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788835199.545371:0:17079:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9afdbf96e800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788835199.545416:0:17079:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbfb92680 x1875729254089472/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1788835199.545442:0:17079:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID 00000020:01000000:1.0:1788835199.545497:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788835199.545509:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835199.545511:0:17079:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-MDT0001 add osp 00000020:01000000:1.0:1788835199.545515:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1788835199.545518:0:17079:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #19 00000020:01000000:1.0:1788835199.545519:0:17079:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788835199.545521:0:17079:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1788835199.545522:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1788835199.545525:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835199.545526:0:17079:0:(obd_config.c:1563:class_process_config()) marker 19 (0x6) lustre sys.timeout 00000020:01000000:1.0:1788835199.545529:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788835199.545534:0:17079:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:1.0:1788835199.545537:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835199.545538:0:17079:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre-OST0000 add osc 00000100:00100000:2.0:1788835199.545540:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254089472:0@lo:38:llog_process_th.0 00000020:00000080:1.0:1788835199.545541:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1788835199.545544:0:17079:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:1.0:1788835199.545565:0:17079:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1788835199.545568:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788835199.545579:0:17079:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9afdab4f3370) 00000020:00000080:1.0:1788835199.545591:0:17079:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1788835199.545595:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000100:00100000:2.0:1788835199.545623:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1788835199.545647:0:17079:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1788835199.545653:0:17079:0:(osd_handler.c:8925:osd_obd_connect()) connect #6 00000020:00000080:1.0:1788835199.545658:0:17079:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf60171e5a5d2cc3 00010000:00080000:1.0:1788835199.545682:0:17079:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afdbf96b800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.122@tcp at head 00000100:00100000:2.0:1788835199.545697:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254089472 00000100:00100000:2.0:1788835199.545704:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254089472 00000100:00100000:2.0:1788835199.545732:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1788835199.545740:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875729254089472:12345-0@lo:38:llog_process_th.0 00010000:00020000:2.0:1788835199.545755:0:17065:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788835199.545790:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875729254089472:12345-0@lo:38:llog_process_th.0 Request processed in 50us (166us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788835199.545798:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1788835199.545843:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdbf96e800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788835199.545848:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788835199.545851:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254089472:0@lo:38:llog_process_th.0 00010000:00010000:1.0:1788835199.545888:0:17079:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1788835199.547182:0:17079:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1788835199.547466:0:17079:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1788835199.554402:0:17079:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788835199.556918:0:17079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:0.0:1788835199.570895:0:17079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1788835199.583136:0:17085:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1788835199.583144:0:17085:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788835199.584400:0:17079:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1788835199.584860:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1788835199.584944:0:17079:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1788835199.584988:0:17079:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf60171e5a5d2cca 00000100:00080000:3.0:1788835199.585003:0:17079:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788835199.585009:0:17079:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9afdbf96b800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788835199.585058:0:17079:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afd9e816300 x1875729254089600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788835199.585090:0:17079:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1788835199.585186:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788835199.585191:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835199.585193:0:17079:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1788835199.585197:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1788835199.585200:0:17079:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #26 00000020:01000000:3.0:1788835199.585202:0:17079:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788835199.585204:0:17079:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1788835199.585205:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1788835199.585208:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835199.585210:0:17079:0:(obd_config.c:1563:class_process_config()) marker 26 (0x6) lustre sys.timeout 00000020:01000000:3.0:1788835199.585212:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1788835199.585217:0:17079:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds1_flakey 00000020:00000080:3.0:1788835199.585221:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835199.585223:0:17079:0:(obd_config.c:1563:class_process_config()) marker 30 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1788835199.585226:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1788835199.585230:0:17079:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:3.0:1788835199.585261:0:17079:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1788835199.585264:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788835199.585281:0:17079:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9afc82374d28) 00000020:00000080:3.0:1788835199.585295:0:17079:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type osp with refcount 2 00000020:00000080:3.0:1788835199.585301:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1788835199.585429:0:17079:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1788835199.585436:0:17079:0:(osd_handler.c:8925:osd_obd_connect()) connect #7 00000020:00000080:3.0:1788835199.585443:0:17079:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xdf60171e5a5d2cd8 00010000:00080000:3.0:1788835199.585492:0:17079:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afc8369a000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:3.0:1788835199.585752:0:17079:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-3 is initialized 00000040:01000000:3.0:1788835199.585843:0:17079:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1788835199.585863:0:17079:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000100:00100000:2.0:1788835199.586738:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254089600:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788835199.587296:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875729254089600 offset 0 length 520: 4 00000040:00080000:2.0:1788835199.593878:0:17079:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788835199.594152:0:17079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788835199.594554:0:17079:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:0.0:1788835199.601247:0:17087:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788835199.601260:0:17087:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1788835199.602414:0:17079:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1788835199.602431:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1788835199.602606:0:17079:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1788835199.602635:0:17079:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf60171e5a5d2cdf 00000100:00080000:0.0:1788835199.602879:0:17079:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1788835199.602887:0:17079:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9afc8369a000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1788835199.602937:0:17079:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbfa2ea00 x1875729254089728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788835199.605400:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254089728:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1788835199.605531:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875729254089728 offset 0 length 520: 4 00000100:00080000:1.0:1788835199.607378:0:17079:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1788835199.607787:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788835199.607798:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835199.607816:0:17079:0:(obd_config.c:1563:class_process_config()) marker 30 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1788835199.607821:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788835199.607826:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835199.607828:0:17079:0:(obd_config.c:1563:class_process_config()) marker 35 (0x1) lustre sys.timeout 00000020:00000080:1.0:1788835199.607832:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1788835199.607834:0:17079:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1788835199.607837:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788835199.607839:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835199.607841:0:17079:0:(obd_config.c:1563:class_process_config()) marker 35 (0x2) lustre sys.timeout 00000020:01000000:1.0:1788835199.607843:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788835199.607845:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835199.607847:0:17079:0:(obd_config.c:1563:class_process_config()) marker 40 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1788835199.607851:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1788835199.607920:0:17079:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb888812-a79c-4531-9a69-89c757e37463:17079:1875729254089856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1788835199.608138:0:17079:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835199.608198:0:17079:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82e76540 going to sleep for 11 seconds 00000100:00100000:3.0:1788835199.608279:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254089856 00000100:00100000:3.0:1788835199.608289:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254089856 00000100:00100000:3.0:1788835199.608397:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788835199.608409:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+9:17079:x1875729254089856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788835199.608751:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+9:17079:x1875729254089856:12345-0@lo:502:llog_process_th.0 Request processed in 343us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835199.608760:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788835199.608879:0:17079:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb93800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb888812-a79c-4531-9a69-89c757e37463:17079:1875729254089856:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1788835199.608918:0:17079:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788835199.608926:0:17079:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835199.608927:0:17079:0:(obd_config.c:1563:class_process_config()) marker 40 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788835199.608932:0:17079:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 46 count 46 00000020:01000000:3.0:1788835199.609247:0:17039:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-45 (rc=0) 10000000:01000000:3.0:1788835199.609273:0:17039:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1788835199.609300:0:17039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374ca00/0xdf60171e5a5d2c53 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2c5a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835199.609411:0:17039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afc8374ca00/0xdf60171e5a5d2c53 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2c5a expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788835199.609423:0:17039:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afc8447d000 from 1 10000000:01000000:3.0:1788835199.609426:0:17039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1788835199.609604:0:17039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd884aaa00/0xdf60171e5a5d2ce6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835199.609615:0:17039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd884aaa00/0xdf60171e5a5d2ce6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835199.609641:0:17039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd884aaa00/0xdf60171e5a5d2ce6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835199.609664:0:17039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254089984:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788835199.609713:0:17039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835199.609751:0:17039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb7207c00 going to sleep for 11 seconds 00000100:00100000:0.0:1788835199.609899:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254089984 00000100:00100000:0.0:1788835199.609907:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254089984 00000100:00100000:0.0:1788835199.610206:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1788835199.610216:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+9:17039:x1875729254089984:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788835199.610231:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835199.610246:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd866f4800/0xdf60171e5a5d2ced lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2ce6 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.610285:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd866f4800/0xdf60171e5a5d2ced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2ce6 expref: 10 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.610297:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd866f4800/0xdf60171e5a5d2ced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2ce6 expref: 10 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.610307:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f4800, rc 0) 00000100:00100000:1.0:1788835199.610668:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+10:17039:x1875729254089984:12345-0@lo:101:mount.lustre.0 Request processed in 450us (951us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835199.610677:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788835199.610808:0:17039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254089984:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788835199.610828:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd884aaa00/0xdf60171e5a5d2ce6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2ced expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835199.610839:0:17039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd884aaa00/0xdf60171e5a5d2ce6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2ced expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835199.611755:0:17039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254090112:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1788835199.614960:0:17039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835199.615003:0:17039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf58180 going to sleep for 11 seconds 00000100:00100000:1.0:1788835199.617276:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254090112 00000100:00100000:1.0:1788835199.617298:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254090112 00000100:00100000:1.0:1788835199.617418:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788835199.617431:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+10:17039:x1875729254090112:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788835199.617627:0:17054:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788835199.617636:0:17054:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1788835199.617804:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+10:17039:x1875729254090112:12345-0@lo:256:mount.lustre.0 Request processed in 374us (2849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835199.617812:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788835199.618101:0:17039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b9c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254090112:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1788835199.620892:0:17039:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788835199.620930:0:17039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd884aaa00/0xdf60171e5a5d2ce6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2ced expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835199.620944:0:17039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd884aaa00/0xdf60171e5a5d2ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2ced expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788835199.621092:0:17039:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afc8447d000 from 1 10000000:01000000:3.0:1788835199.621101:0:17039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788835199.621168:0:17039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd884aa200/0xdf60171e5a5d2cf4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835199.621179:0:17039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd884aa200/0xdf60171e5a5d2cf4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835199.621192:0:17039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd884aa200/0xdf60171e5a5d2cf4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835199.621223:0:17039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254090240:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788835199.621362:0:17039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835199.621428:0:17039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb7207300 going to sleep for 11 seconds 00000100:00100000:1.0:1788835199.621496:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254090240 00000100:00100000:1.0:1788835199.621507:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254090240 00000100:00100000:1.0:1788835199.621574:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788835199.621602:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+10:17039:x1875729254090240:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788835199.621618:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835199.621636:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e61c00/0xdf60171e5a5d2cfb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2cf4 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835199.621663:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e61c00/0xdf60171e5a5d2cfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2cf4 expref: 11 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835199.621673:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e61c00/0xdf60171e5a5d2cfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2cf4 expref: 11 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835199.621682:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61c00, rc 0) 00000100:00100000:1.0:1788835199.621771:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+11:17039:x1875729254090240:12345-0@lo:101:mount.lustre.0 Request processed in 171us (456us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835199.621778:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788835199.621822:0:17039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254090240:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788835199.621843:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd884aa200/0xdf60171e5a5d2cf4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2cfb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835199.621854:0:17039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd884aa200/0xdf60171e5a5d2cf4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2cfb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835199.621930:0:17039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254090368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788835199.622567:0:17039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835199.622607:0:17039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb7207300 going to sleep for 11 seconds 00000100:00100000:2.0:1788835199.622685:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254090368 00000100:00100000:2.0:1788835199.622694:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254090368 00000100:00100000:2.0:1788835199.622738:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788835199.622747:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+11:17039:x1875729254090368:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788835199.623073:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+11:17039:x1875729254090368:12345-0@lo:501:mount.lustre.0 Request processed in 326us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835199.623081:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788835199.625879:0:17039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254090368:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788835199.625979:0:17039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254090496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788835199.626085:0:17039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835199.626146:0:17039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb7207300 going to sleep for 11 seconds 00000100:00100000:2.0:1788835199.626198:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254090496 00000100:00100000:2.0:1788835199.626214:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254090496 00000100:00100000:2.0:1788835199.626283:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788835199.626293:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+11:17039:x1875729254090496:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788835199.626906:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+11:17039:x1875729254090496:12345-0@lo:503:mount.lustre.0 Request processed in 613us (820us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835199.626914:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788835199.627917:0:17039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254090496:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788835199.628436:0:17089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb888812-a79c-4531-9a69-89c757e37463:17089:1875729254090624:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788835199.628527:0:17089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835199.628560:0:17089:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb7207b40 going to sleep for 11 seconds 00000100:00100000:2.0:1788835199.628921:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254090624 00000100:00100000:2.0:1788835199.628929:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254090624 00000100:00100000:2.0:1788835199.628981:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788835199.628991:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+11:17089:x1875729254090624:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788835199.632029:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+11:17089:x1875729254090624:12345-0@lo:502:llog_process_th.0 Request processed in 3032us (3495us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835199.632043:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788835199.632671:0:17089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb888812-a79c-4531-9a69-89c757e37463:17089:1875729254090624:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788835199.632710:0:17089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788835199.632720:0:17089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835199.632723:0:17089:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1788835199.632730:0:17089:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afc8447d000 00000020:00000080:3.0:1788835199.632732:0:17089:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788835199.632739:0:17089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788835199.632742:0:17089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835199.632743:0:17089:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1788835199.632746:0:17089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788835199.632748:0:17089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835199.632749:0:17089:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1788835199.632753:0:17089:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afc8447d000 00000020:00000080:3.0:1788835199.632755:0:17089:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788835199.632815:0:17089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788835199.632819:0:17089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835199.632820:0:17089:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1788835199.632822:0:17089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788835199.632835:0:17089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835199.632836:0:17089:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788835199.632840:0:17089:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afc8447d000 00000020:00000080:3.0:1788835199.632842:0:17089:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1788835199.632860:0:17089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788835199.632863:0:17089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835199.632864:0:17089:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1788835199.632867:0:17089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788835199.632869:0:17089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835199.632870:0:17089:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:3.0:1788835199.632873:0:17089:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afc8447d000 00000020:00000080:3.0:1788835199.632875:0:17089:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1788835199.632921:0:17089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb888812-a79c-4531-9a69-89c757e37463:17089:1875729254090752:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1788835199.632975:0:17089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835199.633020:0:17089:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb7207b40 going to sleep for 11 seconds 00000100:00100000:0.0:1788835199.633081:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254090752 00000100:00100000:0.0:1788835199.633087:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254090752 00000100:00100000:0.0:1788835199.633133:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1788835199.633141:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+11:17089:x1875729254090752:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788835199.633248:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+11:17089:x1875729254090752:12345-0@lo:502:llog_process_th.0 Request processed in 107us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835199.633255:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788835199.637103:0:17089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb888812-a79c-4531-9a69-89c757e37463:17089:1875729254090752:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1788835199.637155:0:17089:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788835199.637167:0:17089:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835199.637170:0:17089:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:3.0:1788835199.637175:0:17089:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 13 count 13 00000020:01000000:0.0:1788835199.638956:0:17039:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788835199.638990:0:17039:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788835199.639006:0:17039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd884aa200/0xdf60171e5a5d2cf4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2cfb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.639018:0:17039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd884aa200/0xdf60171e5a5d2cf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2cfb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788835199.639080:0:17039:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788835199.639084:0:17039:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9afc8447d000 10000000:01000000:0.0:1788835199.639087:0:17039:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9afc8447d000 10000000:01000000:0.0:1788835199.639091:0:17039:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788835199.639098:0:17039:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afc8447d000 from 1 10000000:01000000:0.0:1788835199.639101:0:17039:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788835199.639149:0:17039:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f4200/0xdf60171e5a5d2d02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.639158:0:17039:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd866f4200/0xdf60171e5a5d2d02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.639168:0:17039:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd866f4200/0xdf60171e5a5d2d02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835199.639192:0:17039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254090880:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788835199.639262:0:17039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835199.642491:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254090880 00000100:00100000:2.0:1788835199.642574:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254090880 00000100:00100000:2.0:1788835199.642630:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788835199.642639:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+11:17039:x1875729254090880:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788835199.642656:0:17054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835199.642675:0:17054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afc8374d400/0xdf60171e5a5d2d09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2d02 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835199.642699:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afc8374d400/0xdf60171e5a5d2d09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2d02 expref: 12 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835199.642711:0:17054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afc8374d400/0xdf60171e5a5d2d09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2d02 expref: 12 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835199.642720:0:17054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374d400, rc 0) 00000100:00100000:2.0:1788835199.642796:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+12:17039:x1875729254090880:12345-0@lo:101:mount.lustre.0 Request processed in 158us (3533us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835199.642847:0:17039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb90ca9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788835199.642875:0:17039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254090880:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788835199.642892:0:17039:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd866f4200/0xdf60171e5a5d2d02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2d09 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835199.642902:0:17039:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd866f4200/0xdf60171e5a5d2d02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2d09 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835199.642917:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788835199.642988:0:17039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254091008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788835199.643023:0:17039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835199.643059:0:17039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda0a8c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788835199.644526:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254091008 00000100:00100000:2.0:1788835199.644535:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254091008 00000100:00100000:2.0:1788835199.645734:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1788835199.645749:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+12:17039:x1875729254091008:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788835199.645939:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+12:17039:x1875729254091008:12345-0@lo:501:mount.lustre.0 Request processed in 195us (2914us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835199.645947:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788835199.646065:0:17039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254091008:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788835199.646117:0:17039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254091136:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788835199.646159:0:17039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835199.646198:0:17039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afda0a8c780 going to sleep for 11 seconds 00000100:00100000:2.0:1788835199.648283:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254091136 00000100:00100000:2.0:1788835199.648293:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254091136 00000100:00100000:2.0:1788835199.648376:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1788835199.648395:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+12:17039:x1875729254091136:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788835199.648554:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+12:17039:x1875729254091136:12345-0@lo:503:mount.lustre.0 Request processed in 169us (2394us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835199.648571:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788835199.651498:0:17039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254091136:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788835199.657614:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb888812-a79c-4531-9a69-89c757e37463:17094:1875729254091264:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788835199.657703:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835199.657752:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 11 seconds 00000100:00100000:0.0:1788835199.657995:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254091264 00000100:00100000:0.0:1788835199.658003:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254091264 00000100:00100000:0.0:1788835199.658043:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788835199.658051:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+12:17094:x1875729254091264:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788835199.658173:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+12:17094:x1875729254091264:12345-0@lo:502:llog_process_th.0 Request processed in 121us (469us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835199.658180:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788835199.658278:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b9c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb888812-a79c-4531-9a69-89c757e37463:17094:1875729254091264:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1788835199.658375:0:17094:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1788835199.658405:0:17094:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9afdbf9399b8) 00000020:00000080:2.0:1788835199.658425:0:17094:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type lwp with refcount 2 00000020:01000004:2.0:1788835199.658972:0:17094:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afc8447d000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788835199.658978:0:17094:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afc8447d000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1788835199.658981:0:17094:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afc8447d000 4 00010000:00080000:2.0:1788835199.659014:0:17094:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afd85553800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1788835199.663051:0:17094:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-4 is initialized 00000020:00000080:2.0:1788835199.663278:0:17094:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1788835199.663427:0:17094:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1788835199.663443:0:17094:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xdf60171e5a5d2d17 00000100:00080000:2.0:1788835199.663453:0:17094:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788835199.663466:0:17094:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9afd85553800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788835199.663639:0:17094:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbf9b9c00 x1875729254091392/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788835199.663681:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875729254091392:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788835199.663753:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1788835199.663809:0:17094:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1788835199.664415:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254091392 00000100:00100000:0.0:1788835199.664425:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254091392 00000100:00100000:0.0:1788835199.664460:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788835199.664469:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875729254091392:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788835199.664541:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875729254091392:12345-0@lo:38:llog_process_th.0 Request processed in 71us (786us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788835199.664548:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788835199.664587:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788835199.664595:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afd85553800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788835199.664606:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788835199.664609:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875729254091392:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788835199.664620:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb888812-a79c-4531-9a69-89c757e37463:17094:1875729254091520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788835199.664677:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835199.664760:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd91672540 going to sleep for 11 seconds 00000100:00100000:0.0:1788835199.664848:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254091520 00000100:00100000:0.0:1788835199.664854:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254091520 00000100:00100000:0.0:1788835199.664886:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788835199.664895:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+12:17094:x1875729254091520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1788835199.665050:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+12:17094:x1875729254091520:12345-0@lo:502:llog_process_th.0 Request processed in 155us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835199.665058:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788835199.665122:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb888812-a79c-4531-9a69-89c757e37463:17094:1875729254091520:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788835199.665164:0:17094:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb888812-a79c-4531-9a69-89c757e37463:17094:1875729254091648:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788835199.665223:0:17094:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835199.665247:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254091648 00000100:00100000:2.0:1788835199.665251:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254091648 00000100:00100000:2.0:1788835199.665338:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788835199.665346:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+12:17094:x1875729254091648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1788835199.665424:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+12:17094:x1875729254091648:12345-0@lo:502:llog_process_th.0 Request processed in 78us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835199.665430:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788835199.665908:0:17094:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2e0ec00 going to sleep for 11 seconds 00000100:00100000:2.0:1788835199.665926:0:17094:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:cb888812-a79c-4531-9a69-89c757e37463:17094:1875729254091648:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1788835199.665950:0:17094:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 52 count 51 00000020:01000000:0.0:1788835199.667444:0:17039:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788835199.667601:0:17039:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788835199.667660:0:17039:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f4200/0xdf60171e5a5d2d02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2d09 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.667673:0:17039:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd866f4200/0xdf60171e5a5d2d02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2d09 expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788835199.667729:0:17039:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788835199.667731:0:17039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788835199.667733:0:17039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788835199.667734:0:17039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788835199.667736:0:17039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788835199.667737:0:17039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788835199.667739:0:17039:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788835199.667740:0:17039:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788835199.667742:0:17039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788835199.667744:0:17039:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788835199.667748:0:17039:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:0.0:1788835199.667751:0:17039:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788835199.667752:0:17039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788835199.667753:0:17039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788835199.667759:0:17039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788835199.667760:0:17039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788835199.667761:0:17039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788835199.667762:0:17039:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788835199.667763:0:17039:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788835199.667765:0:17039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788835199.667766:0:17039:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788835199.667788:0:17039:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1788835199.667806:0:17039:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254091776:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788835199.667876:0:17039:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835199.667912:0:17039:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb90cacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1788835199.667940:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254091776 00000100:00100000:0.0:1788835199.667945:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254091776 00000100:00100000:0.0:1788835199.667986:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788835199.667994:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+12:17039:x1875729254091776:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788835199.668023:0:17054:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1788835199.668037:0:17054:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788835199.673614:0:17054:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788835199.673644:0:17054:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1788835199.674696:0:17077:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788835199.674706:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788835199.674730:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afd884ab400/0xdf60171e5a5d2d1e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835199.674750:0:17077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd866f4800/0xdf60171e5a5d2ced lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2ce6 expref: 12 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835199.674758:0:17077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afd884ab400/0xdf60171e5a5d2d1e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835199.675084:0:17077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd866f4800/0xdf60171e5a5d2ced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d2ce6 expref: 12 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835199.675105:0:17077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afd866f4800/0xdf60171e5a5d2ced lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d2ce6 expref: 12 pid: 17055 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835199.675121:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17077:1875729254091904:0@lo:104: 00000100:00100000:3.0:1788835199.675187:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835199.675241:0:17077:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8109ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1788835199.675266:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+12:17039:x1875729254091776:12345-0@lo:253:mount.lustre.0 Request processed in 7264us (7380us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835199.675282:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1788835199.676672:0:17043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254091904 00000100:00100000:0.0:1788835199.676683:0:17043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254091904 00000100:00100000:0.0:1788835199.676730:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788835199.676738:0:17043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e815180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+3:17077:x1875729254091904:12345-0@lo:104: 00010000:00010000:0.0:1788835199.676754:0:17043:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afd884aaa00/0xdf60171e5a5d2ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2ced expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.676835:0:17043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1788835199.676841:0:17043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e815180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+3:17077:x1875729254091904:12345-0@lo:104: Request processed in 105us (1656us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835199.676849:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1788835199.676868:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835199.676874:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd884aaa00/0xdf60171e5a5d2ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2ced expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.676894:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aaa00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:0.0:1788835199.676897:0:17049:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd884aaa00/0xdf60171e5a5d2ce6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d2ced expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.676906:0:17049:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd884aaa00/0xdf60171e5a5d2ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d2ced expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1788835199.676913:0:17049:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd884aaa00/0xdf60171e5a5d2ce6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d2ced expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788835199.676919:0:17049:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1788835199.676950:0:17049:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd884aaa00/0xdf60171e5a5d2ce6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2ced expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.676957:0:17049:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1788835199.676974:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd884aaa00/0xdf60171e5a5d2ce6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2ced expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.676982:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd884aaa00/0xdf60171e5a5d2ce6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2ced expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.676996:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835199.676997:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835199.676999:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835199.677026:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb888812-a79c-4531-9a69-89c757e37463:3617:1875729254092032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788835199.677059:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835199.677095:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17077:1875729254091904:0@lo:104: 00010000:00010000:3.0:1788835199.677116:0:17077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afd884ab400/0xdf60171e5a5d2d1e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835199.677135:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254092032 00000100:00100000:0.0:1788835199.677139:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254092032 00010000:00010000:0.0:1788835199.677154:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd866f4800/0xdf60171e5a5d2ced lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2ce6 expref: 12 pid: 17055 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835199.677179:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788835199.677185:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb888812-a79c-4531-9a69-89c757e37463+12:3617:x1875729254092032:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788835199.677195:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835199.677200:0:17045:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd866f4800/0xdf60171e5a5d2ced lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2ce6 expref: 12 pid: 17055 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.677210:0:17045:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd866f4800/0xdf60171e5a5d2ced lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d2ce6 expref: 12 pid: 17055 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.677223:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd866f4800/0xdf60171e5a5d2ced lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d2ce6 expref: 12 pid: 17055 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.677236:0:17045:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afd884ab400/0xdf60171e5a5d2d1e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.677243:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd884ab400/0xdf60171e5a5d2d1e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1788835199.677257:0:17045:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002552231s 00010000:00010000:0.0:1788835199.677262:0:17045:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afd884ab400/0xdf60171e5a5d2d1e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.677268:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afd884ab400/0xdf60171e5a5d2d1e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.677275:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afd884ab400/0xdf60171e5a5d2d1e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.677282:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afd884ab400/0xdf60171e5a5d2d1e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.677292:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884ab400 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835199.677296:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afd884ab400/0xdf60171e5a5d2d1e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.677304:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afd884ab400/0xdf60171e5a5d2d1e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.677346:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afd884ab400/0xdf60171e5a5d2d1e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835199.677356:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835199.677386:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb888812-a79c-4531-9a69-89c757e37463+11:3617:x1875729254092032:12345-0@lo:103:ldlm_bl.0 Request processed in 200us (325us total) trans 0 rc 0/0 00010000:00010000:3.0:1788835199.677403:0:17077:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afd884ab400/0xdf60171e5a5d2d1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835199.677405:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:3.0:1788835199.677411:0:17077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afd884ab400/0xdf60171e5a5d2d1e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835199.677417:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd884ab400/0xdf60171e5a5d2d1e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835199.677432:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb888812-a79c-4531-9a69-89c757e37463:3617:1875729254092032:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788835199.677457:0:17039:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2df80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17039:1875729254091776:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788835199.677467:0:17039:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1788835199.677470:0:17039:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788835199.677472:0:17039:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1788835199.677474:0:17039:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788835199.677475:0:17039:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788835199.677476:0:17039:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788835199.677477:0:17039:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788835199.677479:0:17039:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1788835199.677481:0:17039:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1788835199.677482:0:17039:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788835199.677484:0:17039:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788835199.677493:0:17039:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000020:00080000:0.0:1788835199.712604:0:17039:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:0.0:1788835199.712983:0:17039:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:2.0:1788835199.713060:0:17101:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:2.0:1788835199.713065:0:17101:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:2.0:1788835199.713485:0:17102:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788835199.713708:0:17039:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osp-MDT0000 ctxt 16 is initialized 00000040:00080000:1.0:1788835199.714083:0:17102:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00080000:2.0:1788835199.714149:0:17103:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != DISCONN) req@ffff9afdbf9b8700 x1875729254092160/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835199.714163:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 0 seconds 00000040:01000000:0.0:1788835199.714755:0:17039:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1788835199.714789:0:17039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1788835199.716903:0:17039:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1788835199.716921:0:17039:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1788835199.716998:0:17039:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788835199.720276:0:17039:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1788835199.720972:0:17102:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788835199.721026:0:17102:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1788835199.722846:0:17039:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1788835199.722991:0:17039:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1788835199.725788:0:17039:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x35:0x0] (8/32) registered 00000001:00000004:0.0:1788835199.729159:0:17039:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1788835199.732736:0:17039:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1788835199.732777:0:17039:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffadff40dab988 00100000:10000000:0.0:1788835199.732785:0:17039:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:2.0:1788835199.734109:0:17039:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1788835199.734134:0:17039:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1788835199.734166:0:17039:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=45 00000080:00000004:2.0:1788835199.734190:0:17039:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds1_flakey: Mount complete 00000020:00000004:2.0:1788835199.735757:0:17039:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788835199.736034:0:17039:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788835200.165884:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1788835200.681107:0:17095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788835200.742372:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 0 seconds 00010000:00010000:0.0:1788835201.189773:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1788835201.189848:0:17057:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1788835201.189853:0:17057:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afc8447d000 from 7 10000000:01000000:2.0:1788835201.189859:0:17057:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788835201.189924:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374c600/0xdf60171e5a5d2d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835201.189938:0:17057:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afc8374c600/0xdf60171e5a5d2d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835201.189952:0:17057:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afc8374c600/0xdf60171e5a5d2d25 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835201.189984:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254092288:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788835201.190073:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835201.190189:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77e40 going to sleep for 11 seconds 00000100:00100000:0.0:1788835201.194306:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254092288 00000100:00100000:0.0:1788835201.194342:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254092288 00000100:00100000:0.0:1788835201.194448:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1788835201.194816:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+11:17057:x1875729254092288:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788835201.194840:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835201.194868:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd866f5400/0xdf60171e5a5d2d2c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2d25 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835201.194904:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd866f5400/0xdf60171e5a5d2d2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2d25 expref: 12 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835201.194916:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd866f5400/0xdf60171e5a5d2d2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2d25 expref: 12 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835201.194949:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5400, rc 0) 00000100:00100000:0.0:1788835201.195073:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+12:17057:x1875729254092288:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 263us (4999us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835201.195080:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788835201.195617:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254092288:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788835201.195643:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afc8374c600/0xdf60171e5a5d2d25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2d2c expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835201.195655:0:17057:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afc8374c600/0xdf60171e5a5d2d25 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2d2c expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835201.195755:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254092416:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1788835201.195808:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835201.195859:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8109b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788835201.195934:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254092416 00000100:00100000:1.0:1788835201.195942:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254092416 00000100:00100000:1.0:1788835201.195994:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788835201.196004:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+12:17057:x1875729254092416:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788835201.196025:0:17054:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788835201.196046:0:17054:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788835201.196049:0:17054:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788835201.196156:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+12:17057:x1875729254092416:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 152us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835201.196165:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788835201.196243:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254092416:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1788835201.196290:0:17057:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1788835201.196298:0:17057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374c600/0xdf60171e5a5d2d25 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2d2c expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835201.196307:0:17057:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afc8374c600/0xdf60171e5a5d2d25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2d2c expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788835201.702065:0:17095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788835201.767562:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 0 seconds 00010000:00010000:0.0:1788835202.221786:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835202.790584:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 0 seconds 00010000:00010000:0.0:1788835203.240145:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835203.816115:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 0 seconds 00010000:00010000:2.0:1788835204.261714:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1788835204.610454:0:17345:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788835204.840087:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 0 seconds 00000100:00100000:2.0:1788835204.901865:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb888812-a79c-4531-9a69-89c757e37463:3614:1875729254092544:0@lo:400:kworker.0 00000100:00100000:2.0:1788835204.901954:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788835204.902161:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788835204.902166:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788835204.902170:0:37:0:(import.c:65:import_set_state_nolock()) ffff9afdbf96e800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788835204.902175:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 441 00000100:00080000:1.0:1788835204.902188:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1788835204.902208:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9afdbf96e800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788835204.902238:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbfb90000 x1875729254092672/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788835204.902287:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254092672:0@lo:38:kworker.0 00000100:00100000:3.0:1788835204.902433:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788835204.902572:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788835204.902577:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788835204.902580:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788835204.902584:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788835204.902593:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788835204.902596:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1788835204.902598:0:37:0:(import.c:65:import_set_state_nolock()) ffff9afd85553800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788835204.902604:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9afd85553800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788835204.902620:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbfb93100 x1875729254092800/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788835204.902721:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875729254092800:0@lo:38:kworker.0 00000100:00100000:3.0:1788835204.902769:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835204.902816:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254092800 00000100:00100000:3.0:1788835204.902824:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254092800 00000100:00100000:3.0:1788835204.902854:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788835204.902861:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3613:x1875729254092800:12345-0@lo:38:kworker.0 00010000:00080000:3.0:1788835204.902885:0:17062:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:3.0:1788835204.902920:0:17062:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xdf60171e5a5d2d33 00000004:00100000:3.0:1788835204.902934:0:17062:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788835204.903116:0:17062:0:(import.c:65:import_set_state_nolock()) ffff9afdb9322000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788835204.903187:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e816a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3613:x1875729254092800:12345-0@lo:38:kworker.0 Request processed in 316us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835204.903200:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1788835204.903245:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9afdbfb93100 x1875729254092800/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788835214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788835204.903268:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788835204.903275:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1788835204.903279:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1788835204.903281:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afd85553800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788835204.903287:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3613:1875729254092800:0@lo:38:kworker.0 00000100:00100000:3.0:1788835204.903386:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254092544 00000100:00100000:3.0:1788835204.903390:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254092544 00000100:00100000:3.0:1788835204.903546:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788835204.903554:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+12:3614:x1875729254092544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835204.903895:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+12:3614:x1875729254092544:12345-0@lo:400:kworker.0 Request processed in 341us (1940us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835204.903904:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788835204.903965:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb888812-a79c-4531-9a69-89c757e37463:3614:1875729254092544:0@lo:400:kworker.0 00000100:00100000:2.0:1788835204.903998:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254092672 00000100:00100000:2.0:1788835204.904003:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254092672 00000100:00100000:2.0:1788835204.904071:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788835204.904076:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875729254092672:12345-0@lo:38:kworker.0 00010000:00020000:2.0:1788835204.904091:0:17065:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1788835204.920095:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e815c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875729254092672:12345-0@lo:38:kworker.0 Request processed in 16010us (17655us total) trans 0 rc -19/-19 00000100:00100000:2.0:1788835204.920110:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:0.0:1788835204.920365:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdbf96e800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788835204.920372:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1788835204.920376:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254092672:0@lo:38:kworker.0 00010000:00010000:1.0:1788835205.286022:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:2.0:1788835205.387506:0:17397:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788835205.387911:0:17397:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788835205.861474:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 0 seconds 00000020:00000004:0.0:1788835206.245866:0:17447:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788835206.246133:0:17447:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788835206.309481:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835206.888654:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 0 seconds 00010000:00010000:1.0:1788835207.334370:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835207.911141:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 0 seconds 00010000:00010000:2.0:1788835208.358426:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835208.933429:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 0 seconds 00010000:00010000:1.0:1788835209.381518:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835209.959113:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 0 seconds 00000100:00100000:0.0:1788835210.021819:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788835199/real 1788835199] req@ffff9afdbfa2ea00 x1875729254089728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788835209 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835210.021851:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9afdbfa2ea00 x1875729254089728/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788835209 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835210.021901:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788835199/real 1788835199] req@ffff9afd9e816300 x1875729254089600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788835209 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835210.021915:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9afd9e816300 x1875729254089600/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788835209 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1788835210.021932:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc8369a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788835210.021960:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788835210.021972:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254089728:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1788835210.021979:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdbf96b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788835210.021984:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1788835210.021987:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e816300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254089600:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788835210.022101:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1788835210.022106:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:3.0:1788835210.022110:0:8:0:(import.c:65:import_set_state_nolock()) ffff9afdbf96e800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788835210.022115:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 446 00000100:00080000:3.0:1788835210.022120:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788835210.022126:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9afdbf96e800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788835210.022147:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afd9e816d80 x1875729254093056/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788835210.022160:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788835210.022169:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788835210.022171:0:8:0:(import.c:65:import_set_state_nolock()) ffff9afdbf96b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788835210.022174:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 441 00000100:00080000:3.0:1788835210.022177:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788835210.022180:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9afdbf96b800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788835210.022193:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afd9e814700 x1875729254093184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788835210.022202:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788835210.022205:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788835210.022207:0:8:0:(import.c:65:import_set_state_nolock()) ffff9afc8369a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788835210.022209:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 441 00000100:00080000:3.0:1788835210.022212:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1788835210.022215:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9afc8369a000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788835210.022226:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afd9e814a80 x1875729254093312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788835210.022260:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788835210.022272:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb888812-a79c-4531-9a69-89c757e37463:3614:1875729254092928:0@lo:400:kworker.0 00000100:00100000:3.0:1788835210.022369:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835210.024847:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254093440:0@lo:400:kworker.0 00000100:00100000:0.0:1788835210.024928:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835210.025007:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254092928 00000100:00100000:0.0:1788835210.025016:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254092928 00000100:00100000:0.0:1788835210.025068:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788835210.025076:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+12:3614:x1875729254092928:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835210.025132:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+12:3614:x1875729254092928:12345-0@lo:400:kworker.0 Request processed in 56us (2762us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835210.025139:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788835210.025196:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb888812-a79c-4531-9a69-89c757e37463:3614:1875729254092928:0@lo:400:kworker.0 00000100:00100000:0.0:1788835210.025221:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254093056:0@lo:38:kworker.0 00000100:00100000:0.0:1788835210.025250:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835210.025270:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254093184:0@lo:8:kworker.0 00000400:00000100:0.0:1788835210.025293:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875729254093184 offset 0 length 520: 4 00000100:00100000:0.0:1788835210.025306:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254093312:0@lo:8:kworker.0 00000400:00000100:0.0:1788835210.025355:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875729254093312 offset 0 length 520: 4 00000100:00100000:0.0:1788835210.025411:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254093056 00000100:00100000:0.0:1788835210.025416:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254093056 00000100:00100000:0.0:1788835210.025443:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1788835210.025448:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875729254093056:12345-0@lo:38:kworker.0 00010000:00020000:0.0:1788835210.025471:0:17066:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-MDT0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1788835210.026420:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254093440 00000100:00100000:3.0:1788835210.026429:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254093440 00000100:00100000:3.0:1788835210.026467:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1788835210.026475:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254093440:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835210.026544:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254093440:12345-0@lo:400:kworker.0 Request processed in 69us (1615us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835210.026551:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1788835210.032800:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9afd9e817480 x1875729254093440/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835226 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835210.032821:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e817480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254093440:0@lo:400:kworker.0 00000100:00100000:0.0:1788835210.049059:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:0+-99:3613:x1875729254093056:12345-0@lo:38:kworker.0 Request processed in 23601us (23799us total) trans 0 rc -19/-19 00000100:00100000:0.0:1788835210.049073:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1788835210.049771:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdbf96e800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788835210.049779:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1788835210.049784:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e816d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254093056:0@lo:38:kworker.0 00010000:00010000:0.0:1788835210.406779:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835210.982369:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 0 seconds 00010000:00010000:1.0:1788835211.433664:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788835211.943731:0:17095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788835212.005609:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 0 seconds 00000020:01000004:2.0:1788835212.427013:0:17792:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1788835212.427018:0:17792:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/mds2_flakey 00000020:01000004:2.0:1788835212.427020:0:17792:0:(obd_mount.c:929:lmd_print()) options: user_xattr,errors=remount-ro 00000080:01200004:2.0:1788835212.427155:0:17792:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9afd87f3f800 00000020:01000004:2.0:1788835212.427176:0:17792:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0001, type=osd-ldiskfs, lsifl=200001, mountfl=0 00000020:01000004:2.0:1788835212.427190:0:17792:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-osd (typ=osd-ldiskfs) 00000020:00000080:2.0:1788835212.427208:0:17792:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-osd (ffff9afdbf938000) 00000020:00000080:2.0:1788835212.427229:0:17792:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type osd-ldiskfs with refcount 2 00010000:00010000:0.0:1788835212.453621:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:2.0:1788835212.495670:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xd:0x0] (16/1) registered 00100000:10000000:0.0:1788835212.496773:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:0.0:1788835212.502111:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x27:0x0] (24/16) registered 00100000:10000000:0.0:1788835212.505401:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x19:0x0] (16/1) registered 00100000:10000000:0.0:1788835212.506754:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x22:0x0] (24/16) registered 00100000:10000000:0.0:1788835212.507279:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1a:0x0] (16/1) registered 00100000:10000000:0.0:1788835212.508959:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x25:0x0] (24/16) registered 00100000:10000000:0.0:1788835212.509415:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xe:0x0] (16/1) registered 00100000:10000000:0.0:1788835212.512899:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2c:0x0] (24/16) registered 00100000:10000000:0.0:1788835212.513893:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x18:0x0] (16/1) registered 00100000:10000000:0.0:1788835212.514299:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x20:0x0] (24/16) registered 00100000:10000000:0.0:1788835212.517190:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x14:0x0] (16/1) registered 00100000:10000000:0.0:1788835212.518137:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x13:0x0] (16/1) registered 00100000:10000000:0.0:1788835212.518489:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x15:0x0] (16/1) registered 00100000:10000000:0.0:1788835212.523691:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x29:0x0] (24/16) registered 00100000:10000000:0.0:1788835212.524767:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x26:0x0] (24/16) registered 00100000:10000000:0.0:1788835212.526705:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x17:0x0] (16/1) registered 00100000:10000000:0.0:1788835212.527396:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1f:0x0] (24/16) registered 00100000:10000000:0.0:1788835212.527718:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x12:0x0] (16/1) registered 00100000:10000000:0.0:1788835212.528039:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x21:0x0] (24/16) registered 00100000:10000000:0.0:1788835212.528238:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x23:0x0] (24/16) registered 00100000:10000000:0.0:1788835212.528671:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2a:0x0] (24/16) registered 00100000:10000000:0.0:1788835212.529367:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2d:0x0] (24/16) registered 00100000:10000000:0.0:1788835212.533828:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0xf:0x0] (16/1) registered 00100000:10000000:0.0:1788835212.535455:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x28:0x0] (24/16) registered 00100000:10000000:0.0:1788835212.536064:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1b:0x0] (16/1) registered 00100000:10000000:0.0:1788835212.536502:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x16:0x0] (16/1) registered 00100000:10000000:0.0:1788835212.536988:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2e:0x0] (24/16) registered 00100000:10000000:1.0:1788835212.538108:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x24:0x0] (24/16) registered 00100000:10000000:1.0:1788835212.538636:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x11:0x0] (16/1) registered 00100000:10000000:1.0:1788835212.538988:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x2b:0x0] (24/16) registered 00100000:10000000:1.0:1788835212.539658:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1d:0x0] (16/1) registered 00100000:10000000:1.0:1788835212.540007:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x1c:0x0] (16/1) registered 00100000:10000000:1.0:1788835212.540269:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x10:0x0] (16/1) registered 00100000:10000000:1.0:1788835212.541262:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20001:0x0] (8/8) registered 00100000:10000000:1.0:1788835212.541913:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x8:0x0] (8/32) registered 00100000:10000000:1.0:1788835212.545787:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:1.0:1788835212.546743:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20002:0x0] (8/8) registered 00100000:10000000:1.0:1788835212.547026:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:1.0:1788835212.547273:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x7:0x0] (8/32) registered 00100000:10000000:1.0:1788835212.547660:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:1.0:1788835212.547877:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x20003:0x0] (8/8) registered 00100000:10000000:1.0:1788835212.548081:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x3:0x0] (8/32) registered 00100000:10000000:1.0:1788835212.548311:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:1.0:1788835212.548679:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:1.0:1788835212.549778:0:17792:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-MDT0001: index object [0x200000003:0x6:0x0] (8/32) registered 00080000:01000000:1.0:1788835212.558605:0:17792:0:(osd_lproc.c:911:osd_procfs_init()) lustre-MDT0001: register osd-ldiskfs tunable parameters 00000020:00000080:1.0:1788835212.558908:0:17792:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-osd (uuid lustre-MDT0001-osd_UUID) 00080000:01000000:1.0:1788835212.558923:0:17792:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:1.0:1788835212.558939:0:17792:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdf60171e5a5d2d41 00000020:01000004:1.0:1788835212.558949:0:17792:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0001 on device /dev/mapper/mds2_flakey 00000020:01000004:1.0:1788835212.558976:0:17792:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.122@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1788835212.558979:0:17792:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1788835212.558986:0:17792:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0001 00000020:01000004:1.0:1788835212.559018:0:17792:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/mds2_flakey 10000000:01000000:1.0:1788835212.559023:0:17792:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-MDT0001-osd for locked: rc = 0 00000040:01000000:2.0:1788835212.584928:0:17792:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788835212.584983:0:17792:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0001, fs=lustre, 192.168.203.122@tcp, index=0001, flags=0x20001 00000020:01000004:2.0:1788835212.584994:0:17792:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788835212.584996:0:17792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788835212.584997:0:17792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788835212.584998:0:17792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788835212.585000:0:17792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788835212.585001:0:17792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788835212.585003:0:17792:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788835212.585004:0:17792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788835212.585006:0:17792:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788835212.585010:0:17792:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x10020001 00000020:01000004:2.0:1788835212.585013:0:17792:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788835212.585014:0:17792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788835212.585015:0:17792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788835212.585016:0:17792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788835212.585017:0:17792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788835212.585018:0:17792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788835212.585019:0:17792:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788835212.585020:0:17792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788835212.585021:0:17792:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788835212.585055:0:17792:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:2.0:1788835212.585084:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254093568:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788835212.585179:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835212.585362:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8109b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788835212.585690:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254093568 00000100:00100000:3.0:1788835212.585701:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254093568 00000100:00100000:3.0:1788835212.585802:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1788835212.585814:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+12:17792:x1875729254093568:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788835212.585870:0:17055:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1788835212.585873:0:17055:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0001 is running on 0@lo 20000000:01000000:3.0:1788835212.585883:0:17055:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 00000100:00100000:3.0:1788835212.589001:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+12:17792:x1875729254093568:12345-0@lo:253:mount.lustre.0 Request processed in 3179us (3811us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835212.589016:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788835212.589584:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254093568:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788835212.589601:0:17792:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:2.0:1788835212.589604:0:17792:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788835212.589606:0:17792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:2.0:1788835212.589607:0:17792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788835212.589609:0:17792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788835212.589610:0:17792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788835212.589611:0:17792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788835212.589612:0:17792:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1788835212.589614:0:17792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788835212.589615:0:17792:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788835212.589636:0:17792:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9afd87f3f800 from lustre-MDT0001 10000000:01000000:2.0:1788835212.589667:0:17792:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0001 from 0 10000000:01000000:2.0:1788835212.589670:0:17792:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0001-0000000000000000 10000000:01000000:2.0:1788835212.589689:0:17792:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9afdbf93b370 local copy 00010000:00010000:2.0:1788835212.589701:0:17792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374d000/0xdf60171e5a5d2c37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2c3e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835212.589808:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254093696:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788835212.589850:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835212.589888:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8109bd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788835212.590467:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254093696 00000100:00100000:0.0:1788835212.590475:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254093696 00000100:00100000:0.0:1788835212.590534:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1788835212.590544:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+12:17792:x1875729254093696:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788835212.590634:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+12:17792:x1875729254093696:12345-0@lo:501:mount.lustre.0 Request processed in 92us (784us total) trans 0 rc -2/-2 00000100:00100000:0.0:1788835212.590641:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1788835212.590724:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254093696:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788835212.590737:0:17792:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1788835212.590756:0:17792:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788835212.590762:0:17792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374d000/0xdf60171e5a5d2c37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2c3e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835212.590771:0:17792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afc8374d000/0xdf60171e5a5d2c37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2c3e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835212.590797:0:17792:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9afd87f3f800 10000000:01000000:2.0:1788835212.590802:0:17792:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788835212.590807:0:17792:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9afdbf93b370 10000000:01000000:2.0:1788835212.590809:0:17792:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1788835212.590812:0:17792:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9afdbf93b370 from 1 10000000:01000000:2.0:1788835212.590815:0:17792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1788835212.590838:0:17792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d2d48 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835212.590846:0:17792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d2d48 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835212.590856:0:17792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d2d48 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835212.590879:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254093824:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788835212.590903:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835212.590985:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8109bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1788835212.591019:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254093824 00000100:00100000:3.0:1788835212.591023:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254093824 00000100:00100000:3.0:1788835212.591082:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1788835212.591090:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86964050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+12:17792:x1875729254093824:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788835212.591099:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835212.591114:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd884aac00/0xdf60171e5a5d2d4f lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2d48 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835212.591136:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd884aac00/0xdf60171e5a5d2d4f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2d48 expref: 13 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835212.591147:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd884aac00/0xdf60171e5a5d2d4f lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2d48 expref: 13 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835212.591156:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884aac00, rc 0) 00000100:00100000:3.0:1788835212.591283:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86964050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+13:17792:x1875729254093824:12345-0@lo:101:mount.lustre.0 Request processed in 193us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835212.591289:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1788835212.591361:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254093824:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788835212.591374:0:17792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d2d48 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2d4f expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.591384:0:17792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d2d48 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2d4f expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788835212.591400:0:17792:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1788835212.591413:0:17792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d2d48 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2d4f expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.591420:0:17792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afc8374d600/0xdf60171e5a5d2d48 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2d4f expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788835212.591443:0:17792:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9afd87f3f800 10000000:01000000:0.0:1788835212.591447:0:17792:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1788835212.591450:0:17792:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9afd87f3f800 from 1 10000000:01000000:0.0:1788835212.591452:0:17792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1788835212.591468:0:17792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f4000/0xdf60171e5a5d2d56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.591474:0:17792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd866f4000/0xdf60171e5a5d2d56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.591481:0:17792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd866f4000/0xdf60171e5a5d2d56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835212.591492:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254093952:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788835212.591569:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835212.591598:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd86002e40 going to sleep for 11 seconds 00000100:00100000:1.0:1788835212.591686:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254093952 00000100:00100000:1.0:1788835212.591699:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254093952 00000100:00100000:2.0:1788835212.591807:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1788835212.591819:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86965450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+13:17792:x1875729254093952:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788835212.591827:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835212.591837:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afc8374dc00/0xdf60171e5a5d2d5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2d56 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835212.591852:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afc8374dc00/0xdf60171e5a5d2d5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2d56 expref: 14 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835212.591860:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afc8374dc00/0xdf60171e5a5d2d5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2d56 expref: 14 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835212.591867:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374dc00, rc 0) 00000100:00100000:2.0:1788835212.591906:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86965450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+14:17792:x1875729254093952:12345-0@lo:101:mount.lustre.0 Request processed in 91us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835212.591913:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788835212.592021:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254093952:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788835212.592034:0:17792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd866f4000/0xdf60171e5a5d2d56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2d5d expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.592041:0:17792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd866f4000/0xdf60171e5a5d2d56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2d5d expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788835212.592052:0:17792:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1788835212.592067:0:17792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f4000/0xdf60171e5a5d2d56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2d5d expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.592074:0:17792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd866f4000/0xdf60171e5a5d2d56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2d5d expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788835212.592092:0:17792:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0001-0000000000000000 10000000:01000000:0.0:1788835212.592095:0:17792:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788835212.592100:0:17792:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9afd87f3f800 10000000:01000000:0.0:1788835212.592102:0:17792:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1788835212.592105:0:17792:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0001-0000000000000000 from 1 10000000:01000000:0.0:1788835212.592107:0:17792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0001 (res 0x65727473756c) 00010000:00010000:0.0:1788835212.592555:0:17792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f4c00/0xdf60171e5a5d2d64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.592564:0:17792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd866f4c00/0xdf60171e5a5d2d64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.592572:0:17792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd866f4c00/0xdf60171e5a5d2d64 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835212.592582:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254094080:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788835212.592606:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835212.592633:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd86002e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788835212.592688:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254094080 00000100:00100000:3.0:1788835212.592750:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254094080 00000100:00100000:3.0:1788835212.592818:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788835212.592824:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+14:17792:x1875729254094080:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788835212.592830:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835212.592838:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd884ab400/0xdf60171e5a5d2d6b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2d64 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835212.592850:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd884ab400/0xdf60171e5a5d2d6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2d64 expref: 15 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835212.592856:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd884ab400/0xdf60171e5a5d2d6b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2d64 expref: 15 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835212.592861:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884ab400, rc 0) 00000100:00100000:3.0:1788835212.592897:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+15:17792:x1875729254094080:12345-0@lo:101:mount.lustre.0 Request processed in 73us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835212.592903:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1788835212.592967:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254094080:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788835212.592978:0:17792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd866f4c00/0xdf60171e5a5d2d64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2d6b expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.592986:0:17792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd866f4c00/0xdf60171e5a5d2d64 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2d6b expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788835212.594786:0:17792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 25 count 25 00000040:00080000:0.0:1788835212.596173:0:17792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788835212.604184:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788835212.604483:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 136 off8552 00000040:00080000:0.0:1788835212.604502:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 176 off8728 00000040:00080000:0.0:1788835212.604514:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8952 00000040:00080000:0.0:1788835212.604526:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9176 00000040:00080000:0.0:1788835212.604538:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 120 off9296 00000040:00080000:0.0:1788835212.604550:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 112 off9408 00000040:00080000:0.0:1788835212.604564:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 160 off9568 00000040:00080000:0.0:1788835212.604575:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9792 00000040:00080000:0.0:1788835212.604585:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10016 00000040:00080000:0.0:1788835212.604596:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 88 off10104 00000040:00080000:0.0:1788835212.604608:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 144 off10248 00000040:00080000:0.0:1788835212.604621:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 152 off10400 00000040:00080000:0.0:1788835212.604634:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].14, 168 off10568 00000040:00080000:0.0:1788835212.604647:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].15, 224 off10792 00000040:00080000:0.0:1788835212.604663:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].16, 224 off11016 00000040:00080000:0.0:1788835212.604678:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].17, 80 off11096 00000040:00080000:0.0:1788835212.604693:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].18, 224 off11320 00000040:00080000:0.0:1788835212.604718:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].19, 224 off11544 00000040:00080000:0.0:1788835212.604738:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].20, 160 off11704 00000040:00080000:0.0:1788835212.604753:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].21, 224 off11928 00000040:00080000:0.0:1788835212.604767:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].22, 224 off12152 00000040:00080000:0.0:1788835212.604779:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].23, 80 off12232 00000040:00080000:0.0:1788835212.604809:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].24, 224 off12456 00000040:00080000:0.0:1788835212.604814:0:17792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 24 count 25 00000100:00100000:0.0:1788835212.604946:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254094208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788835212.605030:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835212.615564:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254094208 00000100:00100000:1.0:1788835212.615585:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254094208 00000100:00100000:1.0:1788835212.615680:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788835212.615693:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+15:17792:x1875729254094208:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788835212.616119:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+15:17792:x1875729254094208:12345-0@lo:501:mount.lustre.0 Request processed in 427us (11087us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835212.616129:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1788835212.616365:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd86002a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788835212.616398:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254094208:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788835212.616462:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254094336:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788835212.616526:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835212.616574:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd86002a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788835212.616924:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254094336 00000100:00100000:3.0:1788835212.616931:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254094336 00000100:00100000:3.0:1788835212.618436:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788835212.618466:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+15:17792:x1875729254094336:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788835212.621633:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+15:17792:x1875729254094336:12345-0@lo:503:mount.lustre.0 Request processed in 3169us (5092us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835212.621651:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1788835212.621784:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254094336:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788835212.622408:0:17792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788835212.622509:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254094464:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788835212.622577:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835212.623190:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd86002e40 going to sleep for 11 seconds 00000100:00100000:2.0:1788835212.624701:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254094464 00000100:00100000:2.0:1788835212.624728:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254094464 00000100:00100000:2.0:1788835212.625065:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788835212.625077:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+15:17792:x1875729254094464:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788835212.628084:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+15:17792:x1875729254094464:12345-0@lo:502:mount.lustre.0 Request processed in 2994us (5492us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835212.628102:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1788835212.628406:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254094464:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788835212.628685:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788835212.628719:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 136 off8552 00000040:00080000:0.0:1788835212.628733:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 176 off8728 00000040:00080000:0.0:1788835212.628746:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8952 00000040:00080000:0.0:1788835212.628759:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9176 00000040:00080000:0.0:1788835212.628771:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9296 00000040:00080000:0.0:1788835212.628784:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 112 off9408 00000040:00080000:0.0:1788835212.628796:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 160 off9568 00000040:00080000:0.0:1788835212.628809:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9792 00000040:00080000:0.0:1788835212.628822:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off10016 00000040:00080000:0.0:1788835212.628835:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 88 off10104 00000040:00080000:0.0:1788835212.628849:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 144 off10248 00000040:00080000:0.0:1788835212.628863:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 152 off10400 00000040:00080000:0.0:1788835212.628877:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 168 off10568 00000040:00080000:0.0:1788835212.628890:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 224 off10792 00000040:00080000:0.0:1788835212.628904:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 224 off11016 00000040:00080000:0.0:1788835212.628919:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 80 off11096 00000040:00080000:0.0:1788835212.628933:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11320 00000040:00080000:0.0:1788835212.628945:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 224 off11544 00000040:00080000:0.0:1788835212.628961:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 160 off11704 00000040:00080000:0.0:1788835212.628973:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11928 00000040:00080000:0.0:1788835212.628987:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 224 off12152 00000040:00080000:0.0:1788835212.629001:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 80 off12232 00000040:00080000:0.0:1788835212.629027:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 224 off12456 00000040:00080000:0.0:1788835212.629041:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 224 off12680 00000040:00080000:0.0:1788835212.629053:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 88 off12768 00000040:00080000:0.0:1788835212.629064:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 144 off12912 00000040:00080000:0.0:1788835212.629076:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 152 off13064 00000040:00080000:0.0:1788835212.629091:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 136 off13200 00000040:00080000:0.0:1788835212.629105:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13424 00000040:00080000:0.0:1788835212.629115:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 224 off13648 00000040:00080000:0.0:1788835212.629127:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 80 off13728 00000040:00080000:0.0:1788835212.629139:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 224 off13952 00000040:00080000:0.0:1788835212.629152:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 224 off14176 00000040:00080000:0.0:1788835212.629165:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 88 off14264 00000040:00080000:0.0:1788835212.629176:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 144 off14408 00000040:00080000:0.0:1788835212.629190:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 152 off14560 00000040:00080000:0.0:1788835212.629205:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 136 off14696 00000040:00080000:0.0:1788835212.629219:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14920 00000040:00080000:0.0:1788835212.629231:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 224 off15144 00000040:00080000:0.0:1788835212.629243:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 80 off15224 00000040:00080000:0.0:1788835212.629272:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 224 off15448 00000040:00080000:0.0:1788835212.629287:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 224 off15672 00000040:00080000:0.0:1788835212.629311:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 120 off15792 00000100:00100000:0.0:1788835212.629396:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254094592:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788835212.629473:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835212.629518:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd86002e40 going to sleep for 11 seconds 00000100:00100000:3.0:1788835212.629715:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254094592 00000100:00100000:3.0:1788835212.629723:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254094592 00000100:00100000:3.0:1788835212.629770:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1788835212.629779:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+15:17792:x1875729254094592:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788835212.629926:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+15:17792:x1875729254094592:12345-0@lo:502:mount.lustre.0 Request processed in 147us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835212.629935:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788835212.630460:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254094592:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788835212.630529:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off16016 00000040:00080000:0.0:1788835212.630540:0:17792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 45 count 46 00000020:01000000:3.0:1788835212.631566:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788835212.631582:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835212.631585:0:17796:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788835212.631594:0:17796:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0001) 00000020:00000080:3.0:1788835212.631597:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788835212.631615:0:17796:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-mdtlov (ffff9afc823719b8) 00000020:00000080:3.0:1788835212.631639:0:17796:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type lod with refcount 2 00000020:00000080:3.0:1788835212.631645:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1788835212.631815:0:17796:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:3.0:1788835212.631825:0:17796:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdf60171e5a5d2d79 00000020:00000080:3.0:1788835212.632084:0:17796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-mdtlov (uuid lustre-MDT0001-mdtlov_UUID) 00000020:01000000:3.0:1788835212.632090:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1788835212.632094:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835212.632095:0:17796:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-MDT0001-m lov setup 00000020:01000000:3.0:1788835212.632098:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1788835212.632103:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1788835212.632104:0:17796:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-MDT0001 add mdt 00000020:00000080:3.0:1788835212.632107:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1788835212.632116:0:17796:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001 (ffff9afc82370000) 00000020:00000080:3.0:1788835212.632126:0:17796:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type mdt with refcount 2 00000020:00000080:3.0:1788835212.632130:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1788835212.632132:0:17796:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0001 osc lustre-MDT0001-mdtlov mdc (null) 00000020:01000000:3.0:1788835212.632135:0:17796:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0001 00000020:00000080:3.0:1788835212.632141:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1788835212.632619:0:17796:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afd87f3f800 from lustre-MDT0001, refs=2 00000020:00000080:3.0:1788835212.632642:0:17796:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0001 (ffff9afdbd4399b8) 00000020:00000080:3.0:1788835212.632654:0:17796:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type mdd with refcount 2 00000004:01000000:3.0:1788835212.633138:0:17796:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1788835212.633155:0:17796:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdf60171e5a5d2d8e 00000020:00000080:3.0:1788835212.633436:0:17796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0001 (uuid lustre-MDD0001_UUID) 00000004:01000000:3.0:1788835212.633445:0:17796:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1788835212.633453:0:17796:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0001_UUID, cookie 0xdf60171e5a5d2d95 00080000:01000000:3.0:1788835212.633461:0:17796:0:(osd_handler.c:8925:osd_obd_connect()) connect #2 00000020:00000080:3.0:1788835212.633466:0:17796:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdf60171e5a5d2d9c 00010000:00010000:2.0:1788835212.781049:0:17796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0001_UUID-2 is initialized 00000001:00000004:2.0:1788835212.783311:0:17796:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 4294967301 00000001:00080000:2.0:1788835212.783900:0:17796:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1788835212.786047:0:17796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001 (uuid lustre-MDT0001_UUID) 00000020:01000000:2.0:1788835212.786065:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788835212.786074:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.786076:0:17796:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-MDT0001 add mdt 00000020:01000000:2.0:1788835212.786080:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788835212.786088:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.786089:0:17796:0:(obd_config.c:1563:class_process_config()) marker 13 (0x1) lustre-MDT0000 add osp 00000020:00000080:2.0:1788835212.786093:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788835212.786099:0:17796:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:00000080:2.0:1788835212.786134:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788835212.786170:0:17796:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osp-MDT0001 (ffff9afdb2edcd28) 00000020:00000080:2.0:1788835212.786198:0:17796:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type osp with refcount 2 00000020:00000080:2.0:1788835212.786204:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788835212.786297:0:17796:0:(osp_dev.c:1203:osp_init0()) lustre-MDT0000-osp-MDT0001: connect to lustre-MDT0001-osd (lustre-MDT0000-osp-MDT0001) 00080000:01000000:2.0:1788835212.786335:0:17796:0:(osd_handler.c:8925:osd_obd_connect()) connect #3 00000020:00000080:2.0:1788835212.786344:0:17796:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdf60171e5a5d2daa 00010000:00080000:2.0:1788835212.786384:0:17796:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afd8b757800@lustre-MDT0000-osp-MDT0001: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1788835212.788514:0:17796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-osp-MDT0001-5 is initialized 00000020:00000080:2.0:1788835212.792084:0:17796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osp-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788835212.792104:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf014 00000004:01000000:2.0:1788835212.792150:0:17796:0:(lod_lov.c:128:lod_add_device()) osp:lustre-MDT0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788835212.792179:0:17796:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdf60171e5a5d2db1 00000100:00080000:2.0:1788835212.792193:0:17796:0:(import.c:510:import_select_connection()) lustre-MDT0000-osp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788835212.792199:0:17796:0:(import.c:624:import_select_connection()) lustre-MDT0000-osp-MDT0001: import ffff9afd8b757800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788835212.793011:0:17796:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbf9b9c00 x1875729254094720/t0(0) o38->lustre-MDT0000-osp-MDT0001@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788835212.793096:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254094720:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788835212.793190:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835212.793344:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254094720 00000100:00100000:1.0:1788835212.793354:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254094720 00000100:00100000:1.0:1788835212.793400:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788835212.793409:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:0+-99:3613:x1875729254094720:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788835212.793437:0:17065:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:1.0:1788835212.793479:0:17065:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdf60171e5a5d2db8 00000004:00100000:1.0:1788835212.793497:0:17065:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788835212.793504:0:17065:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1788835212.793692:0:17796:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-MDT0000_UUID 00000020:01000000:2.0:1788835212.793812:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788835212.793819:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.793822:0:17796:0:(obd_config.c:1563:class_process_config()) marker 13 (0x2) lustre-MDT0000 add osp 00000020:01000000:2.0:1788835212.793825:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788835212.793828:0:17796:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:2.0:1788835212.793829:0:17796:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788835212.793831:0:17796:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788835212.793833:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788835212.793836:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.793837:0:17796:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788835212.793840:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788835212.793845:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.793846:0:17796:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre-MDT0001 mdt.identity_upcall 00000020:00000080:2.0:1788835212.793851:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1788835212.793899:0:17796:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0001: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1788835212.793913:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788835212.793916:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.793918:0:17796:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre-MDT0001 mdt.identity_upcall 00000020:01000000:2.0:1788835212.793920:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788835212.793922:0:17796:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #18 00000020:01000000:2.0:1788835212.793923:0:17796:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788835212.793925:0:17796:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788835212.793926:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788835212.793929:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.793931:0:17796:0:(obd_config.c:1563:class_process_config()) marker 18 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788835212.793933:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788835212.793936:0:17796:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788835212.793939:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.793940:0:17796:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1788835212.793943:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788835212.793947:0:17796:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:2.0:1788835212.793972:0:17796:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788835212.793975:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788835212.793999:0:17796:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0001 (ffff9afdb2ed99b8) 00000020:00000080:2.0:1788835212.794014:0:17796:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1788835212.794021:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788835212.794097:0:17796:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0000-osc-MDT0001) 00080000:01000000:2.0:1788835212.794104:0:17796:0:(osd_handler.c:8925:osd_obd_connect()) connect #4 00000020:00000080:2.0:1788835212.794110:0:17796:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdf60171e5a5d2dc6 00000100:00080000:1.0:1788835212.795693:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1788835212.795705:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:1.0:1788835212.795710:0:8:0:(import.c:65:import_set_state_nolock()) ffff9afdbf96e800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1788835212.795719:0:8:0:(import.c:510:import_select_connection()) lustre-MDT0001-osp-MDT0000: connect to NID 0@lo last attempt 452 00000100:00080000:1.0:1788835212.795726:0:8:0:(import.c:589:import_select_connection()) lustre-MDT0001-osp-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1788835212.795734:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9afdbf96e800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788835212.795783:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbfb93800 x1875729254094848/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00010000:00080000:2.0:1788835212.795846:0:17796:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afc830f8000@lustre-OST0000-osc-MDT0001: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1788835212.796128:0:17796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0001-6 is initialized 00000100:00100000:0.0:1788835212.799346:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254094848:0@lo:38:kworker.0 00000100:00100000:0.0:1788835212.799478:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835212.799733:0:17066:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:2.0:1788835212.799746:0:17066:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:2.0:1788835212.799916:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254094848 00000100:00100000:2.0:1788835212.799926:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254094848 00000100:00100000:2.0:1788835212.800049:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788835212.800058:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3613:x1875729254094848:12345-0@lo:38:kworker.0 00000100:00100000:2.0:1788835212.800137:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3613:x1875729254094848:12345-0@lo:38:kworker.0 Request processed in 78us (659us total) trans 0 rc -11/-11 00000100:00100000:2.0:1788835212.800145:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788835212.800205:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-osp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788835212.800215:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdbf96e800 lustre-MDT0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1788835212.800219:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1788835212.800223:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb93800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254094848:0@lo:38:kworker.0 00000040:01000000:0.0:1788835212.800956:0:17796:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788835212.801510:0:17796:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0001 ctxt 2 is initialized 00000100:00080000:1.0:1788835212.803368:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788835212.803391:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788835212.803394:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788835212.803397:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788835212.803480:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254094976:0@lo:400:kworker.0 00000100:00100000:1.0:1788835212.803567:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835212.803649:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254094976 00000100:00100000:1.0:1788835212.803659:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254094976 00000100:00100000:1.0:1788835212.803714:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788835212.803723:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254094976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835212.803787:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254094976:12345-0@lo:400:kworker.0 Request processed in 64us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835212.803795:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1788835212.803847:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9afdbfb92680 x1875729254094976/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835212.803863:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254094976:0@lo:400:kworker.0 00000040:00080000:1.0:1788835212.806932:0:17796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788835212.807166:0:17796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000100:00080000:3.0:1788835212.807890:0:17065:0:(import.c:65:import_set_state_nolock()) ffff9afdb90c5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788835212.808021:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+6:3613:x1875729254094720:12345-0@lo:38:llog_process_th.0 Request processed in 14609us (14828us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835212.808040:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788835212.808344:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-osp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788835212.808356:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-osp-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788835212.808377:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-osp-MDT0001: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788835212.808384:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788835212.808387:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afd8b757800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788835212.808401:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254094720:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788835212.808477:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254095104:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788835212.808523:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:1.0:1788835212.808757:0:17796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 64 off8256 00000100:00100000:2.0:1788835212.809099:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254095104 00000100:00100000:2.0:1788835212.809107:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254095104 00000100:00100000:2.0:1788835212.809158:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788835212.809169:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3614:x1875729254095104:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788835212.809204:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788835212.809274:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+6:3614:x1875729254095104:12345-0@lo:41:osp-pre-0-1.0 Request processed in 106us (750us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835212.809282:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788835212.809687:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254095104:0@lo:41:osp-pre-0-1.0 00000040:00080000:0.0:1788835212.809841:0:17802:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788835212.809847:0:17802:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1788835212.813638:0:17796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788835212.813659:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788835212.813730:0:17796:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1788835212.813759:0:17796:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdf60171e5a5d2dcd 00000100:00080000:2.0:1788835212.813771:0:17796:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788835212.813778:0:17796:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9afc830f8000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788835212.813825:0:17796:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbf9bad80 x1875729254095232/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788835212.813856:0:17796:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1788835212.813918:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788835212.813922:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.813924:0:17796:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1788835212.813928:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1788835212.813931:0:17796:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #25 00000020:01000000:2.0:1788835212.813932:0:17796:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788835212.813934:0:17796:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1788835212.813936:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1788835212.813938:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.813939:0:17796:0:(obd_config.c:1563:class_process_config()) marker 25 (0x6) lustre sys.timeout 00000020:01000000:2.0:1788835212.813942:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1788835212.813948:0:17796:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/mds2_flakey 00000020:00000080:2.0:1788835212.813951:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.813953:0:17796:0:(obd_config.c:1563:class_process_config()) marker 31 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1788835212.813955:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1788835212.813960:0:17796:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.122@tcp to nid 0x20000c0a8cb7a (192.168.203.122@tcp) 00000020:01000000:2.0:1788835212.813988:0:17796:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0001) 00000020:00000080:2.0:1788835212.813991:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1788835212.814005:0:17796:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0001 (ffff9afdb2ed8000) 00000020:00000080:2.0:1788835212.814019:0:17796:0:(obd_config.c:720:class_attach_name()) OBD: dev 18 attached type osp with refcount 2 00000020:00000080:2.0:1788835212.814023:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1788835212.814109:0:17796:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0001: connect to lustre-MDT0001-osd (lustre-OST0001-osc-MDT0001) 00080000:01000000:2.0:1788835212.814123:0:17796:0:(osd_handler.c:8925:osd_obd_connect()) connect #5 00000020:00000080:2.0:1788835212.814128:0:17796:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-osd_UUID, cookie 0xdf60171e5a5d2ddb 00010000:00080000:2.0:1788835212.814171:0:17796:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afc830ff800@lustre-OST0001-osc-MDT0001: add connection 192.168.203.122@tcp at head 00010000:00010000:2.0:1788835212.814409:0:17796:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0001-7 is initialized 00000040:01000000:2.0:1788835212.814493:0:17796:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1788835212.814511:0:17796:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0001 ctxt 2 is initialized 00000100:00100000:1.0:1788835212.815966:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254095232:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788835212.816059:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875729254095232 offset 0 length 520: 4 00000100:00080000:1.0:1788835212.816140:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788835212.816145:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788835212.816156:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788835212.816160:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:2.0:1788835212.818200:0:17796:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788835212.818737:0:17796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:2.0:1788835212.818904:0:17796:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:0.0:1788835212.819544:0:17804:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1788835212.819550:0:17804:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1788835212.820258:0:17796:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0001 (uuid lustre-MDT0001-mdtlov_UUID) 00000020:00000080:2.0:1788835212.820274:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1788835212.820357:0:17796:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1788835212.820494:0:17796:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdf60171e5a5d2de2 00000100:00080000:2.0:1788835212.820509:0:17796:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1788835212.820515:0:17796:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9afc830ff800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788835212.820559:0:17796:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbf9b8000 x1875729254095360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788835212.820623:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254095360:0@lo:8:llog_process_th.0 00000400:00000100:1.0:1788835212.820691:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875729254095360 offset 0 length 520: 4 00000100:00080000:2.0:1788835212.820765:0:17796:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1788835212.820831:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788835212.820836:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.820838:0:17796:0:(obd_config.c:1563:class_process_config()) marker 31 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1788835212.820842:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788835212.820846:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.820847:0:17796:0:(obd_config.c:1563:class_process_config()) marker 33 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788835212.820850:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788835212.820852:0:17796:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788835212.820855:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788835212.820857:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.820858:0:17796:0:(obd_config.c:1563:class_process_config()) marker 33 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788835212.820861:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788835212.820863:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.820874:0:17796:0:(obd_config.c:1563:class_process_config()) marker 38 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788835212.820879:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788835212.820911:0:17796:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788835212.820914:0:17796:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.820915:0:17796:0:(obd_config.c:1563:class_process_config()) marker 38 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788835212.820918:0:17796:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 46 count 46 00000020:01000000:2.0:1788835212.820996:0:17792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0001 gen 1-45 (rc=0) 10000000:01000000:2.0:1788835212.821031:0:17792:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-MDT0001' succeeded (0). 00010000:00010000:2.0:1788835212.821048:0:17792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f4c00/0xdf60171e5a5d2d64 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2d6b expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835212.821062:0:17792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd866f4c00/0xdf60171e5a5d2d64 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2d6b expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835212.821071:0:17792:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afd87f3f800 from 1 10000000:01000000:2.0:1788835212.821074:0:17792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1788835212.821102:0:17792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2de9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835212.821110:0:17792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2de9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835212.821123:0:17792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2de9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835212.821139:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254095488:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788835212.821183:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835212.821213:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb7207d80 going to sleep for 11 seconds 00000100:00080000:0.0:1788835212.821406:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788835212.821412:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788835212.821415:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788835212.821418:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788835212.821621:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254095488 00000100:00100000:3.0:1788835212.821630:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254095488 00000100:00100000:3.0:1788835212.821692:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1788835212.821702:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+15:17792:x1875729254095488:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788835212.821717:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835212.821732:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd884aa000/0xdf60171e5a5d2df0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2de9 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835212.821760:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd884aa000/0xdf60171e5a5d2df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2de9 expref: 16 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835212.821772:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd884aa000/0xdf60171e5a5d2df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2de9 expref: 16 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835212.821781:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884aa000, rc 0) 00000100:00100000:3.0:1788835212.821878:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+16:17792:x1875729254095488:12345-0@lo:101:mount.lustre.0 Request processed in 176us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835212.821884:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1788835212.822057:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254095488:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788835212.822073:0:17792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2de9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2df0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.822083:0:17792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2de9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2df0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835212.823141:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254095616:0@lo:256:mount.lustre.0 00000100:00100000:0.0:1788835212.823203:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835212.823435:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd86002cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1788835212.823877:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254095616 00000100:00100000:1.0:1788835212.823885:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254095616 00000100:00100000:1.0:1788835212.823976:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788835212.823987:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+16:17792:x1875729254095616:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1788835212.824009:0:17053:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1788835212.824030:0:17053:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788835212.824033:0:17053:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1788835212.824147:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+16:17792:x1875729254095616:12345-0@lo:256:mount.lustre.0 Request processed in 162us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835212.824155:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1788835212.824225:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254095616:0@lo:256:mount.lustre.0 10000000:01000000:0.0:1788835212.824952:0:17792:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1788835212.824973:0:17792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2de9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2df0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.824986:0:17792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2de9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2df0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788835212.824995:0:17792:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afd87f3f800 from 1 10000000:01000000:0.0:1788835212.824998:0:17792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1788835212.825032:0:17792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f5c00/0xdf60171e5a5d2df7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.825040:0:17792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd866f5c00/0xdf60171e5a5d2df7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.825051:0:17792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd866f5c00/0xdf60171e5a5d2df7 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835212.825071:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254095744:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788835212.825116:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835212.825934:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd86002cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1788835212.826014:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254095744 00000100:00100000:3.0:1788835212.826022:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254095744 00000100:00100000:3.0:1788835212.826087:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788835212.826095:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+16:17792:x1875729254095744:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788835212.826110:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835212.826127:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd884ab600/0xdf60171e5a5d2dfe lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2df7 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835212.826158:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd884ab600/0xdf60171e5a5d2dfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2df7 expref: 17 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835212.826171:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd884ab600/0xdf60171e5a5d2dfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2df7 expref: 17 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835212.826181:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884ab600, rc 0) 00000100:00100000:3.0:1788835212.826239:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+17:17792:x1875729254095744:12345-0@lo:101:mount.lustre.0 Request processed in 144us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835212.826307:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1788835212.826522:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254095744:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788835212.826550:0:17792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd866f5c00/0xdf60171e5a5d2df7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2dfe expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.826561:0:17792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd866f5c00/0xdf60171e5a5d2df7 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2dfe expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788835212.826753:0:17792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788835212.826800:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254095872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788835212.826837:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835212.826853:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd86002600 going to sleep for 11 seconds 00000100:00100000:3.0:1788835212.827105:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254095872 00000100:00100000:3.0:1788835212.827111:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254095872 00000100:00100000:3.0:1788835212.827136:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788835212.827143:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+17:17792:x1875729254095872:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788835212.827338:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+17:17792:x1875729254095872:12345-0@lo:501:mount.lustre.0 Request processed in 104us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835212.827346:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1788835212.827505:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254095872:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788835212.827535:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254096000:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788835212.827577:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835212.827599:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd86002600 going to sleep for 11 seconds 00000100:00100000:3.0:1788835212.827646:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254096000 00000100:00100000:3.0:1788835212.827650:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254096000 00000100:00100000:3.0:1788835212.827668:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1788835212.827675:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+17:17792:x1875729254096000:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788835212.827759:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+17:17792:x1875729254096000:12345-0@lo:503:mount.lustre.0 Request processed in 84us (182us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835212.827772:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1788835212.827844:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254096000:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788835212.828234:0:17792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788835212.829607:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254096128:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788835212.829684:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835212.829739:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd86002cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1788835212.829805:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254096128 00000100:00100000:2.0:1788835212.829813:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254096128 00000100:00100000:2.0:1788835212.829871:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788835212.829891:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+17:17792:x1875729254096128:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788835212.830025:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+17:17792:x1875729254096128:12345-0@lo:502:mount.lustre.0 Request processed in 135us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835212.830034:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1788835212.830114:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254096128:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788835212.830765:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1788835212.830798:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 112 off8528 00000040:00080000:2.0:1788835212.830811:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 224 off8752 00000040:00080000:2.0:1788835212.830823:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8976 00000040:00080000:2.0:1788835212.830836:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 112 off9088 00000040:00080000:2.0:1788835212.830848:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 224 off9312 00000040:00080000:2.0:1788835212.830861:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 224 off9536 00000040:00080000:2.0:1788835212.830873:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 128 off9664 00000040:00080000:2.0:1788835212.830886:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788835212.830897:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 224 off10112 00000040:00080000:2.0:1788835212.830911:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 128 off10240 00000100:00100000:2.0:1788835212.830940:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254096256:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788835212.830988:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835212.831057:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb7207540 going to sleep for 11 seconds 00000100:00100000:1.0:1788835212.831095:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254096256 00000100:00100000:1.0:1788835212.831101:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254096256 00000100:00100000:1.0:1788835212.831182:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788835212.831190:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+17:17792:x1875729254096256:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788835212.831351:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+17:17792:x1875729254096256:12345-0@lo:502:mount.lustre.0 Request processed in 161us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835212.831358:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1788835212.831519:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9ba680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254096256:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788835212.831567:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10464 00000040:00080000:2.0:1788835212.831575:0:17792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:2.0:1788835212.832408:0:17806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788835212.832421:0:17806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.832424:0:17806:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1788835212.832435:0:17806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afd87f3f800 00000020:00000080:2.0:1788835212.832438:0:17806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788835212.832448:0:17806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788835212.832456:0:17806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.832458:0:17806:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1788835212.832461:0:17806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788835212.832464:0:17806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.832465:0:17806:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1788835212.832469:0:17806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afd87f3f800 00000020:00000080:2.0:1788835212.832471:0:17806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788835212.832533:0:17806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788835212.832536:0:17806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.832537:0:17806:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1788835212.832541:0:17806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788835212.832543:0:17806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.832545:0:17806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788835212.832549:0:17806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afd87f3f800 00000020:00000080:2.0:1788835212.832551:0:17806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788835212.832566:0:17806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788835212.832569:0:17806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.832570:0:17806:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1788835212.832572:0:17806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788835212.832575:0:17806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.832576:0:17806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:2.0:1788835212.832579:0:17806:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afd87f3f800 00000020:00000080:2.0:1788835212.832581:0:17806:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1788835212.832602:0:17806:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788835212.832606:0:17806:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835212.832607:0:17806:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:2.0:1788835212.832610:0:17806:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 13 count 13 00000020:01000000:0.0:1788835212.844742:0:17792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788835212.844806:0:17792:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788835212.846401:0:17792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f5c00/0xdf60171e5a5d2df7 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2dfe expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.846421:0:17792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd866f5c00/0xdf60171e5a5d2df7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2dfe expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788835212.846518:0:17792:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788835212.846522:0:17792:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9afd87f3f800 10000000:01000000:0.0:1788835212.846525:0:17792:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9afd87f3f800 10000000:01000000:0.0:1788835212.846530:0:17792:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788835212.846539:0:17792:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afd87f3f800 from 1 10000000:01000000:0.0:1788835212.846542:0:17792:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788835212.846590:0:17792:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f5200/0xdf60171e5a5d2e05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.846598:0:17792:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd866f5200/0xdf60171e5a5d2e05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.846611:0:17792:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd866f5200/0xdf60171e5a5d2e05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835212.846643:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254096384:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788835212.846728:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835212.846793:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254096384 00000100:00100000:0.0:1788835212.846802:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254096384 00000100:00100000:0.0:1788835212.846858:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788835212.846868:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+17:17792:x1875729254096384:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788835212.846885:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835212.846900:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd866f5000/0xdf60171e5a5d2e0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2e05 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.846928:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd866f5000/0xdf60171e5a5d2e0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2e05 expref: 18 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.846952:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd866f5000/0xdf60171e5a5d2e0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2e05 expref: 18 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.846962:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5000, rc 0) 00000100:00100000:0.0:1788835212.846999:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+18:17792:x1875729254096384:12345-0@lo:101:mount.lustre.0 Request processed in 131us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835212.847007:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1788835212.847057:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82cc29c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788835212.847082:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254096384:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788835212.847097:0:17792:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd866f5200/0xdf60171e5a5d2e05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2e0c expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.847108:0:17792:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd866f5200/0xdf60171e5a5d2e05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2e0c expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788835212.850866:0:17792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1788835212.853614:0:17792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788835212.853915:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].1, 224 off8416 00000040:00080000:0.0:1788835212.853941:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].2, 120 off8536 00000040:00080000:0.0:1788835212.853953:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].3, 168 off8704 00000040:00080000:0.0:1788835212.853966:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].4, 224 off8928 00000040:00080000:0.0:1788835212.853978:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].5, 224 off9152 00000040:00080000:0.0:1788835212.853990:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].6, 120 off9272 00000040:00080000:0.0:1788835212.854002:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].7, 168 off9440 00000040:00080000:0.0:1788835212.854017:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].8, 224 off9664 00000040:00080000:0.0:1788835212.854028:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].9, 224 off9888 00000040:00080000:0.0:1788835212.854039:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].10, 120 off10008 00000040:00080000:0.0:1788835212.854052:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].11, 224 off10232 00000040:00080000:0.0:1788835212.854076:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].12, 224 off10456 00000040:00080000:0.0:1788835212.854103:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].13, 88 off10544 00000040:00080000:0.0:1788835212.854117:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].14, 128 off10672 00000040:00080000:0.0:1788835212.854129:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].15, 144 off10816 00000040:00080000:0.0:1788835212.854141:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].16, 160 off10976 00000040:00080000:0.0:1788835212.854154:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].17, 224 off11200 00000040:00080000:0.0:1788835212.854167:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].18, 224 off11424 00000040:00080000:0.0:1788835212.854180:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].19, 80 off11504 00000040:00080000:0.0:1788835212.854194:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].20, 224 off11728 00000040:00080000:0.0:1788835212.854208:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].21, 224 off11952 00000040:00080000:0.0:1788835212.854220:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].22, 88 off12040 00000040:00080000:0.0:1788835212.854234:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].23, 128 off12168 00000040:00080000:0.0:1788835212.856605:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].24, 144 off12312 00000040:00080000:0.0:1788835212.856684:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].25, 160 off12472 00000040:00080000:0.0:1788835212.856701:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].26, 224 off12696 00000040:00080000:0.0:1788835212.856713:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].27, 224 off12920 00000040:00080000:0.0:1788835212.856724:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].28, 80 off13000 00000040:00080000:0.0:1788835212.856774:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xb:0x0].29, 224 off13224 00000040:00080000:0.0:1788835212.856781:0:17792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1788835212.856923:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254096512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788835212.857008:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835212.857069:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82cc20c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788835212.857499:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254096512 00000100:00100000:2.0:1788835212.857508:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254096512 00000100:00100000:2.0:1788835212.857587:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788835212.857599:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+18:17792:x1875729254096512:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788835212.857762:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+18:17792:x1875729254096512:12345-0@lo:501:mount.lustre.0 Request processed in 165us (754us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835212.857779:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1788835212.860485:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254096512:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788835212.860561:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254096640:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788835212.860648:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835212.860703:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82cc20c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788835212.861039:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254096640 00000100:00100000:3.0:1788835212.861047:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254096640 00000100:00100000:3.0:1788835212.861112:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788835212.861123:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+18:17792:x1875729254096640:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788835212.861277:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+18:17792:x1875729254096640:12345-0@lo:503:mount.lustre.0 Request processed in 155us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835212.861285:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788835212.861376:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254096640:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788835212.861904:0:17792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788835212.862010:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254096768:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788835212.862060:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835212.862091:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eac840 going to sleep for 11 seconds 00000100:00100000:0.0:1788835212.867428:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254096768 00000100:00100000:0.0:1788835212.867451:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254096768 00000100:00100000:0.0:1788835212.867534:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1788835212.867546:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+18:17792:x1875729254096768:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788835212.867767:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+18:17792:x1875729254096768:12345-0@lo:502:mount.lustre.0 Request processed in 224us (5706us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835212.867776:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788835212.869719:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254096768:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788835212.870048:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].1, 224 off8416 00000040:00080000:3.0:1788835212.870083:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].2, 120 off8536 00000040:00080000:3.0:1788835212.870096:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].3, 168 off8704 00000040:00080000:3.0:1788835212.870108:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].4, 224 off8928 00000040:00080000:3.0:1788835212.870122:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].5, 224 off9152 00000040:00080000:3.0:1788835212.870135:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].6, 120 off9272 00000040:00080000:3.0:1788835212.870147:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].7, 168 off9440 00000040:00080000:3.0:1788835212.870161:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].8, 224 off9664 00000040:00080000:3.0:1788835212.870174:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].9, 224 off9888 00000040:00080000:3.0:1788835212.870187:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].10, 120 off10008 00000040:00080000:3.0:1788835212.870199:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].11, 224 off10232 00000040:00080000:3.0:1788835212.870211:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].12, 224 off10456 00000040:00080000:3.0:1788835212.870244:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].13, 88 off10544 00000040:00080000:3.0:1788835212.870267:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].14, 128 off10672 00000040:00080000:3.0:1788835212.870281:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].15, 144 off10816 00000040:00080000:3.0:1788835212.870293:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].16, 160 off10976 00000040:00080000:3.0:1788835212.871337:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].17, 224 off11200 00000040:00080000:3.0:1788835212.871572:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].18, 224 off11424 00000040:00080000:3.0:1788835212.871592:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].19, 80 off11504 00000040:00080000:3.0:1788835212.871607:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].20, 224 off11728 00000040:00080000:3.0:1788835212.871620:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].21, 224 off11952 00000040:00080000:3.0:1788835212.871634:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].22, 88 off12040 00000040:00080000:3.0:1788835212.871646:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].23, 128 off12168 00000040:00080000:3.0:1788835212.871660:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].24, 144 off12312 00000040:00080000:3.0:1788835212.871674:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].25, 160 off12472 00000040:00080000:3.0:1788835212.871688:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].26, 224 off12696 00000040:00080000:3.0:1788835212.871700:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].27, 224 off12920 00000040:00080000:3.0:1788835212.871714:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].28, 80 off13000 00000040:00080000:3.0:1788835212.871750:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].29, 224 off13224 00000040:00080000:3.0:1788835212.871766:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].30, 224 off13448 00000040:00080000:3.0:1788835212.871779:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].31, 88 off13536 00000040:00080000:3.0:1788835212.871791:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].32, 128 off13664 00000040:00080000:3.0:1788835212.871803:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].33, 144 off13808 00000040:00080000:3.0:1788835212.871817:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].34, 128 off13936 00000040:00080000:3.0:1788835212.871830:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].35, 224 off14160 00000040:00080000:3.0:1788835212.871842:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].36, 224 off14384 00000040:00080000:3.0:1788835212.871853:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].37, 80 off14464 00000040:00080000:3.0:1788835212.871866:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].38, 224 off14688 00000040:00080000:3.0:1788835212.871880:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].39, 224 off14912 00000040:00080000:3.0:1788835212.871893:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].40, 88 off15000 00000040:00080000:3.0:1788835212.871905:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].41, 128 off15128 00000040:00080000:3.0:1788835212.871917:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].42, 144 off15272 00000040:00080000:3.0:1788835212.871929:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].43, 128 off15400 00000040:00080000:3.0:1788835212.871942:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].44, 224 off15624 00000040:00080000:3.0:1788835212.871966:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].45, 224 off15848 00000040:00080000:3.0:1788835212.871981:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].46, 80 off15928 00000040:00080000:3.0:1788835212.872003:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].47, 224 off16152 00000040:00080000:3.0:1788835212.872016:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].48, 232 off16384 00000100:00100000:3.0:1788835212.872085:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254096896:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788835212.872183:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835212.872620:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eac840 going to sleep for 11 seconds 00000100:00100000:2.0:1788835212.875512:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254096896 00000100:00100000:2.0:1788835212.875531:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254096896 00000100:00100000:2.0:1788835212.875649:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1788835212.875662:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+18:17792:x1875729254096896:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788835212.875891:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+18:17792:x1875729254096896:12345-0@lo:502:mount.lustre.0 Request processed in 231us (3708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835212.875899:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788835212.880565:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254096896:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788835212.880900:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].49, 224 off16608 00000040:00080000:3.0:1788835212.880932:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].50, 120 off16728 00000100:00100000:3.0:1788835212.880980:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254097024:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788835212.881074:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835212.881138:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254097024 00000100:00100000:3.0:1788835212.881147:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254097024 00000100:00100000:3.0:1788835212.881203:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788835212.881215:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+18:17792:x1875729254097024:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788835212.884048:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+18:17792:x1875729254097024:12345-0@lo:502:mount.lustre.0 Request processed in 2825us (2963us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835212.884066:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788835212.884174:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eac840 going to sleep for 11 seconds 00000100:00100000:3.0:1788835212.884205:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254097024:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1788835212.885583:0:17792:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xc:0x0].51, 224 off16952 00000040:00080000:1.0:1788835212.885606:0:17792:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:1.0:1788835212.890625:0:17812:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0001 (typ=lwp) 00000020:00000080:1.0:1788835212.890650:0:17812:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0001 (ffff9afdab4f0000) 00000020:00000080:1.0:1788835212.890682:0:17812:0:(obd_config.c:720:class_attach_name()) OBD: dev 19 attached type lwp with refcount 2 00000020:01000004:1.0:1788835212.890833:0:17812:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afd87f3f800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788835212.890839:0:17812:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afd87f3f800 from lustre-MDT0001, refs=3 00000020:01000004:1.0:1788835212.890842:0:17812:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afd87f3f800 3 00010000:00080000:1.0:1788835212.890880:0:17812:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afdbf968000@lustre-MDT0000-lwp-MDT0001: add connection 192.168.203.122@tcp at head 00010000:00010000:1.0:1788835212.893109:0:17812:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0001-8 is initialized 00000020:00000080:1.0:1788835212.893602:0:17812:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0001 (uuid lustre-MDT0000-lwp-MDT0001_UUID) 00000010:01000000:1.0:1788835212.893657:0:17812:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1788835212.893675:0:17812:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001, cookie 0xdf60171e5a5d2e1a 00000100:00080000:1.0:1788835212.893687:0:17812:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1788835212.893695:0:17812:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0001: import ffff9afdbf968000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:1.0:1788835212.893739:0:17812:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbfb92680 x1875729254097152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788835212.893833:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875729254097152:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788835212.893918:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1788835212.893996:0:17812:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788835212.894030:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788835212.894036:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788835212.894039:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788835212.894042:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788835212.894227:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254097152 00000100:00100000:3.0:1788835212.894237:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254097152 00000100:00100000:3.0:1788835212.894292:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788835212.894309:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3613:x1875729254097152:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788835212.894360:0:17062:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0001_UUID@0@lo t0 exp 0000000000000000 cur 454 last 0 00000020:00000080:3.0:1788835212.894711:0:17062:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0001_UUID, cookie 0xdf60171e5a5d2e21 00000004:00100000:3.0:1788835212.894729:0:17062:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788835212.894774:0:17062:0:(import.c:65:import_set_state_nolock()) ffff9afdb90c7800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788835212.894972:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3613:x1875729254097152:12345-0@lo:38:llog_process_th.0 Request processed in 670us (1052us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835212.894981:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:1.0:1788835212.895530:0:17812:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xc:0x0] index 52 count 51 00000020:01000000:1.0:1788835212.895594:0:17792:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:1.0:1788835212.895633:0:17792:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1788835212.895653:0:17792:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f5200/0xdf60171e5a5d2e05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2e0c expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.895665:0:17792:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd866f5200/0xdf60171e5a5d2e05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2e0c expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1788835212.895722:0:17792:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1788835212.895729:0:17792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788835212.895730:0:17792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788835212.895731:0:17792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788835212.895733:0:17792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788835212.895734:0:17792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788835212.895736:0:17792:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788835212.895738:0:17792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788835212.895740:0:17792:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788835212.895745:0:17792:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0001 0x40020001 00000020:01000004:1.0:1788835212.895748:0:17792:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1788835212.895749:0:17792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788835212.895750:0:17792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788835212.895751:0:17792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788835212.895752:0:17792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788835212.895754:0:17792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788835212.895755:0:17792:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788835212.895756:0:17792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788835212.895757:0:17792:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1788835212.895779:0:17792:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0001 00000100:00100000:1.0:1788835212.895798:0:17792:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254097280:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1788835212.895859:0:17792:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835212.895903:0:17792:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2e0e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788835212.895932:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254097280 00000100:00100000:1.0:1788835212.895938:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254097280 00000100:00100000:1.0:1788835212.895990:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1788835212.896000:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+18:17792:x1875729254097280:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788835212.896026:0:17054:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788835212.896042:0:17054:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:2.0:1788835212.901655:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9afdbfb92680 x1875729254097152/t0(0) o38->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788835222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835212.901674:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1788835212.901688:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0001: connect to target with instance 2 00000100:00080000:2.0:1788835212.901699:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0001: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:2.0:1788835212.901705:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1788835212.901710:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdbf968000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1788835212.901718:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0001_UUID:3613:1875729254097152:0@lo:38:llog_process_th.0 00000001:00100000:0.0:1788835212.904619:0:17040:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 20000000:01000000:2.0:1788835212.904707:0:17054:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1788835212.904731:0:17054:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0001, index=1, rc=0 20000000:01000000:0.0:1788835212.904760:0:17077:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1788835212.904767:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1788835212.904790:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2e28 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.904888:0:17077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd866f5400/0xdf60171e5a5d2d2c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2d25 expref: 18 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.904907:0:17077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd884aa000/0xdf60171e5a5d2df0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2de9 expref: 18 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.904916:0:17077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2e28 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.904960:0:17077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd884aa000/0xdf60171e5a5d2df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d2de9 expref: 18 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.904976:0:17077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afd884aa000/0xdf60171e5a5d2df0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d2de9 expref: 18 pid: 17055 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835212.904991:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17077:1875729254097408:0@lo:104: 00000100:00100000:0.0:1788835212.905062:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1788835212.905126:0:17077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd866f5400/0xdf60171e5a5d2d2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d2d25 expref: 18 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835212.905136:0:17077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afd866f5400/0xdf60171e5a5d2d2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d2d25 expref: 18 pid: 17053 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835212.905157:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17077:1875729254097536:0@lo:104: 00000100:00100000:0.0:1788835212.905188:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835212.905208:0:17077:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc82368240 going to sleep for 11 seconds 00000100:00100000:1.0:1788835212.905490:0:17043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254097408 00000100:00100000:1.0:1788835212.905501:0:17043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254097408 00000100:00100000:1.0:1788835212.905551:0:17043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254097536 00000100:00100000:1.0:1788835212.905554:0:17043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254097536 00000100:00100000:1.0:1788835212.905571:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788835212.905581:0:17043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+4:17077:x1875729254097408:12345-0@lo:104: 00010000:00010000:1.0:1788835212.905599:0:17043:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2de9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2df0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.905712:0:17043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788835212.905719:0:17043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+4:17077:x1875729254097408:12345-0@lo:104: Request processed in 139us (657us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835212.905727:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788835212.905746:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788835212.905753:0:17043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+3:17077:x1875729254097536:12345-0@lo:104: 00010000:00010000:1.0:1788835212.905761:0:17043:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afc8374c600/0xdf60171e5a5d2d25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2d2c expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.905796:0:17043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788835212.905801:0:17043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+3:17077:x1875729254097536:12345-0@lo:104: Request processed in 49us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835212.905807:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1788835212.905827:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788835212.905834:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2de9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2df0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.905843:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374ce00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:1.0:1788835212.905847:0:17049:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2de9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d2df0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.905857:0:17049:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2de9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d2df0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788835212.905865:0:17049:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2de9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d2df0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788835212.905871:0:17049:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788835212.905913:0:17049:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2de9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2df0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.905920:0:17049:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788835212.905942:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2de9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2df0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.905949:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2de9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2df0 expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.905962:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788835212.905965:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afc8374c600/0xdf60171e5a5d2d25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2d2c expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.905970:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374c600 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:1.0:1788835212.905974:0:17049:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afc8374c600/0xdf60171e5a5d2d25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d2d2c expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.905981:0:17049:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afc8374c600/0xdf60171e5a5d2d25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d2d2c expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788835212.905987:0:17049:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afc8374c600/0xdf60171e5a5d2d25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d2d2c expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788835212.905992:0:17049:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788835212.906003:0:17049:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afc8374c600/0xdf60171e5a5d2d25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2d2c expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.906008:0:17049:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788835212.906022:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afc8374c600/0xdf60171e5a5d2d25 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2d2c expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.906039:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afc8374c600/0xdf60171e5a5d2d25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2d2c expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.906053:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835212.906055:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835212.906057:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835212.906063:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835212.906084:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb888812-a79c-4531-9a69-89c757e37463:3615:1875729254097664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788835212.906122:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835212.906174:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb888812-a79c-4531-9a69-89c757e37463:3616:1875729254097792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788835212.906196:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835212.906236:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254097664 00000100:00100000:1.0:1788835212.906240:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254097664 00010000:00010000:1.0:1788835212.906261:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd884aa000/0xdf60171e5a5d2df0 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2de9 expref: 19 pid: 17055 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835212.906282:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254097792 00000100:00100000:1.0:1788835212.906285:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254097792 00010000:00010000:1.0:1788835212.906296:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd866f5400/0xdf60171e5a5d2d2c lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2d25 expref: 20 pid: 17053 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835212.906666:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+20:17792:x1875729254097280:12345-0@lo:253:mount.lustre.0 Request processed in 10666us (10805us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835212.906678:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1788835212.906750:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2f480 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17077:1875729254097408:0@lo:104: 00000100:00100000:0.0:1788835212.906765:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17077:1875729254097536:0@lo:104: 00010000:00010000:0.0:1788835212.906795:0:17077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2e28 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835212.907075:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788835212.907088:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb888812-a79c-4531-9a69-89c757e37463+19:3615:x1875729254097664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788835212.907113:0:17047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835212.907121:0:17047:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd884aa000/0xdf60171e5a5d2df0 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2de9 expref: 19 pid: 17055 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835212.907135:0:17047:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd884aa000/0xdf60171e5a5d2df0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d2de9 expref: 19 pid: 17055 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835212.907153:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd884aa000/0xdf60171e5a5d2df0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d2de9 expref: 19 pid: 17055 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835212.907166:0:17047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835212.907209:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb888812-a79c-4531-9a69-89c757e37463+18:3615:x1875729254097664:12345-0@lo:103:ldlm_bl.0 Request processed in 126us (1087us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835212.907216:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788835212.907445:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb888812-a79c-4531-9a69-89c757e37463:3615:1875729254097664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788835212.907629:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788835212.907641:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb888812-a79c-4531-9a69-89c757e37463+17:3616:x1875729254097792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788835212.907654:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835212.907660:0:17045:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd866f5400/0xdf60171e5a5d2d2c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2d25 expref: 17 pid: 17053 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.907689:0:17045:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd866f5400/0xdf60171e5a5d2d2c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d2d25 expref: 17 pid: 17053 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.907704:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd866f5400/0xdf60171e5a5d2d2c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d2d25 expref: 17 pid: 17053 timeout: 554 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.907721:0:17045:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2e28 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.907731:0:17045:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2e28 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788835212.907748:0:17045:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002980973s 00010000:00010000:1.0:1788835212.907753:0:17045:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2e28 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.907761:0:17045:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2e28 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.907768:0:17045:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2e28 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.907776:0:17045:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2e28 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.907782:0:17045:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5600 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:1.0:1788835212.907787:0:17045:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2e28 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.907795:0:17045:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2e28 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.907829:0:17045:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2e28 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835212.907841:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788835212.907895:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb92d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb888812-a79c-4531-9a69-89c757e37463+16:3616:x1875729254097792:12345-0@lo:103:ldlm_bl.0 Request processed in 259us (1697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835212.907902:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1788835212.907950:0:17077:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2e28 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835212.907959:0:17077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2e28 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835212.907966:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2e28 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835212.908042:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb888812-a79c-4531-9a69-89c757e37463:3616:1875729254097792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1788835212.908465:0:17792:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:17792:1875729254097280:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1788835212.908478:0:17792:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0001 got index = 1 00000020:01000004:1.0:1788835212.908482:0:17792:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1788835212.908483:0:17792:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0001 00000020:01000004:1.0:1788835212.908485:0:17792:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1788835212.908487:0:17792:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1788835212.908488:0:17792:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1788835212.908490:0:17792:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1788835212.908491:0:17792:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1788835212.908494:0:17792:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1788835212.908495:0:17792:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1788835212.908507:0:17792:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0001: Imperative Recovery not enabled, recovery window 60-180 00000040:01000000:0.0:1788835212.938026:0:17792:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0001-osd ctxt 16 is initialized 00000020:00080000:2.0:1788835212.938096:0:17817:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0001: start commit thread committed batchid 0 00000020:00080000:2.0:1788835212.938100:0:17817:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0001: batchid: 0 committed batchid 0 00000040:01000000:2.0:1788835212.938631:0:17818:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:0.0:1788835212.938869:0:17792:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osp-MDT0001 ctxt 16 is initialized 00000100:00100000:2.0:1788835212.939235:0:17819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17819:1875729254097920:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788835212.939374:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:3.0:1788835212.939383:0:17818:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788835212.939418:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254097920 00000100:00100000:3.0:1788835212.939426:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254097920 00000100:00100000:2.0:1788835212.939426:0:17819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8977ca80 going to sleep for 11 seconds 00000100:00100000:3.0:1788835212.939484:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788835212.939496:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17819:x1875729254097920:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788835212.939611:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17819:x1875729254097920:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 117us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835212.939627:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000040:01000000:0.0:1788835212.939733:0:17792:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 12 is initialized 00000040:00080000:0.0:1788835212.939775:0:17792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788835212.940490:0:17819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17819:1875729254097920:0@lo:1000:lod0001_rec0000.0 00000040:01000000:2.0:1788835212.940532:0:17819:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:2.0:1788835212.940567:0:17819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17819:1875729254098048:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788835212.940619:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835212.940660:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254098048 00000100:00100000:2.0:1788835212.940666:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254098048 00000100:00100000:2.0:1788835212.940699:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788835212.940706:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17819:x1875729254098048:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788835212.940831:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:17819:x1875729254098048:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 124us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835212.940839:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788835212.940883:0:17819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8977ca80 going to sleep for 11 seconds 00000100:00100000:2.0:1788835212.940896:0:17819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17819:1875729254098048:0@lo:1000:lod0001_rec0000.0 00000100:00100000:2.0:1788835212.940950:0:17819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17819:1875729254098176:0@lo:900:lod0001_rec0000.0 00000100:00100000:2.0:1788835212.940979:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835212.941002:0:17819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf58e40 going to sleep for 11 seconds 00000004:00000080:0.0:1788835212.941294:0:17792:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000100:00100000:0.0:1788835212.941705:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254098176 00000100:00100000:0.0:1788835212.941712:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254098176 00000100:00100000:0.0:1788835212.941750:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788835212.941757:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17819:x1875729254098176:12345-0@lo:900:lod0001_rec0000.0 00000100:00100000:0.0:1788835212.941848:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17819:x1875729254098176:12345-0@lo:900:lod0001_rec0000.0 Request processed in 91us (868us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835212.941855:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000040:01000000:0.0:1788835212.941879:0:17792:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 14 is initialized 00000040:00080000:0.0:1788835212.941956:0:17792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788835212.942183:0:17818:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788835212.942253:0:17818:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osd retrieved update log, duration 0, retries 0 00000040:00080000:0.0:1788835212.945080:0:17792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1788835212.945814:0:17792:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00010000:00080000:2.0:1788835212.946105:0:17819:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9afdbf9b8a80 x1875729254098176/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788835228 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'lod0001_rec0000.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835212.946127:0:17819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8a80 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0000-lwp-MDT0001_UUID:17819:1875729254098176:0@lo:900:lod0001_rec0000.0 00000040:01000000:2.0:1788835212.946435:0:17792:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0001 ctxt 15 is initialized 00000100:00100000:3.0:1788835212.946455:0:17819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17819:1875729254098304:0@lo:1000:lod0001_rec0000.0 00000100:00100000:3.0:1788835212.946539:0:17819:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835212.946586:0:17819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eac240 going to sleep for 11 seconds 00000100:00100000:0.0:1788835212.946710:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254098304 00000100:00100000:0.0:1788835212.946719:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254098304 00000100:00100000:0.0:1788835212.946773:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1788835212.946801:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17819:x1875729254098304:12345-0@lo:1000:lod0001_rec0000.0 00000100:00100000:0.0:1788835212.946898:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e815880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:17819:x1875729254098304:12345-0@lo:1000:lod0001_rec0000.0 Request processed in 100us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835212.946907:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000040:00080000:2.0:1788835212.946995:0:17792:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788835212.947109:0:17819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815500 pname:cluuid:pid:xid:nid:opc:job lod0001_rec0000:lustre-MDT0001-mdtlov_UUID:17819:1875729254098304:0@lo:1000:lod0001_rec0000.0 00000040:00080000:3.0:1788835212.947162:0:17819:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:2.0:1788835212.949010:0:17792:0:(osd_handler.c:5581:osd_index_try()) lustre-MDT0001: index object [0x200000003:0x2f:0x0] (8/32) registered 00000040:00080000:3.0:1788835212.954162:0:17819:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000401:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1788835212.954495:0:17819:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osp-MDT0001 retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1788835212.954501:0:17819:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0001 got update logs from all MDTs. 00000001:00000004:2.0:1788835212.954838:0:17792:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:2.0:1788835212.972398:0:17792:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0001: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1788835212.972449:0:17792:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0001: cmd=c00866e6 len=0 karg=ffffadff4571f988 00100000:10000000:2.0:1788835212.972458:0:17792:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0001-osd: start master thread 00000020:01000004:1.0:1788835212.973997:0:17792:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788835212.974047:0:17792:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788835212.974068:0:17792:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1788835212.974101:0:17792:0:(super25.c:182:lustre_fill_super()) /dev/mapper/mds2_flakey: Mount complete 00000020:00000004:1.0:1788835212.977653:0:17792:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788835212.977941:0:17792:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:2.0:1788835213.032023:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 0 seconds 00010000:00010000:1.0:1788835213.479191:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788835213.928110:0:17814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788835214.053379:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 0 seconds 00010000:00010000:1.0:1788835214.504761:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1788835214.696160:0:17057:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788835214.696173:0:17057:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afd87f3f800 from 8 10000000:01000000:1.0:1788835214.696180:0:17057:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788835214.696255:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60600/0xdf60171e5a5d2e2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835214.696269:0:17057:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60600/0xdf60171e5a5d2e2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835214.696284:0:17057:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60600/0xdf60171e5a5d2e2f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835214.696347:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254098432:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788835214.696443:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835214.696516:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2e0e840 going to sleep for 11 seconds 00000100:00100000:1.0:1788835214.696543:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254098432 00000100:00100000:1.0:1788835214.696551:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254098432 00000100:00100000:1.0:1788835214.696614:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788835214.696625:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+16:17057:x1875729254098432:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788835214.696642:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835214.696663:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e61200/0xdf60171e5a5d2e36 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2e2f expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835214.696693:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e61200/0xdf60171e5a5d2e36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2e2f expref: 17 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835214.696707:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e61200/0xdf60171e5a5d2e36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2e2f expref: 17 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835214.696718:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61200, rc 0) 00000100:00100000:1.0:1788835214.696765:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+17:17057:x1875729254098432:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (321us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835214.696772:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788835214.696854:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254098432:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788835214.696869:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60600/0xdf60171e5a5d2e2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2e36 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835214.696878:0:17057:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60600/0xdf60171e5a5d2e2f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2e36 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835214.696932:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254098560:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788835214.696966:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835214.696987:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2e0e840 going to sleep for 11 seconds 00000100:00100000:3.0:1788835214.697161:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254098560 00000100:00100000:3.0:1788835214.697166:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254098560 00000100:00100000:3.0:1788835214.697203:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1788835214.697211:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+17:17057:x1875729254098560:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1788835214.697228:0:17055:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1788835214.697249:0:17055:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1788835214.697252:0:17055:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1788835214.697369:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+17:17057:x1875729254098560:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 157us (401us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835214.697377:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788835214.700081:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254098560:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788835214.700180:0:17057:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788835214.700195:0:17057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60600/0xdf60171e5a5d2e2f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2e36 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835214.700208:0:17057:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60600/0xdf60171e5a5d2e2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2e36 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788835214.700221:0:17057:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788835214.700224:0:17057:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afc8447d000 from 8 10000000:01000000:1.0:1788835214.700228:0:17057:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788835214.700274:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d2e3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835214.700283:0:17057:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d2e3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835214.700305:0:17057:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d2e3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835214.700368:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254098688:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788835214.700445:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835214.700556:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2e0e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788835214.707724:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254098688 00000100:00100000:2.0:1788835214.707745:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254098688 00000100:00100000:2.0:1788835214.707826:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1788835214.707839:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+17:17057:x1875729254098688:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788835214.707860:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835214.707891:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afc8374c800/0xdf60171e5a5d2e44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2e3d expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835214.707926:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afc8374c800/0xdf60171e5a5d2e44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2e3d expref: 18 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835214.707940:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afc8374c800/0xdf60171e5a5d2e44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2e3d expref: 18 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835214.707951:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374c800, rc 0) 00000100:00100000:2.0:1788835214.708205:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+18:17057:x1875729254098688:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 368us (7759us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835214.708213:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788835214.711284:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254098688:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788835214.711347:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d2e3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2e44 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835214.711363:0:17057:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d2e3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2e44 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835214.711470:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254098816:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788835214.711558:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835214.713209:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2e0e840 going to sleep for 11 seconds 00000100:00100000:2.0:1788835214.720142:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254098816 00000100:00100000:2.0:1788835214.720163:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254098816 00000100:00100000:2.0:1788835214.720246:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788835214.720258:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+18:17057:x1875729254098816:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1788835214.720301:0:17053:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1788835214.720347:0:17053:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1788835214.720350:0:17053:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1788835214.720521:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+18:17057:x1875729254098816:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 264us (8961us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835214.720529:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788835214.720633:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb91880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254098816:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1788835214.720713:0:17057:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1788835214.720725:0:17057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d2e3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2e44 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835214.720738:0:17057:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d2e3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2e44 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788835214.949988:0:17814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788835215.078732:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 0 seconds 00010000:00010000:1.0:1788835215.527695:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835216.109387:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 0 seconds 00010000:00010000:0.0:1788835216.552672:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835217.132817:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 0 seconds 00010000:00010000:1.0:1788835217.575232:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788835217.708854:0:18062:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1788835218.149558:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 0 seconds 00000100:00100000:1.0:1788835218.219498:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788835218.219528:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254098944:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788835218.219618:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835218.219703:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254098944 00000100:00100000:1.0:1788835218.219712:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254098944 00000100:00100000:1.0:1788835218.219765:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788835218.219773:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254098944:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788835218.219812:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788835218.219864:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254098944:12345-0@lo:41:osp-pre-0-1.0 Request processed in 90us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835218.219871:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1788835218.219942:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254098944:0@lo:41:osp-pre-0-1.0 00000100:00080000:2.0:1788835218.220231:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-MDT0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1788835218.220237:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0001_UUID: starting recovery 00000100:00080000:2.0:1788835218.220242:0:8:0:(import.c:65:import_set_state_nolock()) ffff9afdbf96e800 lustre-MDT0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788835218.220250:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0001-osp-MDT0000: import ffff9afdbf96e800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788835218.220286:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbf9b8380 x1875729254099200/t0(0) o38->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788835218.220305:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788835218.220309:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788835218.220331:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788835218.220336:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788835218.220348:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788835218.220352:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788835218.220355:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788835218.220358:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788835218.220389:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254099200:0@lo:38:kworker.0 00000100:00100000:2.0:1788835218.220426:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835218.220507:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb888812-a79c-4531-9a69-89c757e37463:3614:1875729254099072:0@lo:400:kworker.0 00000100:00100000:1.0:1788835218.220544:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835218.220578:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788835218.220584:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729254099328:0@lo:400:kworker.0 00000100:00100000:1.0:1788835218.220611:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835218.220640:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254099200 00000100:00100000:1.0:1788835218.220645:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254099200 00000100:00100000:1.0:1788835218.220671:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788835218.220677:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:0+-99:3613:x1875729254099200:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1788835218.220705:0:17801:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 460 last 0 00000020:00000080:1.0:1788835218.220748:0:17801:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf60171e5a5d2e4b 00000004:00100000:1.0:1788835218.220766:0:17801:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000001:00000004:1.0:1788835218.220773:0:17801:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0001_UUID: mount_count is 2, last_transno is 8589934592 00000100:00100000:1.0:1788835218.220861:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254099328 00000100:00100000:1.0:1788835218.220865:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254099328 00000100:00100000:1.0:1788835218.220895:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788835218.220902:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729254099328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835218.220948:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729254099328:12345-0@lo:400:kworker.0 Request processed in 47us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835218.220956:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1788835218.220986:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afdbf9b8e00 x1875729254099328/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835218.220997:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729254099328:0@lo:400:kworker.0 00000100:00100000:1.0:1788835218.221019:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729254099456:0@lo:400:kworker.0 00000100:00100000:1.0:1788835218.221057:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835218.221155:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254099456 00000100:00100000:3.0:1788835218.221159:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254099456 00000100:00100000:3.0:1788835218.221198:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788835218.221205:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729254099456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835218.221248:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729254099456:12345-0@lo:400:kworker.0 Request processed in 43us (190us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835218.221254:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1788835218.221303:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afdbf9bb800 x1875729254099456/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835218.221330:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729254099456:0@lo:400:kworker.0 00000100:00100000:2.0:1788835218.222158:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254099072 00000100:00100000:2.0:1788835218.222166:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254099072 00000100:00100000:2.0:1788835218.222208:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788835218.222229:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+18:3614:x1875729254099072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835218.222343:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+18:3614:x1875729254099072:12345-0@lo:400:kworker.0 Request processed in 117us (1796us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835218.222351:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788835218.222484:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb888812-a79c-4531-9a69-89c757e37463:3614:1875729254099072:0@lo:400:kworker.0 00000100:00080000:1.0:1788835218.235714:0:17801:0:(import.c:65:import_set_state_nolock()) ffff9afd87803800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788835218.235869:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3613:x1875729254099200:12345-0@lo:38:kworker.0 Request processed in 15189us (15440us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835218.235880:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:0.0:1788835218.235991:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-osp-MDT0000: connect to target with instance 2 00000100:00080000:0.0:1788835218.236004:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-osp-MDT0000: Resetting ns_connect_flags to server flags: 0xa2400010450010a0 00000100:00080000:0.0:1788835218.236009:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:0.0:1788835218.236012:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdbf96e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00080000:0.0:1788835218.236036:0:3613:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b3404d8f): req@ffff9afdbf9b8700 x1875729254092160/t0(0) o1000->lustre-MDT0001-osp-MDT0000@0@lo:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'lod0000_rec0001.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835218.236063:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254099200:0@lo:38:kworker.0 00000100:00100000:1.0:1788835218.236187:0:17103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835218.236231:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdaaf77900 going to sleep for 11 seconds 00000100:00100000:0.0:1788835218.236361:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254092160 00000100:00100000:0.0:1788835218.236368:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254092160 00000100:00100000:0.0:1788835218.236406:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1788835218.236415:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17103:x1875729254092160:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:0.0:1788835218.236494:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17103:x1875729254092160:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 79us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835218.236502:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788835218.236907:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788835218.236921:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254099584:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835218.236957:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835218.237067:0:17103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8700 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17103:1875729254092160:0@lo:1000:lod0000_rec0001.0 00000040:01000000:1.0:1788835218.237109:0:17103:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000100:00100000:1.0:1788835218.237148:0:17103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb91500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17103:1875729254099712:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788835218.237181:0:17103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835218.237227:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8109bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788835218.237242:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254099584 00000100:00100000:1.0:1788835218.237246:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254099584 00000100:00100000:1.0:1788835218.237278:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254099712 00000100:00100000:1.0:1788835218.237281:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254099712 00000100:00100000:1.0:1788835218.237295:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788835218.237303:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3616:x1875729254099584:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788835218.237370:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788835218.237420:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e817800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:3616:x1875729254099584:12345-0@lo:41:osp-pre-1-0.0 Request processed in 117us (462us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835218.237427:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1788835218.237443:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788835218.237450:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17103:x1875729254099712:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788835218.237566:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17103:x1875729254099712:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 116us (383us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835218.237572:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788835218.237616:0:17103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb91500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17103:1875729254099712:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788835218.237690:0:17103:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb91500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17103:1875729254099840:0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788835218.237716:0:17103:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835218.237734:0:17103:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8109bc00 going to sleep for 11 seconds 00000100:00100000:1.0:1788835218.237745:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254099840 00000100:00100000:1.0:1788835218.237749:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254099840 00000100:00100000:1.0:1788835218.237765:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788835218.237771:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17103:x1875729254099840:12345-0@lo:1000:lod0000_rec0001.0 00000100:00100000:1.0:1788835218.237813:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:17103:x1875729254099840:12345-0@lo:1000:lod0000_rec0001.0 Request processed in 41us (96us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835218.237818:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788835218.237836:0:17103:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb91500 pname:cluuid:pid:xid:nid:opc:job lod0000_rec0001:lustre-MDT0000-mdtlov_UUID:17103:1875729254099840:0@lo:1000:lod0000_rec0001.0 00000040:00080000:1.0:1788835218.237874:0:17103:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788835218.239997:0:17103:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x240000401:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1788835218.240112:0:17103:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0001-osp-MDT0000 retrieved update log, duration 19, retries 0 00000004:00080000:1.0:1788835218.240117:0:17103:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000100:00100000:3.0:1788835218.240553:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254099584:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788835218.602924:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:0.0:1788835218.699898:0:18114:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:0.0:1788835218.700134:0:18114:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788835219.626268:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:3.0:1788835219.812858:0:18164:0:(tgt_mount.c:2347:server_getattr()) lustre-MDT0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788835219.813169:0:18164:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788835220.646463:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1788835220.916871:0:18213:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffee5187be0 20000000:00000080:2.0:1788835220.916888:0:18213:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9afdbb300400 uarg=0000000000000000 20000000:01000000:2.0:1788835220.917045:0:18213:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1788835220.917053:0:18213:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1788835220.917057:0:18213:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1788835220.920241:0:18214:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 13 20000000:00000400:3.0:1788835220.923163:0:18213:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788835220.942110:0:18213:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788835220.944500:0:18213:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2e52 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835220.944526:0:18213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdb2e61c00/0xdf60171e5a5d2cfb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2cf4 expref: 17 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835220.944533:0:18213:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd884ab600/0xdf60171e5a5d2dfe lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2df7 expref: 17 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835220.944541:0:18213:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2e52 lrc: 5/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 18213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835220.944582:0:18213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd884ab600/0xdf60171e5a5d2dfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d2df7 expref: 17 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835220.944597:0:18213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afd884ab600/0xdf60171e5a5d2dfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d2df7 expref: 17 pid: 17055 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835220.944613:0:18213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18213:1875729254099968:0@lo:104: 00000100:00100000:2.0:1788835220.944690:0:18213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788835220.944768:0:18213:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdb2e61c00/0xdf60171e5a5d2cfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d2cf4 expref: 17 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835220.944777:0:18213:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afdb2e61c00/0xdf60171e5a5d2cfb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d2cf4 expref: 17 pid: 17053 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835220.944785:0:18213:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18213:1875729254100096:0@lo:104: 00000100:00100000:2.0:1788835220.944822:0:18213:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835220.944944:0:18213:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8330e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788835220.948505:0:17044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254099968 00000100:00100000:3.0:1788835220.948524:0:17044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254099968 00000100:00100000:2.0:1788835220.948676:0:17044:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254100096 00000100:00100000:2.0:1788835220.948681:0:17044:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254100096 00000100:00100000:2.0:1788835220.948700:0:17044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788835220.948710:0:17044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb888812-a79c-4531-9a69-89c757e37463+4:18213:x1875729254099968:12345-0@lo:104: 00010000:00010000:2.0:1788835220.948727:0:17044:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afd866f5c00/0xdf60171e5a5d2df7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2dfe expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835220.948865:0:17044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788835220.948872:0:17044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb888812-a79c-4531-9a69-89c757e37463+4:18213:x1875729254099968:12345-0@lo:104: Request processed in 164us (4181us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835220.948880:0:17044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1788835220.948914:0:17044:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788835220.948932:0:17044:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb888812-a79c-4531-9a69-89c757e37463+3:18213:x1875729254100096:12345-0@lo:104: 00010000:00010000:2.0:1788835220.948942:0:17044:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afd884aa200/0xdf60171e5a5d2cf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2cfb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835220.948979:0:17044:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:1.0:1788835220.949126:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788835220.949135:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd866f5c00/0xdf60171e5a5d2df7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2dfe expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835220.949143:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5c00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:1.0:1788835220.949147:0:17049:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f5c00/0xdf60171e5a5d2df7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d2dfe expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835220.949155:0:17049:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd866f5c00/0xdf60171e5a5d2df7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d2dfe expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788835220.949188:0:17049:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f5c00/0xdf60171e5a5d2df7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d2dfe expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788835220.949194:0:17049:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788835220.949232:0:17049:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd866f5c00/0xdf60171e5a5d2df7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2dfe expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835220.949239:0:17049:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788835220.949262:0:18213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18213:1875729254099968:0@lo:104: 00010000:00010000:1.0:1788835220.949271:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd866f5c00/0xdf60171e5a5d2df7 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2dfe expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835220.949280:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd866f5c00/0xdf60171e5a5d2df7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2dfe expref: -99 pid: 17792 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835220.949287:0:18213:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:18213:1875729254100096:0@lo:104: 00010000:00010000:1.0:1788835220.949295:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788835220.949299:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd884aa200/0xdf60171e5a5d2cf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2cfb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835220.949305:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aa200 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:1.0:1788835220.949336:0:17049:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd884aa200/0xdf60171e5a5d2cf4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d2cfb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835220.949343:0:17049:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd884aa200/0xdf60171e5a5d2cf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d2cfb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835220.949345:0:18213:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2e52 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788835220.949352:0:17049:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd884aa200/0xdf60171e5a5d2cf4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d2cfb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788835220.949360:0:17049:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1788835220.949383:0:17049:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd884aa200/0xdf60171e5a5d2cf4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2cfb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835220.949388:0:17049:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1788835220.949393:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb888812-a79c-4531-9a69-89c757e37463:3614:1875729254100224:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788835220.949396:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd884aa200/0xdf60171e5a5d2cf4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2cfb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835220.949405:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd884aa200/0xdf60171e5a5d2cf4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2cfb expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835220.949420:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835220.949422:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835220.949425:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835220.949438:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb888812-a79c-4531-9a69-89c757e37463:3615:1875729254100352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788835220.949444:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835220.949482:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835220.949512:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254100224 00000100:00100000:3.0:1788835220.949517:0:17047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254100224 00000100:00100000:1.0:1788835220.949530:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254100352 00000100:00100000:1.0:1788835220.949536:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254100352 00010000:00010000:3.0:1788835220.949541:0:17047:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd884ab600/0xdf60171e5a5d2dfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2df7 expref: 19 pid: 17055 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835220.949556:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdb2e61c00/0xdf60171e5a5d2cfb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2cf4 expref: 19 pid: 17053 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835220.949568:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788835220.949576:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e815500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb888812-a79c-4531-9a69-89c757e37463+19:3614:x1875729254100224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788835220.949587:0:17047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835220.949599:0:17047:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd884ab600/0xdf60171e5a5d2dfe lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2df7 expref: 19 pid: 17055 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835220.949608:0:17044:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:cb888812-a79c-4531-9a69-89c757e37463+3:18213:x1875729254100096:12345-0@lo:104: Request processed in 64us (4175us total) trans 0 rc 0/0 00010000:00010000:3.0:1788835220.949611:0:17047:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd884ab600/0xdf60171e5a5d2dfe lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d2df7 expref: 19 pid: 17055 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835220.949626:0:17044:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1788835220.949632:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd884ab600/0xdf60171e5a5d2dfe lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d2df7 expref: 19 pid: 17055 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835220.949648:0:17047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835220.949684:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e815500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb888812-a79c-4531-9a69-89c757e37463+18:3614:x1875729254100224:12345-0@lo:103:ldlm_bl.0 Request processed in 109us (243us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835220.951191:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb888812-a79c-4531-9a69-89c757e37463:3614:1875729254100224:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1788835220.954155:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835220.954864:0:17045:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1788835220.954880:0:17045:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1788835220.955136:0:17046:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1788835220.955155:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788835220.955169:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb888812-a79c-4531-9a69-89c757e37463+18:3615:x1875729254100352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788835220.955200:0:17046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835220.955210:0:17046:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdb2e61c00/0xdf60171e5a5d2cfb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2cf4 expref: 18 pid: 17053 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835220.955227:0:17046:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdb2e61c00/0xdf60171e5a5d2cfb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d2cf4 expref: 18 pid: 17053 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835220.955256:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e61c00/0xdf60171e5a5d2cfb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d2cf4 expref: 18 pid: 17053 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835220.955273:0:17046:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2e52 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835220.955282:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2e52 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 18213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835220.955300:0:17046:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2e52 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 18213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835220.955357:0:17046:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2e52 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835220.955365:0:17046:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2e52 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 18213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835220.955372:0:17046:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2e52 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835220.955400:0:17046:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835220.955405:0:17046:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2e52 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 18213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835220.955414:0:17046:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2e52 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 18213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835220.955440:0:17046:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2e52 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835220.955452:0:17046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788835220.955525:0:18213:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2e52 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835220.955547:0:18213:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2e52 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835220.955553:0:18213:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2e52 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 18213 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835220.955579:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb91880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb888812-a79c-4531-9a69-89c757e37463+17:3615:x1875729254100352:12345-0@lo:103:ldlm_bl.0 Request processed in 414us (6097us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835220.955589:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788835220.955657:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb888812-a79c-4531-9a69-89c757e37463:3615:1875729254100352:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788835220.961996:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000040:00080000:1.0:1788835221.158061:0:17095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788835221.670409:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835222.309736:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788835212/real 1788835212] req@ffff9afdbf9b8000 x1875729254095360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788835222 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835222.309767:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9afdbf9b8000 x1875729254095360/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788835222 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835222.309777:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788835212/real 1788835212] req@ffff9afdbf9bad80 x1875729254095232/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788835222 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835222.309789:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9afdbf9bad80 x1875729254095232/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788835222 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788835222.309807:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc830ff800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788835222.309820:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788835222.309823:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254095360:0@lo:8:llog_process_th.0 00000100:00080000:3.0:1788835222.309829:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc830f8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788835222.309843:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788835222.309847:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254095232:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1788835222.310933:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788835222.310938:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788835222.310941:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788835222.310944:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788835222.310966:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788835222.310969:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788835222.310972:0:37:0:(import.c:65:import_set_state_nolock()) ffff9afc830f8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788835222.310978:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 454 00000100:00080000:2.0:1788835222.310983:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788835222.310989:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9afc830f8000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788835222.311017:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbf9bbb80 x1875729254100992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788835222.311035:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788835222.311038:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788835222.311040:0:37:0:(import.c:65:import_set_state_nolock()) ffff9afc830ff800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788835222.311044:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 454 00000100:00080000:2.0:1788835222.311046:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1788835222.311050:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9afc830ff800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788835222.311060:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbf9bad80 x1875729254101120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788835222.311090:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254100608:0@lo:400:kworker.0 00000100:00100000:2.0:1788835222.311153:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835222.311199:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788835222.311205:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb888812-a79c-4531-9a69-89c757e37463:3617:1875729254100480:0@lo:400:kworker.0 00000100:00100000:2.0:1788835222.311244:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835222.311266:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729254101248:0@lo:400:kworker.0 00000100:00100000:2.0:1788835222.311288:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835222.311311:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729254100736:0@lo:400:kworker.0 00000100:00100000:2.0:1788835222.311357:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835222.311372:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788835222.311377:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254100864:0@lo:400:kworker.0 00000100:00100000:2.0:1788835222.311394:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835222.311420:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254100608 00000100:00100000:2.0:1788835222.311426:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254100608 00000100:00100000:2.0:1788835222.311460:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254100864 00000100:00100000:2.0:1788835222.311467:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254100864 00000100:00100000:2.0:1788835222.311484:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788835222.311491:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1875729254100608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835222.311539:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:3617:x1875729254100608:12345-0@lo:400:kworker.0 Request processed in 49us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835222.311547:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788835222.311574:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1788835222.311579:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254100864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835222.311606:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254100864:12345-0@lo:400:kworker.0 Request processed in 27us (211us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835222.311612:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788835222.311806:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254101248 00000100:00100000:1.0:1788835222.311811:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254101248 00000100:00100000:1.0:1788835222.311845:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254100736 00000100:00100000:1.0:1788835222.311848:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254100736 00000100:00100000:1.0:1788835222.311861:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788835222.311867:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729254101248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835222.311905:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729254101248:12345-0@lo:400:kworker.0 Request processed in 38us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835222.311920:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788835222.311933:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788835222.311938:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729254100736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835222.311968:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729254100736:12345-0@lo:400:kworker.0 Request processed in 30us (610us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835222.311973:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788835222.311997:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254100992:0@lo:8:kworker.0 00000400:00000100:1.0:1788835222.312017:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875729254100992 offset 0 length 520: 4 00000100:00100000:2.0:1788835222.312050:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254100480 00000100:00100000:2.0:1788835222.312055:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254100480 00000100:00100000:1.0:1788835222.316550:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254101120:0@lo:8:kworker.0 00000400:00000100:1.0:1788835222.316613:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875729254101120 offset 0 length 520: 4 00010000:00080000:1.0:1788835222.316734:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afdbf9b8000 x1875729254101248/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835222.316750:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729254101248:0@lo:400:kworker.0 00000100:00100000:1.0:1788835222.316763:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254100608:0@lo:400:kworker.0 00000100:00100000:2.0:1788835222.318464:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788835222.318478:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+16:3617:x1875729254100480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835222.318559:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+16:3617:x1875729254100480:12345-0@lo:400:kworker.0 Request processed in 86us (7323us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835222.318566:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1788835222.318622:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb888812-a79c-4531-9a69-89c757e37463:3617:1875729254100480:0@lo:400:kworker.0 00000100:00100000:0.0:1788835222.320474:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254100864:0@lo:400:kworker.0 00010000:00080000:0.0:1788835222.320494:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afdbf9bb100 x1875729254100736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835222.320506:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729254100736:0@lo:400:kworker.0 10000000:01000000:2.0:1788835222.374462:0:17057:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788835222.374471:0:17057:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afd87f3f800 from 13 10000000:01000000:2.0:1788835222.374475:0:17057:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788835222.374521:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374da00/0xdf60171e5a5d2e59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835222.374534:0:17057:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afc8374da00/0xdf60171e5a5d2e59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835222.374558:0:17057:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afc8374da00/0xdf60171e5a5d2e59 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835222.374585:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254101376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788835222.375569:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835222.375618:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8330e0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788835222.377042:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254101376 00000100:00100000:3.0:1788835222.377054:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254101376 00000100:00100000:3.0:1788835222.377224:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788835222.377246:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+16:17057:x1875729254101376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788835222.377263:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835222.377284:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd884abe00/0xdf60171e5a5d2e60 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2e59 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835222.377345:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd884abe00/0xdf60171e5a5d2e60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2e59 expref: 17 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835222.377359:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd884abe00/0xdf60171e5a5d2e60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2e59 expref: 17 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835222.377368:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884abe00, rc 0) 00000100:00100000:3.0:1788835222.377439:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+17:17057:x1875729254101376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 206us (1872us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835222.377446:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1788835222.378797:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458fb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254101376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788835222.378825:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afc8374da00/0xdf60171e5a5d2e59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2e60 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835222.378838:0:17057:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afc8374da00/0xdf60171e5a5d2e59 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2e60 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835222.378999:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254101504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788835222.379048:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835222.379103:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8663e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788835222.379286:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254101504 00000100:00100000:0.0:1788835222.379294:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254101504 00000100:00100000:0.0:1788835222.379343:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1788835222.379351:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+17:17057:x1875729254101504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788835222.379461:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+17:17057:x1875729254101504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 110us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835222.379468:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788835222.379639:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254101504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788835222.379672:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254101632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788835222.379713:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835222.379732:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8663e000 going to sleep for 11 seconds 00000100:00100000:0.0:1788835222.379811:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254101632 00000100:00100000:0.0:1788835222.379815:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254101632 00000100:00100000:0.0:1788835222.379831:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1788835222.379836:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbc360050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+17:17057:x1875729254101632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788835222.379907:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbc360050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+17:17057:x1875729254101632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 69us (193us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835222.379913:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788835222.380283:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254101632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1788835222.383475:0:18282:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788835222.383747:0:17057:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788835222.383769:0:17057:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788835222.383780:0:17057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374da00/0xdf60171e5a5d2e59 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2e60 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835222.383792:0:17057:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afc8374da00/0xdf60171e5a5d2e59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2e60 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788835222.383802:0:17057:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788835222.383819:0:17057:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afc8447d000 from 13 10000000:01000000:3.0:1788835222.383822:0:17057:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788835222.383858:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd884ab600/0xdf60171e5a5d2e67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835222.383866:0:17057:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd884ab600/0xdf60171e5a5d2e67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835222.383876:0:17057:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd884ab600/0xdf60171e5a5d2e67 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835222.383901:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e817100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254101760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788835222.384803:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835222.384847:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c240 going to sleep for 11 seconds 00000100:00100000:3.0:1788835222.384874:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254101760 00000100:00100000:3.0:1788835222.384880:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254101760 00000100:00100000:3.0:1788835222.384989:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788835222.384999:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbc363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+17:17057:x1875729254101760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788835222.385012:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835222.385025:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd884aa600/0xdf60171e5a5d2e6e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2e67 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835222.385048:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd884aa600/0xdf60171e5a5d2e6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2e67 expref: 18 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835222.385058:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd884aa600/0xdf60171e5a5d2e6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2e67 expref: 18 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835222.385066:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884aa600, rc 0) 00000100:00100000:3.0:1788835222.385099:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbc363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+18:17057:x1875729254101760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835222.385113:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1788835222.385159:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e817100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254101760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788835222.385174:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd884ab600/0xdf60171e5a5d2e67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2e6e expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835222.385182:0:17057:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd884ab600/0xdf60171e5a5d2e67 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2e6e expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835222.385255:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e817100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254101888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788835222.385282:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835222.385297:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c240 going to sleep for 11 seconds 00000100:00100000:3.0:1788835222.385308:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254101888 00000100:00100000:3.0:1788835222.385329:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254101888 00000100:00100000:3.0:1788835222.385353:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788835222.385358:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbc363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+18:17057:x1875729254101888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788835222.385455:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbc363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+18:17057:x1875729254101888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 96us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835222.385462:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1788835222.385487:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e817100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254101888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788835222.385511:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e817100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254102016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788835222.385549:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835222.385567:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c240 going to sleep for 11 seconds 00000100:00100000:3.0:1788835222.385578:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254102016 00000100:00100000:3.0:1788835222.385581:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254102016 00000100:00100000:3.0:1788835222.385599:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1788835222.385610:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbc363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+18:17057:x1875729254102016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788835222.387247:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbc363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+18:17057:x1875729254102016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1620us (1680us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835222.387259:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1788835222.395501:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e817100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254102016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1788835222.396529:0:18283:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788835222.396722:0:17057:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788835222.396745:0:17057:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788835222.396756:0:17057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd884ab600/0xdf60171e5a5d2e67 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2e6e expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835222.396769:0:17057:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd884ab600/0xdf60171e5a5d2e67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2e6e expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835222.694723:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835223.333519:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788835223.333540:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254102144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788835223.333612:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835223.333668:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254102144 00000100:00100000:1.0:1788835223.333676:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254102144 00000100:00100000:1.0:1788835223.333721:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788835223.333730:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254102144:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788835223.333760:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788835223.333804:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254102144:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835223.333812:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788835223.333859:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254102144:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788835223.334081:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1788835223.334090:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254102272:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788835223.334117:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835223.334146:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254102272 00000100:00100000:1.0:1788835223.334150:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254102272 00000100:00100000:1.0:1788835223.334173:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788835223.334190:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3615:x1875729254102272:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788835223.334243:0:17801:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788835223.334282:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:3615:x1875729254102272:12345-0@lo:41:osp-pre-1-0.0 Request processed in 93us (164us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835223.334300:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788835223.334352:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254102272:0@lo:41:osp-pre-1-0.0 00010000:00010000:3.0:1788835223.717449:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1788835223.850066:0:17793:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000040:00080000:2.0:1788835224.166581:0:17814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1788835224.742417:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835225.382552:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788835210/real 1788835210] req@ffff9afd9e814700 x1875729254093184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788835225 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835225.382599:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9afd9e814700 x1875729254093184/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788835225 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835225.382610:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788835210/real 1788835210] req@ffff9afd9e814a80 x1875729254093312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788835225 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835225.382623:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9afd9e814a80 x1875729254093312/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788835225 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788835225.382646:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdbf96b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788835225.382673:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788835225.382677:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254093184:0@lo:8:kworker.0 00000100:00080000:1.0:1788835225.382683:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc8369a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788835225.382688:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788835225.382691:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254093312:0@lo:8:kworker.0 00000100:00080000:3.0:1788835225.382970:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788835225.382974:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:3.0:1788835225.382977:0:37:0:(import.c:65:import_set_state_nolock()) ffff9afdbf96b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788835225.382983:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 452 00000100:00080000:3.0:1788835225.382989:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788835225.382996:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9afdbf96b800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788835225.383021:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afd9e814e00 x1875729254102656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788835225.383035:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788835225.383038:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1788835225.383050:0:37:0:(import.c:65:import_set_state_nolock()) ffff9afc8369a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1788835225.383054:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 452 00000100:00080000:3.0:1788835225.383056:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:3.0:1788835225.383060:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9afc8369a000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788835225.383073:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afd9e817b80 x1875729254102784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788835225.383097:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788835225.383100:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788835225.383103:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788835225.383105:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788835225.383136:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254102528:0@lo:400:kworker.0 00000100:00100000:2.0:1788835225.383252:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254103040:0@lo:400:kworker.0 00000100:00100000:1.0:1788835225.383334:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb888812-a79c-4531-9a69-89c757e37463:3615:1875729254102400:0@lo:400:kworker.0 00000100:00100000:2.0:1788835225.383438:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835225.383492:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254102912:0@lo:400:kworker.0 00000100:00100000:2.0:1788835225.383525:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835225.383648:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254102912 00000100:00100000:0.0:1788835225.383658:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254102912 00000100:00100000:0.0:1788835225.383722:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788835225.383734:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254102912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835225.383801:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254102912:12345-0@lo:400:kworker.0 Request processed in 69us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835225.383809:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788835225.383838:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254103040 00000100:00100000:0.0:1788835225.383842:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254103040 00000100:00100000:0.0:1788835225.383869:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788835225.383876:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254103040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835225.383917:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254103040:12345-0@lo:400:kworker.0 Request processed in 41us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835225.383923:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:0.0:1788835225.383966:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afd9e814a80 x1875729254102912/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835225.383981:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254102912:0@lo:400:kworker.0 00000100:00100000:0.0:1788835225.384009:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254103040:0@lo:400:kworker.0 00000100:00100000:2.0:1788835225.388464:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254102656:0@lo:8:kworker.0 00000400:00000100:2.0:1788835225.388554:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875729254102656 offset 0 length 520: 4 00000100:00100000:2.0:1788835225.388604:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254102784:0@lo:8:kworker.0 00000400:00000100:2.0:1788835225.388626:0:3613:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1875729254102784 offset 0 length 520: 4 00000100:00100000:3.0:1788835225.390518:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835225.390518:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835225.390605:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254102400 00000100:00100000:2.0:1788835225.390618:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254102400 00000100:00100000:2.0:1788835225.390678:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1788835225.390689:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbc360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+18:3615:x1875729254102400:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835225.390787:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254102528 00000100:00100000:0.0:1788835225.390792:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254102528 00000100:00100000:0.0:1788835225.390824:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788835225.390831:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254102528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835225.391367:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254103168:0@lo:400:kworker.0 00000100:00100000:1.0:1788835225.391431:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835225.391474:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254103168 00000100:00100000:1.0:1788835225.391479:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254103168 00000100:00100000:1.0:1788835225.391512:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788835225.391519:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254103168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835225.391562:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3615:x1875729254103168:12345-0@lo:400:kworker.0 Request processed in 43us (130us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835225.391568:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1788835225.391616:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afd9e817100 x1875729254103168/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835241 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835225.391631:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0001_UUID:3615:1875729254103168:0@lo:400:kworker.0 00000100:00100000:0.0:1788835225.394477:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e816d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254102528:12345-0@lo:400:kworker.0 Request processed in 3632us (3958us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835225.394505:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1788835225.394786:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbc360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+18:3615:x1875729254102400:12345-0@lo:400:kworker.0 Request processed in 4095us (4278us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835225.394798:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1788835225.397471:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254102528:0@lo:400:kworker.0 00000100:00100000:1.0:1788835225.404386:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e816680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb888812-a79c-4531-9a69-89c757e37463:3615:1875729254102400:0@lo:400:kworker.0 00010000:00010000:1.0:1788835225.767949:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835226.790555:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1788835227.065386:0:18562:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1788835227.065390:0:18562:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost1_flakey 00000020:01000004:1.0:1788835227.065392:0:18562:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:1.0:1788835227.065538:0:18562:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9afdc1d5c800 00000020:01000004:1.0:1788835227.065557:0:18562:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1788835227.065573:0:18562:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-ldiskfs) 00000020:00000080:1.0:1788835227.065592:0:18562:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9afdb715cd28) 00000020:00000080:1.0:1788835227.065611:0:18562:0:(obd_config.c:720:class_attach_name()) OBD: dev 20 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788835227.144748:0:18562:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:3.0:1788835227.149675:0:18562:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:3.0:1788835227.150428:0:18562:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/32) registered 00100000:10000000:3.0:1788835227.150636:0:18562:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:3.0:1788835227.150897:0:18562:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:3.0:1788835227.151304:0:18562:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:3.0:1788835227.152613:0:18562:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8) registered 00080000:01000000:3.0:1788835227.154129:0:18562:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0000: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788835227.154533:0:18562:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1788835227.154550:0:18562:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788835227.154567:0:18562:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdf60171e5a5d2e7c 00000020:01000004:3.0:1788835227.154576:0:18562:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device /dev/mapper/ost1_flakey 00000020:01000004:3.0:1788835227.154605:0:18562:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.122@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788835227.154610:0:18562:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788835227.154628:0:18562:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1788835227.154634:0:18562:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1788835227.154649:0:18562:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9afdbd43cd28) 00000020:00000080:3.0:1788835227.154663:0:18562:0:(obd_config.c:720:class_attach_name()) OBD: dev 21 attached type ost with refcount 2 00000100:00100000:3.0:1788835227.161923:0:18562:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788835227.162519:0:18562:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1788835227.162527:0:18562:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1788835227.164127:0:18562:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1788835227.164146:0:18562:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1788835227.164883:0:18562:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1788835227.164892:0:18562:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1788835227.174690:0:18562:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788835227.174918:0:18562:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1788835227.174925:0:18562:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:2.0:1788835227.175604:0:18562:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:2.0:1788835227.175612:0:18562:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1788835227.231811:0:18562:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1788835227.232109:0:18562:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1788835227.232117:0:18562:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1788835227.236097:0:18562:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1788835227.236120:0:18562:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1788835227.240442:0:18562:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1788835227.240467:0:18562:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1788835227.246118:0:18562:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788835227.246421:0:18562:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1788835227.246428:0:18562:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1788835227.249041:0:18562:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1788835227.249058:0:18562:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1788835227.310993:0:18562:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1788835227.311255:0:18562:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1788835227.311263:0:18562:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1788835227.312542:0:18562:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1788835227.312554:0:18562:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1788835227.312967:0:18562:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1788835227.313001:0:18562:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost1_flakey 10000000:01000000:2.0:1788835227.313009:0:18562:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1788835227.335306:0:18562:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788835227.335396:0:18562:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.122@tcp, index=0000, flags=0x20002 00000020:01000004:2.0:1788835227.335401:0:18562:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788835227.335404:0:18562:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788835227.335405:0:18562:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788835227.335407:0:18562:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788835227.335408:0:18562:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788835227.335410:0:18562:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788835227.335412:0:18562:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788835227.335414:0:18562:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788835227.335416:0:18562:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788835227.335421:0:18562:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:2.0:1788835227.335423:0:18562:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788835227.335425:0:18562:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788835227.335426:0:18562:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788835227.335427:0:18562:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788835227.335428:0:18562:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788835227.335430:0:18562:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788835227.335437:0:18562:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788835227.335438:0:18562:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788835227.335439:0:18562:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788835227.335490:0:18562:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788835227.335517:0:18562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254103296:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788835227.335608:0:18562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835227.335670:0:18562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2ef5180 going to sleep for 11 seconds 00000100:00100000:0.0:1788835227.335711:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254103296 00000100:00100000:0.0:1788835227.335722:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254103296 00000100:00100000:0.0:1788835227.335793:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788835227.335804:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8304b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+18:18562:x1875729254103296:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788835227.335840:0:17053:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1788835227.335843:0:17053:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1788835227.335848:0:17053:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1788835227.336590:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8304b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+18:18562:x1875729254103296:12345-0@lo:253:mount.lustre.0 Request processed in 783us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835227.336601:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1788835227.336777:0:18562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254103296:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788835227.336791:0:18562:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788835227.336794:0:18562:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788835227.336795:0:18562:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788835227.336796:0:18562:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788835227.336797:0:18562:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788835227.336798:0:18562:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788835227.336800:0:18562:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788835227.336801:0:18562:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788835227.336802:0:18562:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788835227.336804:0:18562:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1788835227.336838:0:18562:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9afdc1d5c800 from lustre-OST0000 10000000:01000000:2.0:1788835227.336877:0:18562:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1788835227.336880:0:18562:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788835227.336891:0:18562:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9afdbf93b370 local copy 00010000:00010000:2.0:1788835227.336904:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374d000/0xdf60171e5a5d2c37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2c3e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835227.337155:0:18562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254103424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788835227.337198:0:18562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835227.337351:0:18562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2ef5600 going to sleep for 11 seconds 00000100:00100000:3.0:1788835227.338116:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254103424 00000100:00100000:3.0:1788835227.338131:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254103424 00000100:00100000:3.0:1788835227.338197:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1788835227.338221:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+18:18562:x1875729254103424:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788835227.338400:0:18562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254103424:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1788835227.338424:0:18562:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 00000100:00100000:3.0:1788835227.338435:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+18:18562:x1875729254103424:12345-0@lo:501:mount.lustre.0 Request processed in 216us (1235us total) trans 0 rc -2/-2 00000100:00100000:3.0:1788835227.338445:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 10000000:01000000:2.0:1788835227.338450:0:18562:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1788835227.338472:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374d000/0xdf60171e5a5d2c37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2c3e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835227.338484:0:18562:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afc8374d000/0xdf60171e5a5d2c37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2c3e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835227.338517:0:18562:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9afdc1d5c800 10000000:01000000:2.0:1788835227.338522:0:18562:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1788835227.338528:0:18562:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1788835227.338531:0:18562:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788835227.338536:0:18562:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1788835227.338540:0:18562:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1788835227.338570:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d2e8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835227.338579:0:18562:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d2e8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835227.338589:0:18562:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d2e8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835227.338608:0:18562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254103552:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788835227.338644:0:18562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835227.338681:0:18562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2ef5600 going to sleep for 11 seconds 00000100:00100000:0.0:1788835227.338909:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254103552 00000100:00100000:0.0:1788835227.338916:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254103552 00000100:00100000:0.0:1788835227.338960:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1788835227.338969:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+18:18562:x1875729254103552:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788835227.338979:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835227.338995:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d2e91 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2e8a expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835227.339023:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d2e91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2e8a expref: 19 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835227.339035:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd866f5a00/0xdf60171e5a5d2e91 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2e8a expref: 19 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835227.339046:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5a00, rc 0) 00000100:00100000:0.0:1788835227.339101:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+19:18562:x1875729254103552:12345-0@lo:101:mount.lustre.0 Request processed in 133us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835227.339108:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788835227.340412:0:18562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254103552:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788835227.340438:0:18562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d2e8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2e91 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835227.340451:0:18562:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d2e8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2e91 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788835227.342126:0:18562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788835227.343724:0:18562:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788835227.347660:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788835227.347737:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788835227.347754:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788835227.347767:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788835227.347782:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788835227.347796:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788835227.348123:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788835227.348141:0:18562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788835227.348663:0:18562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e817480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254103680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788835227.348753:0:18562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835227.348864:0:18562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba07db40 going to sleep for 11 seconds 00000100:00100000:2.0:1788835227.349081:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254103680 00000100:00100000:2.0:1788835227.349090:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254103680 00000100:00100000:2.0:1788835227.349216:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1788835227.349229:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8304a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+19:18562:x1875729254103680:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788835227.349479:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8304a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+19:18562:x1875729254103680:12345-0@lo:501:mount.lustre.0 Request processed in 252us (725us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835227.349487:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1788835227.349600:0:18562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e817480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254103680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788835227.349640:0:18562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e817480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254103808:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788835227.349692:0:18562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835227.349991:0:18562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba07db40 going to sleep for 11 seconds 00000100:00100000:0.0:1788835227.350213:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254103808 00000100:00100000:0.0:1788835227.350220:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254103808 00000100:00100000:0.0:1788835227.350257:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788835227.350266:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+19:18562:x1875729254103808:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788835227.352554:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+19:18562:x1875729254103808:12345-0@lo:503:mount.lustre.0 Request processed in 2276us (2849us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835227.352570:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1788835227.352757:0:18562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e817480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254103808:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788835227.353661:0:18562:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788835227.353807:0:18562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254103936:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788835227.353937:0:18562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835227.354141:0:18562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8663e240 going to sleep for 11 seconds 00000100:00100000:1.0:1788835227.354266:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254103936 00000100:00100000:1.0:1788835227.354275:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254103936 00000100:00100000:1.0:1788835227.354525:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788835227.354537:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+19:18562:x1875729254103936:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788835227.355242:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+19:18562:x1875729254103936:12345-0@lo:502:mount.lustre.0 Request processed in 705us (1302us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835227.355252:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1788835227.355373:0:18562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254103936:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788835227.355635:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1788835227.355667:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1788835227.355681:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1788835227.355692:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1788835227.355704:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1788835227.355716:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1788835227.355730:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1788835227.355744:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1788835227.355756:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:0.0:1788835227.355769:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:0.0:1788835227.355781:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:0.0:1788835227.355792:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:0.0:1788835227.355848:0:18562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254104064:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788835227.355895:0:18562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835227.356335:0:18562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8663e240 going to sleep for 11 seconds 00000100:00100000:2.0:1788835227.356496:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254104064 00000100:00100000:2.0:1788835227.356506:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254104064 00000100:00100000:2.0:1788835227.356555:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1788835227.356566:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8304b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+19:18562:x1875729254104064:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788835227.356695:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8304b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+19:18562:x1875729254104064:12345-0@lo:502:mount.lustre.0 Request processed in 131us (798us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835227.356703:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1788835227.356844:0:18562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254104064:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788835227.356911:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1788835227.356922:0:18562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 13 count 14 00000020:01000000:0.0:1788835227.357885:0:18579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1788835227.357897:0:18579:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of /dev/mapper/ost1_flakey 00000020:00000080:0.0:1788835227.357906:0:18579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835227.357909:0:18579:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1788835227.357915:0:18579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1788835227.357935:0:18579:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9afdaf55cd28) 00000020:00000080:0.0:1788835227.357963:0:18579:0:(obd_config.c:720:class_attach_name()) OBD: dev 22 attached type obdfilter with refcount 2 00000020:00000080:0.0:1788835227.357970:0:18579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1788835227.358062:0:18579:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afdc1d5c800 from lustre-OST0000, refs=2 00080000:01000000:0.0:1788835227.358071:0:18579:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:0.0:1788835227.358079:0:18579:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xdf60171e5a5d2e9f 00010000:00010000:0.0:1788835227.367591:0:18579:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-3 is initialized 00000001:00000004:0.0:1788835227.368297:0:18579:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967311 00080000:10000000:0.0:1788835227.370402:0:18579:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0000: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:0.0:1788835227.372593:0:18579:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1788835227.372608:0:18579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788835227.372617:0:18579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835227.372620:0:18579:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1788835227.372639:0:18579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1788835227.372642:0:18579:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #27 00000020:01000000:0.0:1788835227.372644:0:18579:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788835227.372646:0:18579:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1788835227.372648:0:18579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1788835227.372650:0:18579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835227.372652:0:18579:0:(obd_config.c:1563:class_process_config()) marker 27 (0x6) lustre sys.timeout 00000020:01000000:0.0:1788835227.372656:0:18579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788835227.372659:0:18579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835227.372660:0:18579:0:(obd_config.c:1563:class_process_config()) marker 36 (0x1) lustre sys.timeout 00000020:00000080:0.0:1788835227.372672:0:18579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1788835227.372674:0:18579:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1788835227.372677:0:18579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788835227.372679:0:18579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835227.372680:0:18579:0:(obd_config.c:1563:class_process_config()) marker 36 (0x2) lustre sys.timeout 00000020:01000000:0.0:1788835227.372684:0:18579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788835227.372686:0:18579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835227.372687:0:18579:0:(obd_config.c:1563:class_process_config()) marker 41 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1788835227.372691:0:18579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1788835227.372726:0:18579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788835227.372730:0:18579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835227.372731:0:18579:0:(obd_config.c:1563:class_process_config()) marker 41 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1788835227.372736:0:18579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1788835227.372976:0:18562:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1788835227.373017:0:18562:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1788835227.373037:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d2e8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2e91 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835227.373050:0:18562:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afc8374c200/0xdf60171e5a5d2e8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2e91 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835227.373059:0:18562:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afdc1d5c800 from 1 10000000:01000000:2.0:1788835227.373062:0:18562:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788835227.373111:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2ea6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835227.373126:0:18562:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2ea6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835227.373139:0:18562:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2ea6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835227.373182:0:18562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254104192:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788835227.373284:0:18562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835227.373357:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254104192 00000100:00100000:2.0:1788835227.373366:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254104192 00000100:00100000:2.0:1788835227.373417:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788835227.373427:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+19:18562:x1875729254104192:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788835227.373444:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835227.373460:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afc8374c600/0xdf60171e5a5d2ead lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2ea6 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835227.373487:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afc8374c600/0xdf60171e5a5d2ead lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2ea6 expref: 20 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835227.373498:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afc8374c600/0xdf60171e5a5d2ead lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2ea6 expref: 20 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835227.373507:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374c600, rc 0) 00000100:00100000:2.0:1788835227.373543:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+20:18562:x1875729254104192:12345-0@lo:101:mount.lustre.0 Request processed in 118us (260us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835227.373550:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1788835227.373615:0:18562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2ef53c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788835227.373648:0:18562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254104192:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788835227.373662:0:18562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2ea6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2ead expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835227.373672:0:18562:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2ea6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2ead expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788835227.377429:0:18562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788835227.377842:0:18562:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788835227.378085:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788835227.378113:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788835227.378132:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788835227.378138:0:18562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788835227.378820:0:18562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254104320:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788835227.378905:0:18562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835227.379008:0:18562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2ef5000 going to sleep for 11 seconds 00000100:00100000:3.0:1788835227.379718:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254104320 00000100:00100000:3.0:1788835227.379729:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254104320 00000100:00100000:3.0:1788835227.380535:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1788835227.380547:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+20:18562:x1875729254104320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788835227.380743:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+20:18562:x1875729254104320:12345-0@lo:501:mount.lustre.0 Request processed in 198us (1837us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835227.380757:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1788835227.381869:0:18562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254104320:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788835227.381943:0:18562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254104448:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788835227.382018:0:18562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835227.382068:0:18562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788835227.382249:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254104448 00000100:00100000:2.0:1788835227.382257:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254104448 00000100:00100000:2.0:1788835227.382339:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1788835227.382350:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+20:18562:x1875729254104448:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788835227.382479:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+20:18562:x1875729254104448:12345-0@lo:503:mount.lustre.0 Request processed in 131us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835227.382488:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1788835227.382694:0:18562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254104448:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788835227.383305:0:18562:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788835227.383436:0:18562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254104576:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788835227.383494:0:18562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835227.383528:0:18562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788835227.383623:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254104576 00000100:00100000:2.0:1788835227.383630:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254104576 00000100:00100000:2.0:1788835227.383667:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1788835227.383676:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+20:18562:x1875729254104576:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788835227.383778:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+20:18562:x1875729254104576:12345-0@lo:502:mount.lustre.0 Request processed in 102us (283us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835227.383792:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1788835227.383893:0:18562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254104576:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788835227.384084:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1788835227.384111:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1788835227.384125:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1788835227.384137:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1788835227.384294:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1788835227.385047:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1788835227.385091:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1788835227.385107:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:0.0:1788835227.385121:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1788835227.385135:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:0.0:1788835227.385289:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:0.0:1788835227.385453:0:18562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254104704:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788835227.385914:0:18562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835227.386013:0:18562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788835227.387137:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254104704 00000100:00100000:1.0:1788835227.387212:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254104704 00000100:00100000:1.0:1788835227.387283:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1788835227.387294:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+20:18562:x1875729254104704:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788835227.387643:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+20:18562:x1875729254104704:12345-0@lo:502:mount.lustre.0 Request processed in 350us (1729us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835227.387652:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1788835227.387750:0:18562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254104704:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788835227.387845:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:0.0:1788835227.387860:0:18562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:0.0:1788835227.389096:0:18583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788835227.389108:0:18583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835227.389112:0:18583:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1788835227.389127:0:18583:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afdc1d5c800 00000020:00000080:0.0:1788835227.389130:0:18583:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788835227.389140:0:18583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788835227.389142:0:18583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835227.389144:0:18583:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1788835227.389156:0:18583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788835227.389159:0:18583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835227.389161:0:18583:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1788835227.389164:0:18583:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afdc1d5c800 00000020:00000080:0.0:1788835227.389166:0:18583:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788835227.390005:0:18583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788835227.390013:0:18583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835227.390015:0:18583:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1788835227.390023:0:18583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788835227.390027:0:18583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835227.390028:0:18583:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788835227.390033:0:18583:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afdc1d5c800 00000020:00000080:0.0:1788835227.390041:0:18583:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788835227.390234:0:18583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788835227.390240:0:18583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835227.390241:0:18583:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1788835227.390247:0:18583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1788835227.390249:0:18583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835227.390251:0:18583:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:0.0:1788835227.390255:0:18583:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afdc1d5c800 00000020:00000080:0.0:1788835227.390257:0:18583:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1788835227.390293:0:18583:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1788835227.390297:0:18583:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1788835227.390298:0:18583:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:0.0:1788835227.390303:0:18583:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:0.0:1788835227.398369:0:18562:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:0.0:1788835227.398416:0:18562:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1788835227.398439:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2ea6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2ead expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835227.398453:0:18562:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2ea6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2ead expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1788835227.399332:0:18562:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1788835227.399337:0:18562:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9afdc1d5c800 10000000:01000000:0.0:1788835227.399341:0:18562:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9afdc1d5c800 10000000:01000000:0.0:1788835227.399345:0:18562:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1788835227.399354:0:18562:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afdc1d5c800 from 1 10000000:01000000:0.0:1788835227.399357:0:18562:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1788835227.399478:0:18562:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f4600/0xdf60171e5a5d2eb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835227.399489:0:18562:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd866f4600/0xdf60171e5a5d2eb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835227.399515:0:18562:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd866f4600/0xdf60171e5a5d2eb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835227.399546:0:18562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254104832:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1788835227.399632:0:18562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835227.399690:0:18562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c780 going to sleep for 11 seconds 00000100:00100000:1.0:1788835227.399823:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254104832 00000100:00100000:1.0:1788835227.399833:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254104832 00000100:00100000:1.0:1788835227.399886:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1788835227.399896:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+20:18562:x1875729254104832:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788835227.399911:0:17054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835227.399928:0:17054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e61a00/0xdf60171e5a5d2ebb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2eb4 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.399956:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e61a00/0xdf60171e5a5d2ebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2eb4 expref: 21 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.399968:0:17054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e61a00/0xdf60171e5a5d2ebb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2eb4 expref: 21 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.399979:0:17054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61a00, rc 0) 00000100:00100000:1.0:1788835227.401336:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+21:18562:x1875729254104832:12345-0@lo:101:mount.lustre.0 Request processed in 1432us (1695us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835227.401357:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1788835227.406648:0:18562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254104832:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1788835227.406692:0:18562:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd866f4600/0xdf60171e5a5d2eb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2ebb expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835227.406710:0:18562:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd866f4600/0xdf60171e5a5d2eb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2ebb expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1788835227.408675:0:18562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:0.0:1788835227.409732:0:18562:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1788835227.410281:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1788835227.410310:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1788835227.410354:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1788835227.410371:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1788835227.410407:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1788835227.410430:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1788835227.410621:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1788835227.410646:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1788835227.410665:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1788835227.410682:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1788835227.410698:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1788835227.410714:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1788835227.410729:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1788835227.410745:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1788835227.410777:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1788835227.410802:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1788835227.410826:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1788835227.410847:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1788835227.410970:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1788835227.410995:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1788835227.411029:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1788835227.411049:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1788835227.411068:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1788835227.411085:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1788835227.411103:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:0.0:1788835227.411120:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:0.0:1788835227.411137:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:0.0:1788835227.411269:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:0.0:1788835227.411288:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:0.0:1788835227.411302:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:0.0:1788835227.411342:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:0.0:1788835227.411363:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:0.0:1788835227.411380:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:0.0:1788835227.411395:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:0.0:1788835227.411409:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:0.0:1788835227.411425:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:0.0:1788835227.411603:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:0.0:1788835227.411637:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:0.0:1788835227.411644:0:18562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:0.0:1788835227.411786:0:18562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254104960:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788835227.411969:0:18562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835227.412034:0:18562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788835227.416760:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254104960 00000100:00100000:3.0:1788835227.416782:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254104960 00000100:00100000:3.0:1788835227.418011:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1788835227.418030:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+21:18562:x1875729254104960:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788835227.419008:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+21:18562:x1875729254104960:12345-0@lo:501:mount.lustre.0 Request processed in 981us (7035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835227.419021:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1788835227.424881:0:18562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254104960:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788835227.425887:0:18562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254105088:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788835227.426050:0:18562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835227.426124:0:18562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788835227.426166:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254105088 00000100:00100000:2.0:1788835227.427761:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254105088 00000100:00100000:2.0:1788835227.430062:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1788835227.430082:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+21:18562:x1875729254105088:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1788835227.430330:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+21:18562:x1875729254105088:12345-0@lo:503:mount.lustre.0 Request processed in 240us (4266us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835227.430338:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1788835227.430484:0:18562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254105088:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1788835227.431038:0:18562:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1788835227.431139:0:18562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254105216:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788835227.431196:0:18562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835227.433697:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254105216 00000100:00100000:0.0:1788835227.433714:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254105216 00000100:00100000:0.0:1788835227.433764:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788835227.433775:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+21:18562:x1875729254105216:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788835227.434093:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+21:18562:x1875729254105216:12345-0@lo:502:mount.lustre.0 Request processed in 318us (2896us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835227.434102:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1788835227.434682:0:18562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b2a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788835227.434714:0:18562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254105216:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788835227.435156:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1788835227.435296:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1788835227.435498:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1788835227.435527:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1788835227.435555:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1788835227.435569:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1788835227.435580:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1788835227.435594:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1788835227.435606:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1788835227.435619:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1788835227.435631:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1788835227.435644:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1788835227.435657:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1788835227.435670:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1788835227.435681:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1788835227.435695:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1788835227.435709:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1788835227.435721:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1788835227.435735:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1788835227.435749:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1788835227.435763:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1788835227.435779:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1788835227.435793:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1788835227.435809:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1788835227.435835:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:2.0:1788835227.435850:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:2.0:1788835227.435864:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:2.0:1788835227.435879:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:2.0:1788835227.435892:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:2.0:1788835227.436060:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:2.0:1788835227.436077:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:2.0:1788835227.436089:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:2.0:1788835227.436102:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:2.0:1788835227.436115:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:2.0:1788835227.436126:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:2.0:1788835227.436137:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:2.0:1788835227.436149:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:2.0:1788835227.436160:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:2.0:1788835227.436171:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:2.0:1788835227.436194:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:2.0:1788835227.436215:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:2.0:1788835227.436227:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:2.0:1788835227.436238:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:2.0:1788835227.436250:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:2.0:1788835227.436261:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:2.0:1788835227.436284:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000040:00080000:2.0:1788835227.436296:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:2.0:1788835227.436307:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:2.0:1788835227.436395:0:18562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254105344:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788835227.436481:0:18562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835227.436523:0:18562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2ef5180 going to sleep for 11 seconds 00000100:00100000:0.0:1788835227.437226:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254105344 00000100:00100000:0.0:1788835227.437236:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254105344 00000100:00100000:0.0:1788835227.437296:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1788835227.437305:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+21:18562:x1875729254105344:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788835227.437484:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+21:18562:x1875729254105344:12345-0@lo:502:mount.lustre.0 Request processed in 179us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835227.437492:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1788835227.437770:0:18562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254105344:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788835227.438075:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:2.0:1788835227.438101:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:2.0:1788835227.438130:0:18562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254105472:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788835227.438191:0:18562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835227.438236:0:18562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2ef5180 going to sleep for 11 seconds 00000100:00100000:0.0:1788835227.438341:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254105472 00000100:00100000:0.0:1788835227.438346:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254105472 00000100:00100000:0.0:1788835227.438378:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1788835227.438386:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+21:18562:x1875729254105472:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788835227.438461:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+21:18562:x1875729254105472:12345-0@lo:502:mount.lustre.0 Request processed in 74us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835227.438477:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1788835227.438624:0:18562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458f100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254105472:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788835227.438661:0:18562:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:2.0:1788835227.438669:0:18562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:0.0:1788835227.440087:0:18589:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1788835227.440106:0:18589:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9afdaf5599b8) 00000020:00000080:0.0:1788835227.440130:0:18589:0:(obd_config.c:720:class_attach_name()) OBD: dev 23 attached type lwp with refcount 2 00000020:01000004:2.0:1788835227.440630:0:18589:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afdc1d5c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788835227.440637:0:18589:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afdc1d5c800 from lustre-OST0000, refs=3 00000020:01000004:2.0:1788835227.440640:0:18589:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afdc1d5c800 3 00010000:00080000:2.0:1788835227.440675:0:18589:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afdbb2dc000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.122@tcp at head 00010000:00010000:3.0:1788835227.458742:0:18589:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-9 is initialized 00000020:00000080:3.0:1788835227.458972:0:18589:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1788835227.459032:0:18589:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788835227.459049:0:18589:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xdf60171e5a5d2ec9 00000100:00080000:3.0:1788835227.459068:0:18589:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788835227.459075:0:18589:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9afdbb2dc000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788835227.459120:0:18589:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afd9e814000 x1875729254105600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788835227.459152:0:18589:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1788835227.459282:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788835227.459288:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788835227.459291:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788835227.459294:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788835227.459335:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788835227.459339:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788835227.459341:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788835227.459344:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788835227.459358:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254105728:0@lo:400:kworker.0 00000100:00100000:1.0:1788835227.459377:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254105856:0@lo:400:kworker.0 00000100:00100000:3.0:1788835227.460070:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835227.460251:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835227.460387:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254105984:0@lo:400:kworker.0 00000100:00100000:1.0:1788835227.460424:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835227.460449:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788835227.460457:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254106112:0@lo:400:kworker.0 00000100:00100000:1.0:1788835227.460484:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835227.460597:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875729254105600:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788835227.460614:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254105856 00000100:00100000:3.0:1788835227.460623:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254105856 00000100:00100000:2.0:1788835227.460648:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835227.460670:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254106112 00000100:00100000:3.0:1788835227.460674:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254106112 00000100:00100000:3.0:1788835227.460693:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254105600 00000100:00100000:3.0:1788835227.460696:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254105600 00000100:00100000:3.0:1788835227.460738:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788835227.460749:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254105856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835227.460819:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254105856:12345-0@lo:400:kworker.0 Request processed in 72us (570us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835227.460827:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788835227.460847:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788835227.460854:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254106112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835227.460892:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254106112:12345-0@lo:400:kworker.0 Request processed in 39us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835227.460897:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788835227.460910:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788835227.460913:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3613:x1875729254105600:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788835227.460938:0:17062:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:3.0:1788835227.460988:0:17062:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xdf60171e5a5d2ed0 00000004:00100000:3.0:1788835227.461008:0:17062:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:1.0:1788835227.461152:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afdbfb92a00 x1875729254106112/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835227.461194:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254106112:0@lo:400:kworker.0 00000100:00080000:3.0:1788835227.461441:0:17062:0:(import.c:65:import_set_state_nolock()) ffff9afdbfa56800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788835227.461535:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3613:x1875729254105600:12345-0@lo:38:llog_process_th.0 Request processed in 620us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835227.461543:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000020:01000004:3.0:1788835227.461658:0:18589:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1788835227.461678:0:18589:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0000 (ffff9afdbd43b370) 00000020:00000080:3.0:1788835227.461700:0:18589:0:(obd_config.c:720:class_attach_name()) OBD: dev 24 attached type lwp with refcount 2 00000020:01000004:3.0:1788835227.461835:0:18589:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afdc1d5c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788835227.461841:0:18589:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afdc1d5c800 from lustre-OST0000, refs=3 00000020:01000004:3.0:1788835227.461844:0:18589:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afdc1d5c800 3 00010000:00080000:3.0:1788835227.461888:0:18589:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afdbb33e800@lustre-MDT0001-lwp-OST0000: add connection 192.168.203.122@tcp at head 00010000:00080000:2.0:1788835227.462242:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afdbfb93100 x1875729254105856/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835227.462255:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254105856:0@lo:400:kworker.0 00000100:00100000:2.0:1788835227.462378:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254105728 00000100:00100000:2.0:1788835227.462384:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254105728 00000100:00100000:2.0:1788835227.462413:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254105984 00000100:00100000:2.0:1788835227.462416:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254105984 00000100:00100000:2.0:1788835227.462429:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1788835227.462437:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254105728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835227.462498:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e816300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254105728:12345-0@lo:400:kworker.0 Request processed in 61us (2428us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835227.462505:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1788835227.462518:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254105728:0@lo:400:kworker.0 00000100:00100000:2.0:1788835227.463849:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:3.0:1788835227.463855:0:18589:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0000-10 is initialized 00000100:00100000:2.0:1788835227.463870:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254105984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835227.464021:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254105984:12345-0@lo:400:kworker.0 Request processed in 159us (3595us total) trans 0 rc 0/0 00000020:00000080:3.0:1788835227.464411:0:18589:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0000 (uuid lustre-MDT0001-lwp-OST0000_UUID) 00000010:01000000:3.0:1788835227.464466:0:18589:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788835227.464483:0:18589:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000, cookie 0xdf60171e5a5d2ede 00000100:00080000:3.0:1788835227.464493:0:18589:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788835227.464499:0:18589:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0000: import ffff9afdbb33e800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788835227.464537:0:18589:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afd9e815f80 x1875729254106240/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788835227.464556:0:18589:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0000_UUID->lustre-MDT0001_UUID 00000040:00080000:3.0:1788835227.464793:0:18589:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00010000:00080000:1.0:1788835227.465131:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afd9e814000 x1875729254105600/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788835237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835227.465144:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788835227.465233:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788835227.465243:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788835227.465248:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1788835227.465252:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdbb2dc000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788835227.465260:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3613:1875729254105600:0@lo:38:llog_process_th.0 00000100:00080000:1.0:1788835227.465279:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788835227.465284:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788835227.465287:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788835227.465290:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788835227.465294:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788835227.465297:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1788835227.465300:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1788835227.465303:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1788835227.465364:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254105984:0@lo:400:kworker.0 00000100:00100000:1.0:1788835227.465408:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875729254106240:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1788835227.465472:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835227.465520:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254106240 00000100:00100000:1.0:1788835227.465527:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254106240 00000100:00100000:1.0:1788835227.465561:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1788835227.465569:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3613:x1875729254106240:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1788835227.465596:0:17061:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 469 last 0 00000020:00000080:1.0:1788835227.465630:0:17061:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0000_UUID, cookie 0xdf60171e5a5d2ee5 00000004:00100000:1.0:1788835227.465649:0:17061:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1788835227.465684:0:17061:0:(import.c:65:import_set_state_nolock()) ffff9afdc1e0e000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788835227.465727:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3613:x1875729254106240:12345-0@lo:38:llog_process_th.0 Request processed in 158us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835227.465735:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1788835227.465780:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9afd9e815f80 x1875729254106240/t0(0) o38->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788835237 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835227.465790:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1788835227.465794:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1788835227.465799:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1788835227.465802:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:1.0:1788835227.465804:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdbb33e800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1788835227.465808:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0000_UUID:3613:1875729254106240:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1788835227.469689:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000020:01000000:2.0:1788835227.469821:0:18562:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:2.0:1788835227.469874:0:18562:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1788835227.469897:0:18562:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f4600/0xdf60171e5a5d2eb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2ebb expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835227.470896:0:18562:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd866f4600/0xdf60171e5a5d2eb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2ebb expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1788835227.471005:0:18562:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1788835227.471008:0:18562:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788835227.471010:0:18562:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788835227.471011:0:18562:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788835227.471012:0:18562:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788835227.471013:0:18562:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788835227.471016:0:18562:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788835227.471018:0:18562:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788835227.471019:0:18562:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788835227.471024:0:18562:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1788835227.471027:0:18562:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788835227.471028:0:18562:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788835227.471029:0:18562:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788835227.471030:0:18562:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788835227.471031:0:18562:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788835227.471032:0:18562:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788835227.471033:0:18562:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788835227.471034:0:18562:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788835227.471035:0:18562:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1788835227.471069:0:18562:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1788835227.471093:0:18562:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254106368:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788835227.471189:0:18562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835227.471248:0:18562:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2ef5180 going to sleep for 11 seconds 00000100:00100000:3.0:1788835227.472428:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254106368 00000100:00100000:3.0:1788835227.472440:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254106368 00000100:00100000:3.0:1788835227.472497:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1788835227.472507:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+21:18562:x1875729254106368:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1788835227.472554:0:17055:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1788835227.472571:0:17055:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788835227.484382:0:17055:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788835227.484401:0:17055:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1788835227.484634:0:17077:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1788835227.484640:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1788835227.484668:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d2eec lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.484693:0:17077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdb2e61200/0xdf60171e5a5d2e36 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2e2f expref: 21 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.484713:0:17077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afc8374c800/0xdf60171e5a5d2e44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2e3d expref: 21 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.484721:0:17077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d2eec lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.484771:0:17077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afc8374c800/0xdf60171e5a5d2e44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d2e3d expref: 21 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.484790:0:17077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afc8374c800/0xdf60171e5a5d2e44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d2e3d expref: 21 pid: 17055 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835227.484808:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17077:1875729254106496:0@lo:104: 00000100:00100000:1.0:1788835227.484895:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788835227.484963:0:17077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdb2e61200/0xdf60171e5a5d2e36 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d2e2f expref: 21 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.484972:0:17077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afdb2e61200/0xdf60171e5a5d2e36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d2e2f expref: 21 pid: 17053 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835227.484981:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17077:1875729254106624:0@lo:104: 00000100:00100000:1.0:1788835227.485011:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835227.485032:0:17077:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8b5da3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1788835227.485607:0:17043:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1788835227.485629:0:17043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254106496 00000100:00100000:1.0:1788835227.485637:0:17043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254106496 00000100:00100000:1.0:1788835227.485698:0:17043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254106624 00000100:00100000:1.0:1788835227.485702:0:17043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254106624 00000100:00100000:1.0:1788835227.485719:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788835227.485735:0:17043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+4:17077:x1875729254106496:12345-0@lo:104: 00010000:00010000:1.0:1788835227.485751:0:17043:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d2e3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2e44 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.485818:0:17043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1788835227.485825:0:17043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+4:17077:x1875729254106496:12345-0@lo:104: Request processed in 92us (931us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835227.485832:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788835227.485851:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788835227.485857:0:17043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba1b4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+3:17077:x1875729254106624:12345-0@lo:104: 00010000:00010000:1.0:1788835227.485864:0:17043:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60600/0xdf60171e5a5d2e2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2e36 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.485899:0:17043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1788835227.485904:0:17043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba1b4850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+3:17077:x1875729254106624:12345-0@lo:104: Request processed in 48us (895us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835227.485910:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:1.0:1788835227.485952:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788835227.485959:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d2e3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2e44 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.485966:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61000 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:1.0:1788835227.485971:0:17049:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d2e3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d2e44 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.485980:0:17049:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d2e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d2e44 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788835227.485988:0:17049:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d2e3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d2e44 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788835227.486000:0:17049:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788835227.487225:0:17049:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d2e3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2e44 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.487239:0:17049:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788835227.487275:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d2e3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2e44 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.487282:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61000/0xdf60171e5a5d2e3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2e44 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.487298:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788835227.487346:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60600/0xdf60171e5a5d2e2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2e36 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.487353:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60600 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:1.0:1788835227.487358:0:17049:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60600/0xdf60171e5a5d2e2f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d2e36 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835227.487360:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb888812-a79c-4531-9a69-89c757e37463:3616:1875729254106752:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788835227.487370:0:17049:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60600/0xdf60171e5a5d2e2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d2e36 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1788835227.487379:0:17049:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60600/0xdf60171e5a5d2e2f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d2e36 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788835227.487384:0:17049:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1788835227.487409:0:17049:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60600/0xdf60171e5a5d2e2f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2e36 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.487414:0:17049:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1788835227.487431:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60600/0xdf60171e5a5d2e2f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2e36 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835227.487437:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835227.487496:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1788835227.487505:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb888812-a79c-4531-9a69-89c757e37463:3616:1875729254106880:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1788835227.487534:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1788835227.487535:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60600/0xdf60171e5a5d2e2f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2e36 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.487553:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835227.487555:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835227.487557:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835227.487565:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835227.487742:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254106752 00000100:00100000:3.0:1788835227.487748:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254106752 00010000:00010000:3.0:1788835227.487777:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afc8374c800/0xdf60171e5a5d2e44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2e3d expref: 22 pid: 17055 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835227.487806:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254106880 00000100:00100000:3.0:1788835227.487810:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254106880 00010000:00010000:3.0:1788835227.487823:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdb2e61200/0xdf60171e5a5d2e36 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2e2f expref: 23 pid: 17053 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835227.487844:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788835227.487853:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e815180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb888812-a79c-4531-9a69-89c757e37463+23:3616:x1875729254106752:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1788835227.487868:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835227.487875:0:17045:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afc8374c800/0xdf60171e5a5d2e44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2e3d expref: 23 pid: 17055 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835227.487887:0:17045:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afc8374c800/0xdf60171e5a5d2e44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d2e3d expref: 23 pid: 17055 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835227.488806:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835227.488871:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e815180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:cb888812-a79c-4531-9a69-89c757e37463+23:3616:x1875729254106752:12345-0@lo:103:ldlm_bl.0 Request processed in 1017us (1433us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835227.488895:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1788835227.489043:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+23:18562:x1875729254106368:12345-0@lo:253:mount.lustre.0 Request processed in 16535us (17852us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835227.489053:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1788835227.489110:0:18215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788835227.489120:0:18215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbc361850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cb888812-a79c-4531-9a69-89c757e37463+22:3616:x1875729254106880:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788835227.489133:0:18215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835227.489140:0:18215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdb2e61200/0xdf60171e5a5d2e36 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2e2f expref: 22 pid: 17053 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.489152:0:18215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdb2e61200/0xdf60171e5a5d2e36 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d2e2f expref: 22 pid: 17053 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.489171:0:18215:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d2eec lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.489180:0:18215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d2eec lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1788835227.489197:0:18215:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004558061s 00010000:00010000:1.0:1788835227.489214:0:18215:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d2eec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.489229:0:18215:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d2eec lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.489236:0:18215:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d2eec lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.489243:0:18215:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d2eec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.489248:0:18215:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60200 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:1.0:1788835227.489252:0:18215:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d2eec lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.489260:0:18215:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d2eec lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.489269:0:18215:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d2eec lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.489279:0:18215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788835227.489311:0:18215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbc361850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cb888812-a79c-4531-9a69-89c757e37463+22:3616:x1875729254106880:12345-0@lo:103:ldlm_bl.0 Request processed in 193us (1777us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835227.489333:0:18215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1788835227.489502:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb888812-a79c-4531-9a69-89c757e37463:3616:1875729254106880:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1788835227.489515:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb888812-a79c-4531-9a69-89c757e37463:3616:1875729254106752:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1788835227.490195:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afc8374c800/0xdf60171e5a5d2e44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d2e3d expref: 20 pid: 17055 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835227.490221:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17077:1875729254106496:0@lo:104: 00010000:00010000:1.0:1788835227.490234:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e61200/0xdf60171e5a5d2e36 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d2e2f expref: 19 pid: 17053 timeout: 569 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835227.490258:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17077:1875729254106624:0@lo:104: 00010000:00010000:1.0:1788835227.490276:0:17077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d2eec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.490286:0:17077:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d2eec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.490292:0:17077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d2eec lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835227.490298:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d2eec lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835227.491338:0:18562:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458c000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:18562:1875729254106368:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1788835227.491371:0:18562:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1788835227.491375:0:18562:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1788835227.491377:0:18562:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1788835227.491379:0:18562:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788835227.491380:0:18562:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788835227.491382:0:18562:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788835227.491383:0:18562:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788835227.491385:0:18562:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788835227.491387:0:18562:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788835227.491388:0:18562:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1788835227.491405:0:18562:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00000001:00000004:3.0:1788835227.504474:0:18562:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1788835227.516889:0:18562:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1788835227.516903:0:18562:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1788835227.516954:0:18562:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1788835227.517014:0:18562:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1788835227.517042:0:18562:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:3.0:1788835227.517068:0:18562:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost1_flakey: Mount complete 00000020:00000004:3.0:1788835227.518075:0:18562:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:3.0:1788835227.518378:0:18562:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:1.0:1788835227.813986:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788835228.318264:0:18644:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788835228.318937:0:18644:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788835228.455956:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254107008:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788835228.456027:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835228.456072:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788835228.456079:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254107136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788835228.456103:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835228.456148:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254107008 00000100:00100000:1.0:1788835228.456155:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254107008 00000100:00100000:1.0:1788835228.456207:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254107136 00000100:00100000:1.0:1788835228.456211:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254107136 00000100:00100000:1.0:1788835228.456227:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788835228.456236:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254107008:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788835228.456271:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788835228.456346:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254107008:12345-0@lo:41:osp-pre-1-0.0 Request processed in 110us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835228.456354:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1788835228.456370:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788835228.456376:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254107136:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788835228.456394:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788835228.456421:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254107136:12345-0@lo:41:osp-pre-0-1.0 Request processed in 45us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835228.456427:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788835228.456466:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb92300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254107136:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788835228.456478:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254107008:0@lo:41:osp-pre-1-0.0 00010000:00010000:1.0:1788835228.837800:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1788835229.157571:0:17057:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1788835229.157579:0:17057:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afd87f3f800 from 9 10000000:01000000:0.0:1788835229.157584:0:17057:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1788835229.157629:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d2ef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835229.157642:0:17057:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d2ef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835229.157653:0:17057:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d2ef3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835229.157676:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254107264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1788835229.157743:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835229.157790:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdba1b2540 going to sleep for 11 seconds 00000100:00100000:2.0:1788835229.157857:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254107264 00000100:00100000:2.0:1788835229.157865:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254107264 00000100:00100000:2.0:1788835229.157917:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1788835229.157927:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+19:17057:x1875729254107264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788835229.157940:0:17054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835229.157954:0:17054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2efa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2ef3 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835229.157976:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2ef3 expref: 20 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835229.157987:0:17054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2ef3 expref: 20 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835229.157997:0:17054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374d800, rc 0) 00000100:00100000:2.0:1788835229.158048:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+20:17057:x1875729254107264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835229.158055:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1788835229.158225:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254107264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788835229.158239:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d2ef3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2efa expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835229.158248:0:17057:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d2ef3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2efa expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835229.158350:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254107392:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788835229.158391:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835229.158423:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd918abf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788835229.158478:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254107392 00000100:00100000:0.0:1788835229.158484:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254107392 00000100:00100000:0.0:1788835229.158524:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1788835229.158533:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+20:17057:x1875729254107392:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788835229.158548:0:17053:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788835229.158566:0:17053:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788835229.158575:0:17053:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788835229.158657:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+20:17057:x1875729254107392:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 124us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835229.158664:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1788835229.158807:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254107392:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788835229.158864:0:17057:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788835229.158872:0:17057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d2ef3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2efa expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835229.158885:0:17057:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d2ef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2efa expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788835229.158895:0:17057:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788835229.158897:0:17057:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afc8447d000 from 9 10000000:01000000:1.0:1788835229.158899:0:17057:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788835229.158918:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61400/0xdf60171e5a5d2f01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835229.158925:0:17057:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61400/0xdf60171e5a5d2f01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835229.158933:0:17057:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61400/0xdf60171e5a5d2f01 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835229.158945:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254107520:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788835229.158972:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835229.158997:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd918abf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788835229.159045:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254107520 00000100:00100000:0.0:1788835229.159050:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254107520 00000100:00100000:0.0:1788835229.159087:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1788835229.159093:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+20:17057:x1875729254107520:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788835229.159100:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835229.159111:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2f08 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2f01 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835229.159127:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2f08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2f01 expref: 21 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835229.159138:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2f08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2f01 expref: 21 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835229.159145:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5600, rc 0) 00000100:00100000:0.0:1788835229.159173:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+21:17057:x1875729254107520:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835229.159179:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1788835229.159256:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254107520:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788835229.159276:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61400/0xdf60171e5a5d2f01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2f08 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835229.159285:0:17057:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61400/0xdf60171e5a5d2f01 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2f08 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835229.159354:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254107648:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788835229.159382:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835229.159408:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd918abf00 going to sleep for 11 seconds 00000100:00100000:0.0:1788835229.159788:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254107648 00000100:00100000:0.0:1788835229.159793:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254107648 00000100:00100000:0.0:1788835229.159826:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1788835229.159834:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+21:17057:x1875729254107648:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1788835229.159846:0:17053:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1788835229.159861:0:17053:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1788835229.159863:0:17053:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 9 00000100:00100000:0.0:1788835229.159934:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+21:17057:x1875729254107648:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 101us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835229.159941:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1788835229.160054:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254107648:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788835229.160107:0:17057:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788835229.160114:0:17057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61400/0xdf60171e5a5d2f01 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2f08 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835229.160122:0:17057:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61400/0xdf60171e5a5d2f01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2f08 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835229.861416:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835230.886635:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788835231.399520:0:17095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1788835231.909457:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788835232.552586:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788835232.552593:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788835232.552606:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788835232.552609:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788835232.552636:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788835232.552640:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788835232.552642:0:479:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788835232.552645:0:479:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788835232.552692:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254107904:0@lo:400:kworker.0 00000100:00100000:2.0:1788835232.552818:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835232.552865:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254108416:0@lo:400:kworker.0 00000100:00100000:2.0:1788835232.552917:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835232.552943:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1788835232.552950:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb888812-a79c-4531-9a69-89c757e37463:3617:1875729254107776:0@lo:400:kworker.0 00000100:00100000:2.0:1788835232.552977:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835232.552994:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729254108288:0@lo:400:kworker.0 00000100:00100000:2.0:1788835232.553012:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835232.553034:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729254108032:0@lo:400:kworker.0 00000100:00100000:2.0:1788835232.553052:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835232.553065:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254108544:0@lo:400:kworker.0 00000100:00100000:2.0:1788835232.553086:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835232.553223:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254107776 00000100:00100000:0.0:1788835232.553242:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254107776 00000100:00100000:0.0:1788835232.553287:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1788835232.553295:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+21:3617:x1875729254107776:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835232.553367:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+21:3617:x1875729254107776:12345-0@lo:400:kworker.0 Request processed in 72us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835232.553374:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1788835232.553577:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1788835232.553586:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254108160:0@lo:400:kworker.0 00000100:00100000:2.0:1788835232.553616:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835232.553939:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254107904 00000100:00100000:0.0:1788835232.553945:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254107904 00000100:00100000:0.0:1788835232.553974:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254108160 00000100:00100000:0.0:1788835232.553977:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254108160 00000100:00100000:0.0:1788835232.553991:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788835232.553997:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254107904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835232.554039:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254107904:12345-0@lo:400:kworker.0 Request processed in 41us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835232.554045:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1788835232.554058:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1788835232.554063:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254108160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835232.554105:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254108160:12345-0@lo:400:kworker.0 Request processed in 31us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835232.554110:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788835232.554368:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254108416 00000100:00100000:3.0:1788835232.554374:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254108416 00000100:00100000:3.0:1788835232.554414:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254108288 00000100:00100000:3.0:1788835232.554417:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254108288 00000100:00100000:3.0:1788835232.554433:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254108032 00000100:00100000:3.0:1788835232.554435:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254108032 00000100:00100000:3.0:1788835232.554445:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254108544 00000100:00100000:3.0:1788835232.554448:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254108544 00000100:00100000:3.0:1788835232.554462:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788835232.554468:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254108416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835232.554506:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254108416:12345-0@lo:400:kworker.0 Request processed in 38us (1588us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835232.554511:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1788835232.554524:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788835232.554529:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729254108288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835232.554554:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729254108288:12345-0@lo:400:kworker.0 Request processed in 25us (1542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835232.554560:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1788835232.554585:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788835232.554590:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729254108032:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835232.554618:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729254108032:12345-0@lo:400:kworker.0 Request processed in 28us (1565us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835232.554623:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1788835232.554634:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1788835232.554639:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254108544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835232.554660:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254108544:12345-0@lo:400:kworker.0 Request processed in 22us (1573us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835232.554665:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:0.0:1788835232.556214:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788835232.556222:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788835232.556571:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb888812-a79c-4531-9a69-89c757e37463:3617:1875729254107776:0@lo:400:kworker.0 00010000:00080000:0.0:1788835232.556597:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc8458d880 x1875729254108288/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835232.556609:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729254108288:0@lo:400:kworker.0 00000100:00100000:0.0:1788835232.556622:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254107904:0@lo:400:kworker.0 00010000:00080000:0.0:1788835232.556638:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc8458c380 x1875729254108416/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835232.556646:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254108416:0@lo:400:kworker.0 00000100:00100000:2.0:1788835232.556750:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254108160:0@lo:400:kworker.0 00010000:00080000:2.0:1788835232.556772:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc8458ea00 x1875729254108032/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835232.556781:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729254108032:0@lo:400:kworker.0 00010000:00080000:2.0:1788835232.556792:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc8458dc00 x1875729254108544/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835232.556800:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254108544:0@lo:400:kworker.0 00010000:00010000:1.0:1788835232.934646:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788835233.313017:0:18933:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:1.0:1788835233.574479:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254108672:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788835233.574550:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835233.574713:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254108672 00000100:00100000:0.0:1788835233.574720:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254108672 00000100:00100000:0.0:1788835233.574772:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1788835233.574781:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254108672:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:0.0:1788835233.574815:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788835233.574862:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254108672:12345-0@lo:41:osp-pre-1-0.0 Request processed in 82us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835233.574870:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788835233.575030:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb90000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254108672:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788835233.575087:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254108800:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788835233.575136:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835233.575220:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254108800 00000100:00100000:2.0:1788835233.575226:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254108800 00000100:00100000:2.0:1788835233.575258:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1788835233.575276:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254108800:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:2.0:1788835233.575299:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788835233.575363:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254108800:12345-0@lo:41:osp-pre-0-1.0 Request processed in 98us (227us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835233.575371:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788835233.575452:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254108800:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788835233.957544:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788835234.272405:0:18985:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788835234.272663:0:18985:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000040:00080000:0.0:1788835234.411616:0:17814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788835234.987658:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788835235.165298:0:19036:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0000: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788835235.165770:0:19036:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788835236.009967:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835237.031996:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1788835237.672734:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788835237.672743:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788835237.672747:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788835237.672750:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788835237.672784:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788835237.672787:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1788835237.672789:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788835237.672792:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1788835237.673089:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb888812-a79c-4531-9a69-89c757e37463:3617:1875729254108928:0@lo:400:kworker.0 00000100:00100000:2.0:1788835237.674668:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835237.674756:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729254109440:0@lo:400:kworker.0 00000100:00100000:2.0:1788835237.674793:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835237.674830:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788835237.675070:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254109056:0@lo:400:kworker.0 00000100:00100000:1.0:1788835237.675205:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835237.675240:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729254109568:0@lo:400:kworker.0 00000100:00100000:1.0:1788835237.675264:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835237.675285:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1788835237.675292:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729254109184:0@lo:400:kworker.0 00000100:00100000:1.0:1788835237.675362:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835237.675386:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254109696:0@lo:400:kworker.0 00000100:00100000:1.0:1788835237.675410:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835237.675626:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254109312:0@lo:400:kworker.0 00000100:00100000:2.0:1788835237.675665:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835237.675718:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254108928 00000100:00100000:2.0:1788835237.675727:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254108928 00000100:00100000:2.0:1788835237.675789:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1788835237.675801:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+21:3617:x1875729254108928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835237.676188:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254109056 00000100:00100000:1.0:1788835237.676195:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254109056 00000100:00100000:1.0:1788835237.676235:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254109312 00000100:00100000:1.0:1788835237.676238:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254109312 00000100:00100000:1.0:1788835237.676256:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788835237.676264:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254109056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835237.676363:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254109056:12345-0@lo:400:kworker.0 Request processed in 99us (1157us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835237.676372:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788835237.676394:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788835237.676401:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254109312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835237.676445:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254109312:12345-0@lo:400:kworker.0 Request processed in 45us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835237.676451:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1788835237.677589:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+21:3617:x1875729254108928:12345-0@lo:400:kworker.0 Request processed in 1784us (2923us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835237.678033:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1788835237.678244:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254109440 00000100:00100000:1.0:1788835237.678253:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254109440 00000100:00100000:1.0:1788835237.678290:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254109568 00000100:00100000:1.0:1788835237.678294:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254109568 00000100:00100000:1.0:1788835237.678335:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254109184 00000100:00100000:1.0:1788835237.678343:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254109184 00000100:00100000:1.0:1788835237.678356:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254109696 00000100:00100000:1.0:1788835237.678358:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254109696 00000100:00100000:1.0:1788835237.678375:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788835237.678382:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729254109440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835237.678458:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729254109440:12345-0@lo:400:kworker.0 Request processed in 75us (3663us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835237.679015:0:17060:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1788835237.679025:0:17060:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1788835237.679095:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254109312:0@lo:400:kworker.0 00000100:00080000:0.0:1788835237.679399:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788835237.679405:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788835237.679491:0:17062:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788835237.679509:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788835237.679533:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729254109568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835237.681843:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1788835237.681893:0:17061:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1788835237.681906:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788835237.681920:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729254109184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835237.682151:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3614:x1875729254109568:12345-0@lo:400:kworker.0 Request processed in 2621us (6883us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835237.682159:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788835237.682176:0:17062:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1788835237.682187:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1788835237.682209:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254109696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835237.682249:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254109696:12345-0@lo:400:kworker.0 Request processed in 56us (6838us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835237.682256:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1788835237.689817:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb888812-a79c-4531-9a69-89c757e37463:3617:1875729254108928:0@lo:400:kworker.0 00010000:00080000:0.0:1788835237.689817:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc8458c000 x1875729254109696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835237.689951:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254109696:0@lo:400:kworker.0 00010000:00080000:2.0:1788835237.691142:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc8458df80 x1875729254109440/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835237.691163:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729254109440:0@lo:400:kworker.0 00000100:00100000:0.0:1788835237.692579:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254109056:0@lo:400:kworker.0 00010000:00080000:0.0:1788835237.692634:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc8458d880 x1875729254109568/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835237.692650:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3614:1875729254109568:0@lo:400:kworker.0 00010000:00080000:0.0:1788835237.692686:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc8458dc00 x1875729254109184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835237.692696:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3614:1875729254109184:0@lo:400:kworker.0 00000100:00100000:1.0:1788835237.694884:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3614:x1875729254109184:12345-0@lo:400:kworker.0 Request processed in 8084us (14637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835237.694903:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1788835237.733684:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788835222/real 1788835222] req@ffff9afdbf9bbb80 x1875729254100992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788835237 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835237.733731:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9afdbf9bbb80 x1875729254100992/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788835237 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835237.733743:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788835222/real 1788835222] req@ffff9afdbf9bad80 x1875729254101120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788835237 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835237.733755:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9afdbf9bad80 x1875729254101120/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788835237 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1788835237.733780:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc830f8000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788835237.733814:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788835237.733818:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254100992:0@lo:8:kworker.0 00000100:00080000:1.0:1788835237.733823:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc830ff800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788835237.733829:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1788835237.733832:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254101120:0@lo:8:kworker.0 00000100:00080000:0.0:1788835237.733933:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788835237.733939:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788835237.733942:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788835237.733962:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788835237.733967:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788835237.733970:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1788835237.733973:0:8:0:(import.c:65:import_set_state_nolock()) ffff9afc830f8000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788835237.733978:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0001: connect to NID 0@lo last attempt 464 00000100:00080000:0.0:1788835237.733984:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788835237.733993:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0001: import ffff9afc830f8000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1788835237.734033:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbfa2ca80 x1875729254109824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1788835237.734058:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788835237.734061:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788835237.734063:0:8:0:(import.c:65:import_set_state_nolock()) ffff9afc830ff800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788835237.734066:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 464 00000100:00080000:0.0:1788835237.734068:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1788835237.734072:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9afc830ff800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1788835237.734082:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbfa2c380 x1875729254109952/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1788835237.734196:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254109824:0@lo:8:kworker.0 00000100:00100000:1.0:1788835237.734274:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835237.734369:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254109952:0@lo:8:kworker.0 00000100:00100000:1.0:1788835237.734392:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835237.734450:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254109824 00000100:00100000:1.0:1788835237.734460:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254109824 00000100:00100000:1.0:1788835237.734489:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254109952 00000100:00100000:1.0:1788835237.734492:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254109952 00000100:00100000:1.0:1788835237.734506:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788835237.734514:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3613:x1875729254109824:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788835237.734547:0:18568:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:1.0:1788835237.734580:0:18568:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdf60171e5a5d2f0f 00002000:00100000:1.0:1788835237.734597:0:18568:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0001-mdtlov_UUID/ffff9afdc1e0a000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 0 ocd_group 1 00002000:00080000:1.0:1788835237.734602:0:18568:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 1 00002000:00100000:1.0:1788835237.734605:0:18568:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788835237.734825:0:18568:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 1 00000100:00080000:1.0:1788835237.734854:0:18568:0:(import.c:65:import_set_state_nolock()) ffff9afdc1e0f000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788835237.734917:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9bad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+6:3613:x1875729254109824:12345-0@lo:8:kworker.0 Request processed in 402us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835237.734925:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1788835237.734945:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1788835237.734950:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3613:x1875729254109952:12345-0@lo:8:kworker.0 00010000:00020000:1.0:1788835237.734962:0:18568:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00010000:00080000:0.0:1788835237.736809:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdbfa2ca80 x1875729254109824/t0(0) o8->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788835257 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835237.736827:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788835237.736838:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0001: connect to target with instance 2 00000100:00080000:0.0:1788835237.736849:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1788835237.736856:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1788835237.736860:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc830f8000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1788835237.736895:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1788835237.736903:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254109824:0@lo:8:kworker.0 00000004:00080000:0.0:1788835237.736989:0:17803:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: going to cleanup orphans since [0x280000400:0x1:0x0] 00000100:00100000:0.0:1788835237.737018:0:17803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17803:1875729254110208:0@lo:7:osp-pre-0-1.0 00000100:00100000:0.0:1788835237.737088:0:17803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835237.737122:0:17803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb38a6180 going to sleep for 11 seconds 00000004:00080000:0.0:1788835237.737151:0:17802:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788835237.737260:0:17802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0001: add commit cb at 479778944581ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788835237.737268:0:17802:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788835237.737299:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254110080:0@lo:13:osp-pre-0-1.0 00000100:00100000:0.0:1788835237.737356:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835237.737563:0:18567:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1788835237.737573:0:18567:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1788835237.738618:0:18569:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1788835237.738641:0:18569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254110208 00000100:00100000:3.0:1788835237.738660:0:18569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254110208 00000100:00080000:0.0:1788835237.739251:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788835237.739298:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254110080 00000100:00100000:0.0:1788835237.739330:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254110080 00000100:00100000:0.0:1788835237.739367:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788835237.739378:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3616:x1875729254110080:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788835237.739420:0:18570:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788835237.739636:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3616:x1875729254110080:12345-0@lo:13:osp-pre-0-1.0 Request processed in 259us (2277us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835237.739659:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1788835237.739718:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdbfa2ca80 x1875729254110080/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835253 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835237.739742:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254110080:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788835237.745626:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1788835237.745650:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17803:x1875729254110208:12345-0@lo:7:osp-pre-0-1.0 00000004:00080000:3.0:1788835237.757120:0:17793:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0001: 1 committed 00002000:00080000:3.0:1788835237.760637:0:19151:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000400 00002000:00080000:3.0:1788835237.760649:0:19151:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x280000400:0x21:0x0] 00000100:00100000:3.0:1788835237.760785:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17803:x1875729254110208:12345-0@lo:7:osp-pre-0-1.0 Request processed in 15137us (23689us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835237.760798:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1788835237.761048:0:17803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdbfa2d180 x1875729254110208/t0(0) o7->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788835253 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835237.761076:0:17803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2d180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17803:1875729254110208:0@lo:7:osp-pre-0-1.0 00000004:00080000:2.0:1788835237.761093:0:17803:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0001: Got last_fid [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788835237.761155:0:17803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845ff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17803:1875729254110336:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788835237.761203:0:17803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835237.761237:0:17803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82e76840 going to sleep for 11 seconds 00000100:00100000:3.0:1788835237.761447:0:18569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254110336 00000100:00100000:3.0:1788835237.761455:0:18569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254110336 00000100:00100000:3.0:1788835237.761506:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1788835237.761515:0:18569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17803:x1875729254110336:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788835237.761546:0:18569:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:3.0:1788835237.761576:0:18569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+6:17803:x1875729254110336:12345-0@lo:5:osp-pre-0-1.0 Request processed in 62us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835237.761582:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788835237.762784:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9bbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3613:x1875729254109952:12345-0@lo:8:kworker.0 Request processed in 27822us (28381us total) trans 0 rc -19/-19 00000100:00100000:1.0:1788835237.762797:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:1.0:1788835237.762849:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc830ff800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1788835237.762856:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:1.0:1788835237.762869:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254109952:0@lo:8:kworker.0 00010000:00080000:2.0:1788835237.763261:0:17803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc845ff480 x1875729254110336/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788835253 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835237.763276:0:17803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845ff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17803:1875729254110336:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788835237.763290:0:17803:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0001: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x21:0x0] 00000100:00100000:2.0:1788835237.763360:0:17803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845ff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17803:1875729254110464:0@lo:5:osp-pre-0-1.0 00000100:00100000:2.0:1788835237.763405:0:17803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835237.763447:0:17803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82e76840 going to sleep for 11 seconds 00000100:00100000:3.0:1788835237.763794:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254110464 00000100:00100000:3.0:1788835237.763802:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254110464 00000100:00100000:3.0:1788835237.763900:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1788835237.763911:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17803:x1875729254110464:12345-0@lo:5:osp-pre-0-1.0 00002000:00080000:3.0:1788835237.763955:0:19151:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000400 at 34 00000001:00080000:2.0:1788835237.806493:0:18563:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:2.0:1788835237.806518:0:18563:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000100:00100000:0.0:1788835237.807261:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:17803:x1875729254110464:12345-0@lo:5:osp-pre-0-1.0 Request processed in 43343us (43847us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788835237.807297:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788835237.808350:0:17803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc845ff480 x1875729254110464/t0(0) o5->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788835253 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835237.808367:0:17803:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1788835237.808375:0:17803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845ff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0001-mdtlov_UUID:17803:1875729254110464:0@lo:5:osp-pre-0-1.0 00000004:00080000:2.0:1788835237.808395:0:17803:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0001: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:2.0:1788835237.808460:0:17803:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845ff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17803:1875729254110592:0@lo:900:osp-pre-0-1.0 00000100:00100000:2.0:1788835237.808522:0:17803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835237.808561:0:17803:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82e76840 going to sleep for 11 seconds 00000100:00100000:3.0:1788835237.810685:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254110592 00000100:00100000:3.0:1788835237.810702:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254110592 00000100:00100000:3.0:1788835237.810782:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1788835237.810795:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17803:x1875729254110592:12345-0@lo:900:osp-pre-0-1.0 00000100:00100000:3.0:1788835237.810923:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17803:x1875729254110592:12345-0@lo:900:osp-pre-0-1.0 Request processed in 130us (2400us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835237.810931:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788835237.811419:0:17803:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc845ff480 x1875729254110592/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788835253 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835237.811440:0:17803:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845ff480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-1:lustre-MDT0000-lwp-MDT0001_UUID:17803:1875729254110592:0@lo:900:osp-pre-0-1.0 00010000:00010000:1.0:1788835238.053545:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835238.693596:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1788835238.693626:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254110720:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788835238.693720:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835238.693792:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254110720 00000100:00100000:1.0:1788835238.693803:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254110720 00000100:00100000:1.0:1788835238.693859:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788835238.693869:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254110720:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788835238.693911:0:17801:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788835238.694540:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1788835238.694555:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254110848:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835238.694598:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835238.694632:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254110848 00000100:00100000:3.0:1788835238.694636:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254110848 00000100:00100000:3.0:1788835238.694661:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788835238.694668:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254110848:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788835238.694693:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788835238.694747:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e814000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254110848:12345-0@lo:41:osp-pre-1-0.0 Request processed in 78us (147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835238.694755:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1788835238.694804:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254110848:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788835238.695741:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254110720:12345-0@lo:41:osp-pre-0-1.0 Request processed in 1868us (2016us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835238.695752:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1788835238.696052:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254110720:0@lo:41:osp-pre-0-1.0 00010000:00010000:0.0:1788835239.078207:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835240.103190:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835241.126615:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1788835241.639375:0:17095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1788835242.149644:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1788835242.585544:0:19383:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1788835242.585550:0:19383:0:(obd_mount.c:926:lmd_print()) device: /dev/mapper/ost2_flakey 00000020:01000004:0.0:1788835242.585552:0:19383:0:(obd_mount.c:929:lmd_print()) options: errors=remount-ro 00000080:01200004:0.0:1788835242.585862:0:19383:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9afc8239b800 00000020:01000004:0.0:1788835242.585881:0:19383:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-ldiskfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1788835242.585899:0:19383:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-ldiskfs) 00000020:00000080:0.0:1788835242.585917:0:19383:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9afdaf558000) 00000020:00000080:0.0:1788835242.585940:0:19383:0:(obd_config.c:720:class_attach_name()) OBD: dev 25 attached type osd-ldiskfs with refcount 2 00100000:10000000:2.0:1788835242.669298:0:19383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/24) registered 00100000:10000000:2.0:1788835242.669954:0:19383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/32) registered 00100000:10000000:2.0:1788835242.670184:0:19383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x4:0x0] (8/32) registered 00100000:10000000:2.0:1788835242.670558:0:19383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8) registered 00100000:10000000:2.0:1788835242.671571:0:19383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8) registered 00100000:10000000:2.0:1788835242.671923:0:19383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8) registered 00100000:10000000:2.0:1788835242.672152:0:19383:0:(osd_scrub.c:1808:osd_ios_index_register()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/32) registered 00080000:01000000:3.0:1788835242.675160:0:19383:0:(osd_lproc.c:911:osd_procfs_init()) lustre-OST0001: register osd-ldiskfs tunable parameters 00000020:00000080:3.0:1788835242.681085:0:19383:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1788835242.681112:0:19383:0:(osd_handler.c:8925:osd_obd_connect()) connect #0 00000020:00000080:3.0:1788835242.681145:0:19383:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdf60171e5a5d2f1d 00000020:01000004:3.0:1788835242.681153:0:19383:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device /dev/mapper/ost2_flakey 00000020:01000004:3.0:1788835242.681174:0:19383:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.122@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1788835242.681178:0:19383:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.122@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1788835242.681184:0:19383:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1788835242.681219:0:19383:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for /dev/mapper/ost2_flakey 10000000:01000000:3.0:1788835242.681223:0:19383:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.122@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1788835242.703737:0:19383:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.122@tcp ctxt 0 is initialized 00000020:01000004:2.0:1788835242.703783:0:19383:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.122@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1788835242.703788:0:19383:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1788835242.703790:0:19383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788835242.703792:0:19383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788835242.703793:0:19383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788835242.703795:0:19383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788835242.703796:0:19383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788835242.703797:0:19383:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788835242.703800:0:19383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788835242.703802:0:19383:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788835242.703806:0:19383:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1788835242.703809:0:19383:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1788835242.703810:0:19383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1788835242.703811:0:19383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1788835242.703812:0:19383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1788835242.703814:0:19383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1788835242.703815:0:19383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1788835242.703816:0:19383:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1788835242.703817:0:19383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1788835242.703818:0:19383:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1788835242.703850:0:19383:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1788835242.703874:0:19383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254110976:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1788835242.703973:0:19383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835242.704082:0:19383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb38a69c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788835242.704181:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254110976 00000100:00100000:0.0:1788835242.704190:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254110976 00000100:00100000:0.0:1788835242.704276:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1788835242.704286:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+21:19383:x1875729254110976:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1788835242.704359:0:17055:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1788835242.704363:0:17055:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1788835242.704367:0:17055:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1788835242.704697:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+21:19383:x1875729254110976:12345-0@lo:253:mount.lustre.0 Request processed in 411us (723us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835242.704706:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1788835242.704795:0:19383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845ff480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254110976:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1788835242.704807:0:19383:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1788835242.704809:0:19383:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1788835242.704811:0:19383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1788835242.704812:0:19383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1788835242.704813:0:19383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1788835242.704814:0:19383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1788835242.704815:0:19383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1788835242.704817:0:19383:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1788835242.704818:0:19383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1788835242.704819:0:19383:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1788835242.704842:0:19383:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9afc8239b800 from lustre-OST0001 10000000:01000000:3.0:1788835242.704873:0:19383:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1788835242.704876:0:19383:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788835242.704886:0:19383:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9afdbf93b370 local copy 00010000:00010000:3.0:1788835242.704897:0:19383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374d000/0xdf60171e5a5d2c37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2c3e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835242.704993:0:19383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254111104:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788835242.705023:0:19383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835242.705334:0:19383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2e0ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788835242.705431:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254111104 00000100:00100000:2.0:1788835242.705437:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254111104 00000100:00100000:2.0:1788835242.705469:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1788835242.705476:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+21:19383:x1875729254111104:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788835242.705549:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+21:19383:x1875729254111104:12345-0@lo:501:mount.lustre.0 Request processed in 72us (524us total) trans 0 rc -2/-2 00000100:00100000:2.0:1788835242.705556:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1788835242.705649:0:19383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254111104:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1788835242.705664:0:19383:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.122@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1788835242.705682:0:19383:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.122@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1788835242.705700:0:19383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374d000/0xdf60171e5a5d2c37 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2c3e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835242.705710:0:19383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afc8374d000/0xdf60171e5a5d2c37 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2c3e expref: -99 pid: 17039 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788835242.705742:0:19383:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9afc8239b800 10000000:01000000:3.0:1788835242.705746:0:19383:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1788835242.705752:0:19383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1788835242.705754:0:19383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1788835242.705759:0:19383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1788835242.705762:0:19383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1788835242.705786:0:19383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd884aa000/0xdf60171e5a5d2f24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835242.705794:0:19383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd884aa000/0xdf60171e5a5d2f24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835242.705804:0:19383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd884aa000/0xdf60171e5a5d2f24 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835242.705818:0:19383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254111232:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1788835242.705845:0:19383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835242.705870:0:19383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2e0ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1788835242.705961:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254111232 00000100:00100000:2.0:1788835242.705965:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254111232 00000100:00100000:2.0:1788835242.705981:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1788835242.705987:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+21:19383:x1875729254111232:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788835242.705996:0:17054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835242.706010:0:17054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afc8374c400/0xdf60171e5a5d2f2b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2f24 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.706032:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afc8374c400/0xdf60171e5a5d2f2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2f24 expref: 22 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.706053:0:17054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afc8374c400/0xdf60171e5a5d2f2b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2f24 expref: 22 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.706063:0:17054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afc8374c400, rc 0) 00000100:00100000:2.0:1788835242.706095:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+22:19383:x1875729254111232:12345-0@lo:101:mount.lustre.0 Request processed in 108us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835242.706110:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1788835242.706221:0:19383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254111232:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788835242.706233:0:19383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd884aa000/0xdf60171e5a5d2f24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2f2b expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835242.706242:0:19383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd884aa000/0xdf60171e5a5d2f24 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2f2b expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788835242.708007:0:19383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1788835242.709157:0:19383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788835242.711923:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1788835242.711987:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1788835242.712000:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1788835242.712013:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1788835242.712024:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1788835242.712225:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1788835242.712257:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1788835242.712261:0:19383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1788835242.712416:0:19383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254111360:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788835242.712496:0:19383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835242.712606:0:19383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2e0ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1788835242.715105:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254111360 00000100:00100000:2.0:1788835242.715139:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254111360 00000100:00100000:2.0:1788835242.715312:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1788835242.715338:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+22:19383:x1875729254111360:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788835242.715577:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+22:19383:x1875729254111360:12345-0@lo:501:mount.lustre.0 Request processed in 242us (3079us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835242.715585:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1788835242.716018:0:19383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254111360:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788835242.716093:0:19383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254111488:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788835242.716170:0:19383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835242.719382:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254111488 00000100:00100000:3.0:1788835242.719399:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254111488 00000100:00100000:3.0:1788835242.719462:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1788835242.719473:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+22:19383:x1875729254111488:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788835242.720270:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+22:19383:x1875729254111488:12345-0@lo:503:mount.lustre.0 Request processed in 795us (4097us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835242.720280:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1788835242.721672:0:19383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eac0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1788835242.721847:0:19383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2ca80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254111488:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1788835242.722521:0:19383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1788835242.722803:0:19383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254111616:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788835242.722896:0:19383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835242.723013:0:19383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb38a6f00 going to sleep for 11 seconds 00000100:00100000:3.0:1788835242.723224:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254111616 00000100:00100000:3.0:1788835242.723231:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254111616 00000100:00100000:3.0:1788835242.723289:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1788835242.723298:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86964050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+22:19383:x1875729254111616:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788835242.724227:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86964050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+22:19383:x1875729254111616:12345-0@lo:502:mount.lustre.0 Request processed in 925us (1326us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835242.724238:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1788835242.724400:0:19383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254111616:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788835242.725822:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1788835242.725879:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1788835242.725892:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1788835242.725903:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1788835242.725914:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1788835242.725925:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1788835242.725936:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1788835242.725946:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1788835242.725957:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1788835242.726008:0:19383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254111744:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788835242.731162:0:19383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835242.731232:0:19383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb38a6f00 going to sleep for 11 seconds 00000100:00100000:0.0:1788835242.732137:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254111744 00000100:00100000:0.0:1788835242.732151:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254111744 00000100:00100000:0.0:1788835242.732260:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1788835242.732283:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86965450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+22:19383:x1875729254111744:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788835242.734608:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86965450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+22:19383:x1875729254111744:12345-0@lo:502:mount.lustre.0 Request processed in 2327us (3444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835242.734633:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1788835242.735273:0:19383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254111744:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1788835242.735725:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1788835242.737812:0:19383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 10 count 11 00000020:01000000:1.0:1788835242.739197:0:19387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1788835242.739209:0:19387:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of /dev/mapper/ost2_flakey 00000020:00000080:1.0:1788835242.739216:0:19387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835242.739219:0:19387:0:(obd_config.c:1563:class_process_config()) marker 29 (0x1) lustre-OST0001 add ost 00000020:00000080:1.0:1788835242.739225:0:19387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1788835242.739244:0:19387:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9afdb715b370) 00000020:00000080:1.0:1788835242.739275:0:19387:0:(obd_config.c:720:class_attach_name()) OBD: dev 26 attached type obdfilter with refcount 2 00000020:00000080:1.0:1788835242.739281:0:19387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1788835242.739431:0:19387:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afc8239b800 from lustre-OST0001, refs=2 00080000:01000000:1.0:1788835242.739446:0:19387:0:(osd_handler.c:8925:osd_obd_connect()) connect #1 00000020:00000080:1.0:1788835242.739453:0:19387:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xdf60171e5a5d2f39 00010000:00010000:1.0:1788835242.749188:0:19387:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-4 is initialized 00000001:00000004:1.0:1788835242.752062:0:19387:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967326 00080000:10000000:1.0:1788835242.755399:0:19387:0:(osd_handler.c:5581:osd_index_try()) lustre-OST0001: index object [0x200000003:0xa:0x0] (8/32) registered 00000020:00000080:2.0:1788835242.756791:0:19387:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1788835242.756807:0:19387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788835242.756814:0:19387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835242.756816:0:19387:0:(obd_config.c:1563:class_process_config()) marker 29 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1788835242.756820:0:19387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788835242.756824:0:19387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835242.756825:0:19387:0:(obd_config.c:1563:class_process_config()) marker 34 (0x1) lustre sys.timeout 00000020:00000080:2.0:1788835242.756828:0:19387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1788835242.756831:0:19387:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1788835242.756833:0:19387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788835242.756835:0:19387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835242.756836:0:19387:0:(obd_config.c:1563:class_process_config()) marker 34 (0x2) lustre sys.timeout 00000020:01000000:2.0:1788835242.756838:0:19387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1788835242.756840:0:19387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835242.756841:0:19387:0:(obd_config.c:1563:class_process_config()) marker 39 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1788835242.756845:0:19387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1788835242.756875:0:19387:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1788835242.756877:0:19387:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1788835242.756878:0:19387:0:(obd_config.c:1563:class_process_config()) marker 39 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1788835242.756881:0:19387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:1.0:1788835242.757052:0:19383:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:1.0:1788835242.757089:0:19383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:1.0:1788835242.757122:0:19383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd884aa000/0xdf60171e5a5d2f24 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2f2b expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835242.757135:0:19383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd884aa000/0xdf60171e5a5d2f24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2f2b expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788835242.757144:0:19383:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afc8239b800 from 1 10000000:01000000:1.0:1788835242.757147:0:19383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1788835242.757191:0:19383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61200/0xdf60171e5a5d2f40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835242.757199:0:19383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61200/0xdf60171e5a5d2f40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835242.757211:0:19383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61200/0xdf60171e5a5d2f40 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835242.757240:0:19383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254111872:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1788835242.757344:0:19383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835242.757400:0:19383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd86404600 going to sleep for 11 seconds 00000100:00100000:3.0:1788835242.757723:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254111872 00000100:00100000:3.0:1788835242.757732:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254111872 00000100:00100000:3.0:1788835242.757790:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1788835242.757799:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+22:19383:x1875729254111872:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1788835242.757815:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835242.757830:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd884aa200/0xdf60171e5a5d2f47 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2f40 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835242.757856:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd884aa200/0xdf60171e5a5d2f47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2f40 expref: 23 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835242.757867:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd884aa200/0xdf60171e5a5d2f47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2f40 expref: 23 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835242.757877:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884aa200, rc 0) 00000100:00100000:3.0:1788835242.757931:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+23:19383:x1875729254111872:12345-0@lo:101:mount.lustre.0 Request processed in 133us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835242.757937:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1788835242.758054:0:19383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254111872:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788835242.758069:0:19383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61200/0xdf60171e5a5d2f40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2f47 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.758078:0:19383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61200/0xdf60171e5a5d2f40 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2f47 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788835242.760420:0:19383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1788835242.760974:0:19383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1788835242.761199:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1788835242.761224:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1788835242.761239:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1788835242.761244:0:19383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1788835242.762139:0:19383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254112000:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1788835242.762237:0:19383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835242.762299:0:19383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb38a6900 going to sleep for 11 seconds 00000100:00100000:1.0:1788835242.762563:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254112000 00000100:00100000:1.0:1788835242.762572:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254112000 00000100:00100000:1.0:1788835242.762645:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1788835242.762655:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+23:19383:x1875729254112000:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788835242.762810:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+23:19383:x1875729254112000:12345-0@lo:501:mount.lustre.0 Request processed in 156us (574us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835242.762827:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1788835242.763394:0:19383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254112000:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1788835242.763461:0:19383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254112128:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1788835242.763524:0:19383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835242.763553:0:19383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eacd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788835242.763918:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254112128 00000100:00100000:1.0:1788835242.763925:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254112128 00000100:00100000:1.0:1788835242.763970:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1788835242.763978:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+23:19383:x1875729254112128:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788835242.764168:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+23:19383:x1875729254112128:12345-0@lo:503:mount.lustre.0 Request processed in 190us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835242.764176:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1788835242.765194:0:19383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254112128:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1788835242.765905:0:19383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1788835242.766010:0:19383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254112256:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788835242.767736:0:19383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835242.767833:0:19383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eacd80 going to sleep for 11 seconds 00000100:00100000:0.0:1788835242.768136:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254112256 00000100:00100000:0.0:1788835242.768146:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254112256 00000100:00100000:0.0:1788835242.768247:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1788835242.768259:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+23:19383:x1875729254112256:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1788835242.768468:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+23:19383:x1875729254112256:12345-0@lo:502:mount.lustre.0 Request processed in 212us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835242.768478:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1788835242.768675:0:19383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254112256:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788835242.768932:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:3.0:1788835242.768962:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:3.0:1788835242.768987:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:3.0:1788835242.769000:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:3.0:1788835242.769011:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:3.0:1788835242.769022:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:3.0:1788835242.769032:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:3.0:1788835242.769053:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000040:00080000:3.0:1788835242.769066:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:3.0:1788835242.769078:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off10112 00000040:00080000:3.0:1788835242.769111:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 128 off10240 00000100:00100000:3.0:1788835242.769150:0:19383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e817480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254112384:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788835242.769200:0:19383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835242.769842:0:19383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2e0ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1788835242.769882:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254112384 00000100:00100000:1.0:1788835242.769889:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254112384 00000100:00100000:1.0:1788835242.769930:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1788835242.769938:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+23:19383:x1875729254112384:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788835242.770184:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+23:19383:x1875729254112384:12345-0@lo:502:mount.lustre.0 Request processed in 246us (982us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835242.770191:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1788835242.770306:0:19383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e817480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254112384:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788835242.770671:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 224 off10464 00000040:00080000:3.0:1788835242.770685:0:19383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 12 count 13 00000020:01000000:1.0:1788835242.771756:0:19391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788835242.771769:0:19391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835242.771772:0:19391:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1788835242.771780:0:19391:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afc8239b800 00000020:00000080:1.0:1788835242.771783:0:19391:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788835242.771792:0:19391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788835242.771795:0:19391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835242.771796:0:19391:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1788835242.771798:0:19391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788835242.771800:0:19391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835242.771802:0:19391:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1788835242.771812:0:19391:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9afc8239b800 00000020:00000080:1.0:1788835242.771814:0:19391:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788835242.771909:0:19391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788835242.771913:0:19391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835242.771915:0:19391:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1788835242.771917:0:19391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788835242.771919:0:19391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835242.771921:0:19391:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788835242.771924:0:19391:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afc8239b800 00000020:00000080:1.0:1788835242.771926:0:19391:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788835242.777821:0:19391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788835242.777838:0:19391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835242.777840:0:19391:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1788835242.777844:0:19391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1788835242.777849:0:19391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835242.777850:0:19391:0:(obd_config.c:1563:class_process_config()) marker 5 (0x1) lustre mdt.lustre-MDT0001.hsm_control 00000020:01000000:1.0:1788835242.777856:0:19391:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9afc8239b800 00000020:00000080:1.0:1788835242.777858:0:19391:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1788835242.777927:0:19391:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1788835242.777930:0:19391:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1788835242.777931:0:19391:0:(obd_config.c:1563:class_process_config()) marker 5 (0x2) lustre mdt.lustre-MDT0001.hsm_control 00000040:00080000:1.0:1788835242.777935:0:19391:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 13 00000020:01000000:2.0:1788835242.779458:0:19383:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-12 (rc=0) 10000000:01000000:2.0:1788835242.779510:0:19383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788835242.779535:0:19383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61200/0xdf60171e5a5d2f40 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2f47 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.779549:0:19383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61200/0xdf60171e5a5d2f40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2f47 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835242.779628:0:19383:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1788835242.779631:0:19383:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9afc8239b800 10000000:01000000:2.0:1788835242.779635:0:19383:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9afc8239b800 10000000:01000000:2.0:1788835242.779639:0:19383:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1788835242.779646:0:19383:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9afc8239b800 from 1 10000000:01000000:2.0:1788835242.779648:0:19383:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1788835242.779696:0:19383:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374d200/0xdf60171e5a5d2f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.779706:0:19383:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afc8374d200/0xdf60171e5a5d2f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.779719:0:19383:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afc8374d200/0xdf60171e5a5d2f4e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835242.779748:0:19383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254112512:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1788835242.779837:0:19383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835242.779886:0:19383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb38a6f00 going to sleep for 11 seconds 00000100:00100000:1.0:1788835242.780658:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254112512 00000100:00100000:1.0:1788835242.780668:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254112512 00000100:00100000:1.0:1788835242.780729:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1788835242.780739:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+23:19383:x1875729254112512:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1788835242.780757:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835242.780774:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e60600/0xdf60171e5a5d2f55 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2f4e expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835242.780804:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e60600/0xdf60171e5a5d2f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2f4e expref: 24 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835242.780828:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e60600/0xdf60171e5a5d2f55 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2f4e expref: 24 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835242.780839:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60600, rc 0) 00000100:00100000:1.0:1788835242.781704:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+24:19383:x1875729254112512:12345-0@lo:101:mount.lustre.0 Request processed in 960us (1861us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835242.781716:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1788835242.781717:0:19383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fe300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254112512:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1788835242.781751:0:19383:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afc8374d200/0xdf60171e5a5d2f4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2f55 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.781766:0:19383:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afc8374d200/0xdf60171e5a5d2f4e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2f55 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788835242.784038:0:19383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 48 count 48 00000040:00080000:1.0:1788835242.785147:0:19383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1788835242.785403:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1788835242.785428:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1788835242.786160:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1788835242.786179:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1788835242.786190:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1788835242.786201:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1788835242.786212:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1788835242.786223:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1788835242.786235:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1788835242.786261:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1788835242.786273:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1788835242.786285:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1788835242.786295:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1788835242.786306:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1788835242.786349:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1788835242.786363:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1788835242.786375:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1788835242.786386:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1788835242.786397:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1788835242.786408:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1788835242.786419:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1788835242.786569:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1788835242.786584:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1788835242.787343:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1788835242.787367:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 160 off12472 00000040:00080000:1.0:1788835242.787393:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12696 00000040:00080000:1.0:1788835242.787406:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12920 00000040:00080000:1.0:1788835242.787417:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off13000 00000040:00080000:1.0:1788835242.787429:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13224 00000040:00080000:3.0:1788835242.789847:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13448 00000040:00080000:3.0:1788835242.789885:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13536 00000040:00080000:3.0:1788835242.789901:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13664 00000040:00080000:3.0:1788835242.789916:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13808 00000040:00080000:3.0:1788835242.789930:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13936 00000040:00080000:3.0:1788835242.789944:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14160 00000040:00080000:3.0:1788835242.789959:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14384 00000040:00080000:3.0:1788835242.789974:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14464 00000040:00080000:3.0:1788835242.789987:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14688 00000040:00080000:3.0:1788835242.790001:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].39, 224 off14912 00000040:00080000:3.0:1788835242.790017:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].40, 88 off15000 00000040:00080000:3.0:1788835242.790032:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].41, 128 off15128 00000040:00080000:3.0:1788835242.790121:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].42, 144 off15272 00000040:00080000:3.0:1788835242.790138:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].43, 128 off15400 00000040:00080000:3.0:1788835242.790152:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].44, 224 off15624 00000040:00080000:3.0:1788835242.790166:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].45, 224 off15848 00000040:00080000:3.0:1788835242.790181:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].46, 80 off15928 00000040:00080000:3.0:1788835242.790232:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].47, 224 off16152 00000040:00080000:3.0:1788835242.790239:0:19383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 47 count 48 00000100:00100000:3.0:1788835242.790750:0:19383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e817480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254112640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788835242.790836:0:19383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835242.790923:0:19383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8722f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788835242.790968:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254112640 00000100:00100000:1.0:1788835242.790977:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254112640 00000100:00100000:1.0:1788835242.791031:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1788835242.791040:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+24:19383:x1875729254112640:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1788835242.791312:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+24:19383:x1875729254112640:12345-0@lo:501:mount.lustre.0 Request processed in 272us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835242.791345:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1788835242.791567:0:19383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e817480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254112640:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1788835242.791682:0:19383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e817480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254112768:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1788835242.791726:0:19383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835242.791789:0:19383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8722f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788835242.791836:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254112768 00000100:00100000:1.0:1788835242.791841:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254112768 00000100:00100000:1.0:1788835242.791868:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1788835242.791875:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+24:19383:x1875729254112768:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1788835242.791996:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+24:19383:x1875729254112768:12345-0@lo:503:mount.lustre.0 Request processed in 120us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835242.792002:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1788835242.792127:0:19383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e817480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254112768:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1788835242.792874:0:19383:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1788835242.792957:0:19383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e817480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254112896:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788835242.793014:0:19383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835242.793142:0:19383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8722f600 going to sleep for 11 seconds 00000100:00100000:3.0:1788835242.793563:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254112896 00000100:00100000:3.0:1788835242.793571:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254112896 00000100:00100000:3.0:1788835242.793744:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788835242.793754:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+24:19383:x1875729254112896:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788835242.793892:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaaf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+24:19383:x1875729254112896:12345-0@lo:502:mount.lustre.0 Request processed in 139us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835242.793900:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1788835242.793973:0:19383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e817480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254112896:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788835242.794369:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1788835242.794403:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1788835242.794421:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1788835242.794562:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1788835242.794586:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1788835242.794676:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1788835242.794695:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1788835242.794712:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1788835242.794729:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1788835242.794746:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1788835242.794763:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1788835242.794790:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1788835242.794821:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1788835242.794840:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1788835242.794858:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1788835242.794874:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1788835242.794892:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1788835242.794909:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1788835242.794927:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1788835242.794943:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1788835242.794961:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1788835242.794978:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1788835242.794996:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1788835242.795015:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1788835242.795032:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 160 off12472 00000040:00080000:3.0:1788835242.795049:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12696 00000040:00080000:3.0:1788835242.795066:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12920 00000040:00080000:3.0:1788835242.795155:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off13000 00000040:00080000:3.0:1788835242.795183:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13224 00000040:00080000:3.0:1788835242.795195:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13448 00000040:00080000:3.0:1788835242.795206:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13536 00000040:00080000:3.0:1788835242.795217:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13664 00000040:00080000:3.0:1788835242.795227:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13808 00000040:00080000:3.0:1788835242.795239:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13936 00000040:00080000:3.0:1788835242.795249:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14160 00000040:00080000:3.0:1788835242.795260:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14384 00000040:00080000:3.0:1788835242.795271:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14464 00000040:00080000:3.0:1788835242.795282:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14688 00000040:00080000:3.0:1788835242.795293:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14912 00000040:00080000:3.0:1788835242.795304:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 88 off15000 00000040:00080000:3.0:1788835242.795349:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 128 off15128 00000040:00080000:3.0:1788835242.795363:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].42, 144 off15272 00000040:00080000:3.0:1788835242.795374:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].43, 128 off15400 00000040:00080000:3.0:1788835242.795385:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].44, 224 off15624 00000040:00080000:3.0:1788835242.795414:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].45, 224 off15848 00000040:00080000:3.0:1788835242.795428:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].46, 80 off15928 00000100:00080000:0.0:1788835242.795546:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788835242.795551:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1788835242.795554:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788835242.795558:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1788835242.795580:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254113024:0@lo:400:kworker.0 00000100:00080000:0.0:1788835242.795607:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1788835242.795611:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1788835242.795615:0:8:0:(import.c:65:import_set_state_nolock()) ffff9afc830ff800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1788835242.795622:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0001: connect to NID 0@lo last attempt 479 00000100:00080000:0.0:1788835242.795627:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0001: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1788835242.795635:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9afc830ff800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:0.0:1788835242.795662:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afdbfa2d180 x1875729254113536/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1788835242.795726:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254113408:0@lo:400:kworker.0 00000100:00100000:0.0:1788835242.795768:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835242.795809:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788835242.795815:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254113664:0@lo:400:kworker.0 00000100:00100000:0.0:1788835242.795842:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835242.795872:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254113152:0@lo:400:kworker.0 00000100:00100000:0.0:1788835242.795895:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835242.795914:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729254113792:0@lo:400:kworker.0 00000100:00100000:0.0:1788835242.795951:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835242.797094:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1788835242.797131:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254113280:0@lo:400:kworker.0 00000100:00100000:0.0:1788835242.798120:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835242.798178:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729254113920:0@lo:400:kworker.0 00000100:00100000:0.0:1788835242.798596:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835242.798653:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254113536:0@lo:8:kworker.0 00000100:00100000:0.0:1788835242.798684:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835242.798745:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254113408 00000100:00100000:0.0:1788835242.798753:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254113408 00000100:00100000:0.0:1788835242.798805:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254113536 00000100:00100000:0.0:1788835242.798809:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254113536 00000100:00100000:0.0:1788835242.798827:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788835242.798841:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254113408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835242.798897:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254113408:12345-0@lo:400:kworker.0 Request processed in 58us (3129us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835242.798904:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1788835242.798920:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788835242.798924:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3613:x1875729254113536:12345-0@lo:8:kworker.0 00000100:00100000:0.0:1788835242.799041:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3613:x1875729254113536:12345-0@lo:8:kworker.0 Request processed in 113us (354us total) trans 0 rc -11/-11 00000100:00100000:0.0:1788835242.799047:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788835242.799065:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254113664 00000100:00100000:0.0:1788835242.799069:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254113664 00000100:00100000:0.0:1788835242.799086:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254113152 00000100:00100000:0.0:1788835242.799089:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254113152 00000100:00100000:0.0:1788835242.799109:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254113792 00000100:00100000:0.0:1788835242.799112:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254113792 00000100:00100000:0.0:1788835242.799132:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254113920 00000100:00100000:0.0:1788835242.799135:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254113920 00000100:00100000:0.0:1788835242.799149:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788835242.799155:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254113664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835242.799187:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254113664:12345-0@lo:400:kworker.0 Request processed in 32us (3344us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835242.799193:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1788835242.799217:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788835242.799224:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254113152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835242.799265:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254113152:12345-0@lo:400:kworker.0 Request processed in 42us (3368us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835242.799270:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788835242.799281:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788835242.799287:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729254113792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835242.799312:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729254113792:12345-0@lo:400:kworker.0 Request processed in 26us (3360us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835242.799336:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788835242.799346:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1788835242.799352:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729254113920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835242.799376:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729254113920:12345-0@lo:400:kworker.0 Request processed in 25us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835242.799381:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788835242.799405:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788835242.799409:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788835242.799411:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1788835242.799439:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdbfa2f480 x1875729254113664/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835242.799452:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254113664:0@lo:400:kworker.0 00010000:00080000:0.0:1788835242.799476:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdbfa2c380 x1875729254113408/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835242.799484:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254113408:0@lo:400:kworker.0 00000100:00100000:0.0:1788835242.799512:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788835242.799518:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc830ff800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1788835242.799521:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1788835242.799531:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254113536:0@lo:8:kworker.0 00010000:00080000:0.0:1788835242.799556:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdbfa2fb80 x1875729254113920/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835242.799565:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729254113920:0@lo:400:kworker.0 00010000:00080000:0.0:1788835242.799575:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdbfa2d500 x1875729254113152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835242.799583:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254113152:0@lo:400:kworker.0 00010000:00080000:0.0:1788835242.799593:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afdbfa2f800 x1875729254113792/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835258 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835242.799599:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729254113792:0@lo:400:kworker.0 00000100:00100000:2.0:1788835242.800122:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254114048:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788835242.800190:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835242.800254:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254114048 00000100:00100000:2.0:1788835242.800261:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254114048 00000100:00100000:2.0:1788835242.800308:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1788835242.800344:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254114048:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788835242.800375:0:18570:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788835242.800529:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254114048:12345-0@lo:13:osp-pre-0-1.0 Request processed in 212us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835242.800536:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1788835242.800599:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afc845fe300 x1875729254114048/t0(0) o13->lustre-OST0000-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835258 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835242.800617:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254114048:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788835242.802215:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835242.802428:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254113280 00000100:00100000:3.0:1788835242.802436:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254113280 00000100:00100000:3.0:1788835242.802489:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254113024 00000100:00100000:3.0:1788835242.802493:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254113024 00000100:00100000:1.0:1788835242.802749:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1788835242.802772:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254113280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835242.802782:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788835242.802796:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254113024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835242.802901:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254113280:12345-0@lo:400:kworker.0 Request processed in 137us (4781us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835242.802915:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1788835242.802917:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e817480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254113024:12345-0@lo:400:kworker.0 Request processed in 119us (703us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835242.802930:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788835242.803010:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254113024:0@lo:400:kworker.0 00000040:00080000:3.0:1788835242.803123:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].47, 224 off16152 00000040:00080000:3.0:1788835242.803152:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].48, 232 off16384 00000100:00100000:3.0:1788835242.803200:0:19383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e816680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254114176:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788835242.803261:0:19383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835242.803385:0:19383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8722f600 going to sleep for 11 seconds 00000100:00100000:1.0:1788835242.803716:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254114176 00000100:00100000:1.0:1788835242.803733:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254114176 00000100:00100000:1.0:1788835242.803785:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1788835242.803793:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+24:19383:x1875729254114176:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1788835242.803939:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaaec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+24:19383:x1875729254114176:12345-0@lo:502:mount.lustre.0 Request processed in 146us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835242.803947:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1788835242.804750:0:19383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e816680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254114176:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1788835242.805002:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].49, 224 off16608 00000040:00080000:3.0:1788835242.805030:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].50, 120 off16728 00000100:00100000:1.0:1788835242.805389:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254113280:0@lo:400:kworker.0 00000100:00100000:3.0:1788835242.805783:0:19383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e816680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254114304:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1788835242.805853:0:19383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835242.805901:0:19383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd8722f600 going to sleep for 11 seconds 00000100:00100000:2.0:1788835242.806029:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254114304 00000100:00100000:2.0:1788835242.806037:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254114304 00000100:00100000:2.0:1788835242.806219:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1788835242.806230:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+24:19383:x1875729254114304:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1788835242.806408:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaadc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+24:19383:x1875729254114304:12345-0@lo:502:mount.lustre.0 Request processed in 179us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835242.806484:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1788835242.807149:0:19383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e816680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254114304:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1788835242.807280:0:19383:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].51, 224 off16952 00000040:00080000:0.0:1788835242.807299:0:19383:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 51 count 51 00000020:01000004:3.0:1788835242.809174:0:19395:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1788835242.809196:0:19395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9afdbd438000) 00000020:00000080:3.0:1788835242.809234:0:19395:0:(obd_config.c:720:class_attach_name()) OBD: dev 27 attached type lwp with refcount 2 00000020:01000004:3.0:1788835242.809398:0:19395:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afc8239b800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788835242.809403:0:19395:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afc8239b800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788835242.809406:0:19395:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afc8239b800 3 00010000:00080000:3.0:1788835242.809912:0:19395:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afc835ea000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.122@tcp at head 00010000:00010000:3.0:1788835242.815293:0:19395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-11 is initialized 00000020:00000080:3.0:1788835242.815864:0:19395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1788835242.815919:0:19395:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788835242.815934:0:19395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xdf60171e5a5d2f63 00000100:00080000:3.0:1788835242.815947:0:19395:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788835242.815954:0:19395:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9afc835ea000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788835242.815997:0:19395:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afd9e814380 x1875729254114432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1788835242.816028:0:19395:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1788835242.816160:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788835242.816165:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788835242.816168:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788835242.816171:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1788835242.816532:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875729254114432:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1788835242.816615:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835242.816686:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254114432 00000100:00100000:0.0:1788835242.816694:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254114432 00000100:00100000:0.0:1788835242.816736:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1788835242.816746:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3613:x1875729254114432:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1788835242.816774:0:17062:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:01000004:3.0:1788835242.816799:0:19395:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0001-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1788835242.816821:0:17062:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xdf60171e5a5d2f6a 00000020:00000080:3.0:1788835242.816833:0:19395:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0001-lwp-OST0001 (ffff9afc837b3370) 00000004:00100000:0.0:1788835242.816839:0:17062:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000020:00000080:3.0:1788835242.816858:0:19395:0:(obd_config.c:720:class_attach_name()) OBD: dev 28 attached type lwp with refcount 2 00000100:00080000:0.0:1788835242.816879:0:17062:0:(import.c:65:import_set_state_nolock()) ffff9afc8319e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788835242.816949:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3613:x1875729254114432:12345-0@lo:38:llog_process_th.0 Request processed in 203us (334us total) trans 0 rc 0/0 00000020:01000004:3.0:1788835242.816956:0:19395:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9afc8239b800 from lustre-OST0001, refs=3 00000100:00100000:0.0:1788835242.816960:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000020:01000004:3.0:1788835242.816964:0:19395:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9afc8239b800 from lustre-OST0001, refs=3 00000020:01000004:3.0:1788835242.816969:0:19395:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9afc8239b800 3 00010000:00080000:3.0:1788835242.817019:0:19395:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9afc830f9800@lustre-MDT0001-lwp-OST0001: add connection 192.168.203.122@tcp at head 00010000:00080000:0.0:1788835242.817020:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afd9e814380 x1875729254114432/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788835252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835242.817036:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1788835242.817044:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1788835242.817051:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1788835242.817056:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1788835242.817058:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc835ea000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1788835242.817064:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3613:1875729254114432:0@lo:38:llog_process_th.0 00010000:00010000:3.0:1788835242.819075:0:19395:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0001-lwp-OST0001-12 is initialized 00000020:00000080:3.0:1788835242.819354:0:19395:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0001-lwp-OST0001 (uuid lustre-MDT0001-lwp-OST0001_UUID) 00000010:01000000:3.0:1788835242.819424:0:19395:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1788835242.819565:0:19395:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001, cookie 0xdf60171e5a5d2f78 00000100:00080000:3.0:1788835242.819578:0:19395:0:(import.c:510:import_select_connection()) lustre-MDT0001-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1788835242.819584:0:19395:0:(import.c:624:import_select_connection()) lustre-MDT0001-lwp-OST0001: import ffff9afc830f9800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:3.0:1788835242.819626:0:19395:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afd9e817100 x1875729254114560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1788835242.819675:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875729254114560:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1788835242.819763:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835242.819834:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254114560 00000100:00100000:3.0:1788835242.819841:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254114560 00000100:00100000:3.0:1788835242.819936:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788835242.819945:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3613:x1875729254114560:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1788835242.819973:0:17060:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from lustre-MDT0001-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 484 last 0 00000020:00000080:3.0:1788835242.820024:0:17060:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-lwp-OST0001_UUID, cookie 0xdf60171e5a5d2f7f 00000004:00100000:3.0:1788835242.820043:0:17060:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0001: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1788835242.820082:0:17060:0:(import.c:65:import_set_state_nolock()) ffff9afdbfa53800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788835242.820151:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e814700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3613:x1875729254114560:12345-0@lo:38:llog_process_th.0 Request processed in 205us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835242.820158:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1788835242.820245:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9afd9e817100 x1875729254114560/t0(0) o38->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1788835252 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835242.820257:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0001-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788835242.820265:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0001-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1788835242.820275:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0001-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1788835242.820281:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0001_UUID 00000100:00080000:3.0:1788835242.820284:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc830f9800 lustre-MDT0001_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1788835242.820299:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-lwp-OST0001_UUID:3613:1875729254114560:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1788835242.820430:0:19395:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0001-lwp-OST0001_UUID->lustre-MDT0001_UUID 00000100:00080000:3.0:1788835242.820588:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788835242.820593:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1788835242.820596:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1788835242.820601:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000040:00080000:3.0:1788835242.821023:0:19395:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 52 count 51 00000020:01000000:0.0:1788835242.821116:0:19383:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-51 (rc=0) 10000000:01000000:0.0:1788835242.821174:0:19383:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1788835242.821201:0:19383:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afc8374d200/0xdf60171e5a5d2f4e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2f55 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835242.821215:0:19383:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afc8374d200/0xdf60171e5a5d2f4e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2f55 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1788835242.821268:0:19383:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1788835242.821270:0:19383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788835242.821271:0:19383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788835242.821273:0:19383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788835242.821274:0:19383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788835242.821275:0:19383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788835242.821277:0:19383:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788835242.821278:0:19383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788835242.821280:0:19383:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788835242.821284:0:19383:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:0.0:1788835242.821286:0:19383:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1788835242.821292:0:19383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788835242.821293:0:19383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788835242.821294:0:19383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788835242.821295:0:19383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788835242.821296:0:19383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788835242.821297:0:19383:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788835242.821298:0:19383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788835242.821299:0:19383:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1788835242.821356:0:19383:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1788835242.821376:0:19383:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254114688:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1788835242.821442:0:19383:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835242.821486:0:19383:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eac180 going to sleep for 11 seconds 00000100:00100000:1.0:1788835242.825190:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254114688 00000100:00100000:1.0:1788835242.825208:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254114688 00000100:00100000:1.0:1788835242.825272:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1788835242.825285:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+24:19383:x1875729254114688:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1788835242.825341:0:17053:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1788835242.825358:0:17053:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1788835242.844058:0:17053:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1788835242.844090:0:17053:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:1.0:1788835242.845251:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+24:19383:x1875729254114688:12345-0@lo:253:mount.lustre.0 Request processed in 19960us (23799us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835242.845266:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1788835242.845339:0:19383:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed1880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:cb888812-a79c-4531-9a69-89c757e37463:19383:1875729254114688:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1788835242.845354:0:19383:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1788835242.845357:0:19383:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1788835242.845359:0:19383:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1788835242.845360:0:19383:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1788835242.845361:0:19383:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1788835242.845362:0:19383:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1788835242.845364:0:19383:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1788835242.845365:0:19383:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1788835242.845367:0:19383:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1788835242.845368:0:19383:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1788835242.845383:0:19383:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 20000000:01000000:3.0:1788835242.847553:0:17077:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1788835242.847566:0:17077:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1788835242.847599:0:17077:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afd884aaa00/0xdf60171e5a5d2f86 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835242.847622:0:17077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2efa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2ef3 expref: 23 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835242.847631:0:17077:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2f08 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2f01 expref: 23 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835242.847639:0:17077:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afd884aaa00/0xdf60171e5a5d2f86 lrc: 5/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835242.847695:0:17077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2f08 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d2f01 expref: 23 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835242.847744:0:17077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2f08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d2f01 expref: 23 pid: 17053 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835242.847761:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e817100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17077:1875729254114816:0@lo:104: 00000100:00100000:3.0:1788835242.847848:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1788835242.847907:0:17077:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2efa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d2ef3 expref: 23 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835242.847915:0:17077:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2efa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d2ef3 expref: 23 pid: 17054 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835242.847923:0:17077:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17077:1875729254114944:0@lo:104: 00000100:00100000:3.0:1788835242.847955:0:17077:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835242.847982:0:17077:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb7207300 going to sleep for 11 seconds 00000100:00100000:2.0:1788835242.848030:0:17043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254114816 00000100:00100000:2.0:1788835242.848053:0:17043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254114816 00000100:00100000:2.0:1788835242.848109:0:17043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254114944 00000100:00100000:2.0:1788835242.848112:0:17043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254114944 00000100:00100000:2.0:1788835242.848133:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788835242.848142:0:17043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e814a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+4:17077:x1875729254114816:12345-0@lo:104: 00010000:00010000:2.0:1788835242.848159:0:17043:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61400/0xdf60171e5a5d2f01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2f08 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.848258:0:17043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788835242.848265:0:17043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e814a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+4:17077:x1875729254114816:12345-0@lo:104: Request processed in 124us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835242.848273:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788835242.848308:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788835242.848352:0:17043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e816680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+3:17077:x1875729254114944:12345-0@lo:104: 00010000:00010000:2.0:1788835242.848361:0:17043:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d2ef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2efa expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.848405:0:17043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788835242.848411:0:17043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e816680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+3:17077:x1875729254114944:12345-0@lo:104: Request processed in 97us (455us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835242.848418:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:2.0:1788835242.848440:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788835242.848447:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61400/0xdf60171e5a5d2f01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2f08 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.848455:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61400 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788835242.848460:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61400/0xdf60171e5a5d2f01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d2f08 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.848486:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61400/0xdf60171e5a5d2f01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d2f08 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788835242.848494:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61400/0xdf60171e5a5d2f01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d2f08 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835242.848501:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788835242.848541:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61400/0xdf60171e5a5d2f01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2f08 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.848548:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788835242.848571:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61400/0xdf60171e5a5d2f01 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2f08 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.848580:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61400/0xdf60171e5a5d2f01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2f08 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.848594:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835242.848598:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d2ef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2efa expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.848603:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5400 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788835242.848606:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d2ef3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d2efa expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.848613:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d2ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d2efa expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788835242.848619:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d2ef3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d2efa expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835242.848633:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1788835242.848652:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d2ef3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2efa expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.848658:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788835242.848675:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d2ef3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2efa expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.848682:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd866f5400/0xdf60171e5a5d2ef3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2efa expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.848698:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835242.848700:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835242.848702:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835242.848708:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835242.848728:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb888812-a79c-4531-9a69-89c757e37463:3615:1875729254115072:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788835242.848767:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835242.848807:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb888812-a79c-4531-9a69-89c757e37463:3616:1875729254115200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788835242.848831:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835242.848867:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254115072 00000100:00100000:2.0:1788835242.848871:0:17047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254115072 00010000:00010000:2.0:1788835242.848890:0:17047:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2f08 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2f01 expref: 24 pid: 17053 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835242.848913:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254115200 00000100:00100000:2.0:1788835242.848916:0:17047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254115200 00010000:00010000:2.0:1788835242.848928:0:17047:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2efa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2ef3 expref: 25 pid: 17054 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835242.848962:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788835242.848969:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb888812-a79c-4531-9a69-89c757e37463+25:3615:x1875729254115072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788835242.848980:0:17047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835242.848986:0:17047:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2f08 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2f01 expref: 25 pid: 17053 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.848997:0:17047:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2f08 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d2f01 expref: 25 pid: 17053 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.849016:0:17047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835242.849052:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb888812-a79c-4531-9a69-89c757e37463+25:3615:x1875729254115072:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (284us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835242.849060:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788835242.849080:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788835242.849088:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb888812-a79c-4531-9a69-89c757e37463+24:3616:x1875729254115200:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788835242.849110:0:17047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835242.849116:0:17047:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2efa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2ef3 expref: 24 pid: 17054 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.849131:0:17047:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2efa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d2ef3 expref: 24 pid: 17054 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.849148:0:17047:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afd884aaa00/0xdf60171e5a5d2f86 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.849157:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd884aaa00/0xdf60171e5a5d2f86 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1788835242.849186:0:17047:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.004558061s 00010000:00010000:2.0:1788835242.849191:0:17047:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afd884aaa00/0xdf60171e5a5d2f86 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.849199:0:17047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afd884aaa00/0xdf60171e5a5d2f86 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.849206:0:17047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afd884aaa00/0xdf60171e5a5d2f86 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.849213:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afd884aaa00/0xdf60171e5a5d2f86 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.849220:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aaa00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835242.849224:0:17047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afd884aaa00/0xdf60171e5a5d2f86 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.849232:0:17047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afd884aaa00/0xdf60171e5a5d2f86 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.849244:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afd884aaa00/0xdf60171e5a5d2f86 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.849255:0:17047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835242.849291:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:cb888812-a79c-4531-9a69-89c757e37463+24:3616:x1875729254115200:12345-0@lo:103:ldlm_bl.0 Request processed in 202us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835242.849299:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1788835242.849383:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb888812-a79c-4531-9a69-89c757e37463:3616:1875729254115200:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788835242.849407:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fe300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb888812-a79c-4531-9a69-89c757e37463:3615:1875729254115072:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788835242.849444:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd866f5600/0xdf60171e5a5d2f08 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d2f01 expref: 23 pid: 17053 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835242.849456:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e817100 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17077:1875729254114816:0@lo:104: 00010000:00010000:2.0:1788835242.849466:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afc8374d800/0xdf60171e5a5d2efa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d2ef3 expref: 22 pid: 17054 timeout: 584 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835242.849473:0:17077:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814380 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:17077:1875729254114944:0@lo:104: 00010000:00010000:2.0:1788835242.849491:0:17077:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afd884aaa00/0xdf60171e5a5d2f86 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.849500:0:17077:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afd884aaa00/0xdf60171e5a5d2f86 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.849506:0:17077:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afd884aaa00/0xdf60171e5a5d2f86 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835242.849512:0:17077:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd884aaa00/0xdf60171e5a5d2f86 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 17077 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00000004:1.0:1788835242.862279:0:19383:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1788835242.870410:0:19383:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1788835242.870423:0:19383:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1788835242.870469:0:19383:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1788835242.870518:0:19383:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.122@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1788835242.870544:0:19383:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=50 00000080:00000004:1.0:1788835242.870576:0:19383:0:(super25.c:182:lustre_fill_super()) /dev/mapper/ost2_flakey: Mount complete 00000020:00000004:1.0:1788835242.871675:0:19383:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788835242.871910:0:19383:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:2.0:1788835243.174488:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835243.813699:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254115328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788835243.813773:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835243.813951:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254115328 00000100:00100000:3.0:1788835243.813959:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254115328 00000100:00100000:3.0:1788835243.814009:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1788835243.814019:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254115328:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788835243.814051:0:17801:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788835243.814118:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254115328:12345-0@lo:41:osp-pre-1-0.0 Request processed in 100us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835243.814125:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1788835243.814212:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254115328:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788835243.815544:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254115456:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788835243.815597:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835243.815686:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254115456 00000100:00100000:0.0:1788835243.815692:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254115456 00000100:00100000:0.0:1788835243.815740:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1788835243.815750:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254115456:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788835243.815778:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788835243.815824:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254115456:12345-0@lo:41:osp-pre-0-1.0 Request processed in 75us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835243.815831:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788835243.815907:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254115456:0@lo:41:osp-pre-0-1.0 00000020:00000004:2.0:1788835243.995911:0:19450:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788835243.996656:0:19450:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 10000000:01000000:1.0:1788835244.136300:0:17057:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788835244.136354:0:17057:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afd87f3f800 from 10 10000000:01000000:1.0:1788835244.136360:0:17057:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788835244.136404:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d2f8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835244.136416:0:17057:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d2f8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835244.136427:0:17057:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d2f8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835244.136454:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254115584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788835244.136522:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835244.136569:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82cc2900 going to sleep for 11 seconds 00000100:00100000:3.0:1788835244.136670:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254115584 00000100:00100000:3.0:1788835244.136677:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254115584 00000100:00100000:3.0:1788835244.136836:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1788835244.136845:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+22:17057:x1875729254115584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788835244.136859:0:17054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835244.136873:0:17054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd884aa800/0xdf60171e5a5d2f94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2f8d expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835244.136896:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd884aa800/0xdf60171e5a5d2f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2f8d expref: 23 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835244.136915:0:17054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd884aa800/0xdf60171e5a5d2f94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2f8d expref: 23 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835244.136925:0:17054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd884aa800, rc 0) 00000100:00100000:3.0:1788835244.136973:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+23:17057:x1875729254115584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835244.136980:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1788835244.137230:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254115584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788835244.137244:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d2f8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2f94 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835244.137253:0:17057:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d2f8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2f94 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835244.137309:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254115712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788835244.137360:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835244.137383:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82cc2900 going to sleep for 11 seconds 00000100:00100000:1.0:1788835244.137396:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254115712 00000100:00100000:1.0:1788835244.137400:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254115712 00000100:00100000:1.0:1788835244.137427:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788835244.137435:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+23:17057:x1875729254115712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788835244.137448:0:17053:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788835244.137469:0:17053:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788835244.137471:0:17053:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788835244.137546:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+23:17057:x1875729254115712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 111us (186us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835244.137554:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1788835244.137587:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254115712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788835244.137637:0:17057:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788835244.137644:0:17057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d2f8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2f94 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835244.137652:0:17057:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61c00/0xdf60171e5a5d2f8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2f94 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1788835244.137662:0:17057:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1788835244.137664:0:17057:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9afc8447d000 from 10 10000000:01000000:1.0:1788835244.137666:0:17057:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1788835244.137681:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d2f9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835244.137687:0:17057:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d2f9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835244.137695:0:17057:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d2f9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835244.137706:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254115840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1788835244.137731:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835244.137746:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82cc2900 going to sleep for 11 seconds 00000100:00100000:1.0:1788835244.137759:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254115840 00000100:00100000:1.0:1788835244.137768:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254115840 00000100:00100000:1.0:1788835244.137789:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788835244.137795:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+23:17057:x1875729254115840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788835244.137802:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835244.137810:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e60a00/0xdf60171e5a5d2fa2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d2f9b expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835244.137826:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e60a00/0xdf60171e5a5d2fa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d2f9b expref: 24 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835244.137833:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e60a00/0xdf60171e5a5d2fa2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2f9b expref: 24 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835244.137840:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60a00, rc 0) 00000100:00100000:1.0:1788835244.137868:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+24:17057:x1875729254115840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 73us (136us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835244.137874:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1788835244.137902:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254115840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788835244.137911:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d2f9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2fa2 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835244.137919:0:17057:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d2f9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d2fa2 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835244.137955:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254115968:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1788835244.137981:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835244.137994:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82cc2900 going to sleep for 11 seconds 00000100:00100000:1.0:1788835244.138134:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254115968 00000100:00100000:1.0:1788835244.138145:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254115968 00000100:00100000:1.0:1788835244.138168:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788835244.138174:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+24:17057:x1875729254115968:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1788835244.138184:0:17053:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1788835244.138195:0:17053:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1788835244.138198:0:17053:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 10 00000100:00100000:1.0:1788835244.138260:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+24:17057:x1875729254115968:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 86us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835244.138268:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1788835244.138448:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254115968:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1788835244.138490:0:17057:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1788835244.138496:0:17057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d2f9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2fa2 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835244.138504:0:17057:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdb2e60400/0xdf60171e5a5d2f9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d2fa2 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835244.200387:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788835244.646288:0:17814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1788835245.234598:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835245.925971:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788835225/real 1788835225] req@ffff9afd9e814e00 x1875729254102656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788835245 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835245.926002:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9afd9e814e00 x1875729254102656/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788835245 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835245.926014:0:3613:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1788835225/real 1788835225] req@ffff9afd9e817b80 x1875729254102784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788835245 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835245.926026:0:3613:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9afd9e817b80 x1875729254102784/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1788835245 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788835245.926044:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdbf96b800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788835245.926069:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788835245.926073:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254102656:0@lo:8:kworker.0 00000100:00080000:3.0:1788835245.926089:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc8369a000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1788835245.926094:0:3613:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1788835245.926098:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e817b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254102784:0@lo:8:kworker.0 00000100:00080000:2.0:1788835245.926612:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788835245.926616:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1788835245.926619:0:8:0:(import.c:65:import_set_state_nolock()) ffff9afdbf96b800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788835245.926624:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 467 00000100:00080000:2.0:1788835245.926629:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788835245.926635:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9afdbf96b800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788835245.926653:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afc845fd180 x1875729254116352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788835245.926678:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788835245.926681:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788835245.926682:0:8:0:(import.c:65:import_set_state_nolock()) ffff9afc8369a000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788835245.926685:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 467 00000100:00080000:2.0:1788835245.926687:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1788835245.926690:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9afc8369a000 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788835245.926701:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afc845fdc00 x1875729254116480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1788835245.926727:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0001-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1788835245.926730:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1788835245.926731:0:8:0:(import.c:65:import_set_state_nolock()) ffff9afc830ff800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1788835245.926736:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0001: import ffff9afc830ff800 using connection 192.168.203.122@tcp/0@lo 00000100:00100000:2.0:1788835245.926755:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9afc845ff480 x1875729254116992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1788835245.926804:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254116224:0@lo:400:kworker.0 00000100:00100000:2.0:1788835245.926864:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835245.926905:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729254117120:0@lo:400:kworker.0 00000100:00100000:2.0:1788835245.926930:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835245.927136:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254117632:0@lo:400:kworker.0 00000100:00100000:2.0:1788835245.927168:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835245.927191:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1788835245.927198:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254116608:0@lo:400:kworker.0 00000100:00100000:2.0:1788835245.927219:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835245.927237:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729254117248:0@lo:400:kworker.0 00000100:00100000:2.0:1788835245.927256:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835245.927289:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254116224 00000100:00100000:2.0:1788835245.927296:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254116224 00000100:00100000:2.0:1788835245.927438:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788835245.927449:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254116224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835245.927501:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254116224:12345-0@lo:400:kworker.0 Request processed in 55us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835245.927508:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788835245.927543:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254117120 00000100:00100000:2.0:1788835245.927547:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254117120 00000100:00100000:2.0:1788835245.927566:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254117632 00000100:00100000:2.0:1788835245.927569:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254117632 00000100:00100000:2.0:1788835245.927592:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254116608 00000100:00100000:2.0:1788835245.927595:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254116608 00000100:00100000:2.0:1788835245.927605:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254117248 00000100:00100000:2.0:1788835245.927607:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254117248 00000100:00100000:2.0:1788835245.927621:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788835245.927627:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729254117120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835245.927767:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb888812-a79c-4531-9a69-89c757e37463:3615:1875729254116096:0@lo:400:kworker.0 00000100:00100000:3.0:1788835245.927808:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835245.927839:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254116864:0@lo:400:kworker.0 00000100:00100000:3.0:1788835245.927865:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835245.927886:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254117504:0@lo:400:kworker.0 00000100:00100000:3.0:1788835245.927908:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835245.927921:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:3.0:1788835245.927926:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254116736:0@lo:400:kworker.0 00000100:00100000:3.0:1788835245.927958:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835245.927979:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729254117376:0@lo:400:kworker.0 00000100:00100000:3.0:1788835245.928003:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835245.928023:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254117504 00000100:00100000:3.0:1788835245.928027:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254117504 00000100:00100000:3.0:1788835245.928048:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254117376 00000100:00100000:3.0:1788835245.928051:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254117376 00000100:00100000:3.0:1788835245.928066:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788835245.928072:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254117632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835245.928113:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f39c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254117632:12345-0@lo:400:kworker.0 Request processed in 41us (945us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835245.928120:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788835245.928137:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788835245.928143:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254116608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835245.928174:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254116608:12345-0@lo:400:kworker.0 Request processed in 32us (954us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835245.928180:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1788835245.928193:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788835245.928199:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729254117248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835245.928235:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f3ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3616:x1875729254117248:12345-0@lo:400:kworker.0 Request processed in 35us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835245.928241:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1788835245.928257:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788835245.928263:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729254117504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835245.928295:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e814e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729254117504:12345-0@lo:400:kworker.0 Request processed in 32us (386us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835245.928301:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1788835245.928339:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1788835245.928345:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729254117376:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835245.928554:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729254117120:12345-0@lo:400:kworker.0 Request processed in 31us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835245.928572:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1788835245.928605:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254116736 00000100:00100000:2.0:1788835245.928609:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254116736 00000100:00100000:2.0:1788835245.928635:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1788835245.928642:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254116736:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835245.930593:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254116864 00000100:00100000:0.0:1788835245.930610:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254116864 00000100:00100000:0.0:1788835245.930682:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788835245.930692:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254116864:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835245.932899:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e815180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729254117376:12345-0@lo:400:kworker.0 Request processed in 4546us (4886us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835245.932913:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:3.0:1788835245.932994:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8458d180 x1875729254117376/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835245.933009:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729254117376:0@lo:400:kworker.0 00010000:00080000:3.0:1788835245.933023:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8458c000 x1875729254117504/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835245.933031:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254117504:0@lo:400:kworker.0 00000100:00080000:3.0:1788835245.933399:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1788835245.933405:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1788835245.933409:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00010000:00080000:3.0:1788835245.933432:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc845fc380 x1875729254116608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835245.933456:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254116608:0@lo:400:kworker.0 00010000:00080000:3.0:1788835245.933475:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8458d880 x1875729254117248/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835245.933483:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3616:1875729254117248:0@lo:400:kworker.0 00000100:00100000:3.0:1788835245.933495:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254116224:0@lo:400:kworker.0 00010000:00080000:3.0:1788835245.933507:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8458dc00 x1875729254117120/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835245.933515:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729254117120:0@lo:400:kworker.0 00010000:00080000:3.0:1788835245.933526:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc8458df80 x1875729254117632/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835245.933533:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254117632:0@lo:400:kworker.0 00000100:00100000:1.0:1788835245.936155:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254116096 00000100:00100000:1.0:1788835245.936168:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254116096 00000100:00100000:1.0:1788835245.936228:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788835245.936238:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+24:3615:x1875729254116096:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835245.936508:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+24:3615:x1875729254116096:12345-0@lo:400:kworker.0 Request processed in 270us (8697us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835245.936517:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1788835245.936562:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254116352:0@lo:8:kworker.0 00000100:00100000:1.0:1788835245.936605:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835245.936643:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254116480:0@lo:8:kworker.0 00000100:00100000:1.0:1788835245.938049:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835245.938108:0:3613:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254116992:0@lo:8:kworker.0 00000100:00100000:1.0:1788835245.938138:0:3613:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835245.938183:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254116352 00000100:00100000:1.0:1788835245.938189:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254116352 00000100:00100000:1.0:1788835245.938212:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254116480 00000100:00100000:1.0:1788835245.938215:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254116480 00000100:00100000:1.0:1788835245.938223:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254116992 00000100:00100000:1.0:1788835245.938226:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254116992 00000100:00100000:1.0:1788835245.938238:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788835245.938244:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875729254116352:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788835245.938285:0:18567:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:1.0:1788835245.938339:0:18567:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf60171e5a5d2fa9 00000100:00100000:2.0:1788835245.938463:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e815500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254116736:12345-0@lo:400:kworker.0 Request processed in 9820us (10515us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835245.938473:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1788835245.938710:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254116736:0@lo:400:kworker.0 00000100:00100000:3.0:1788835245.938724:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb888812-a79c-4531-9a69-89c757e37463:3615:1875729254116096:0@lo:400:kworker.0 00002000:00100000:1.0:1788835245.938927:0:18567:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9afdbd9ea800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1788835245.938932:0:18567:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:1.0:1788835245.938935:0:18567:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788835245.939071:0:18567:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1788835245.939105:0:18567:0:(import.c:65:import_set_state_nolock()) ffff9afdbd9ec000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788835245.939161:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3613:x1875729254116352:12345-0@lo:8:kworker.0 Request processed in 916us (2556us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835245.939169:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1788835245.939183:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1788835245.939188:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875729254116480:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788835245.939205:0:18567:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:1.0:1788835245.939222:0:18567:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xdf60171e5a5d2fb0 00002000:00100000:1.0:1788835245.939228:0:18567:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9afdbd9ef000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1788835245.939242:0:18567:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1788835245.939244:0:18567:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:2.0:1788835245.939504:0:19151:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1788835245.939513:0:19151:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00010000:00080000:3.0:1788835245.940934:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc845fd180 x1875729254116352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788835270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835245.940959:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788835245.940968:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788835245.940978:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788835245.940984:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1788835245.940987:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afdbf96b800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788835245.941008:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788835245.941024:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254116352:0@lo:8:kworker.0 00000004:00080000:3.0:1788835245.941093:0:17086:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x280000401:0x5:0x0] 00000100:00100000:3.0:1788835245.941114:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e814380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17086:1875729254117888:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1788835245.941165:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835245.941183:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd852349c0 going to sleep for 11 seconds 00000100:00100000:3.0:1788835245.941196:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254117760:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788835245.941222:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835245.941275:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254117760 00000100:00100000:3.0:1788835245.941280:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254117760 00002000:00080000:1.0:1788835245.941634:0:18567:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788835245.941658:0:18567:0:(import.c:65:import_set_state_nolock()) ffff9afdbd9ed800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788835245.941727:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3613:x1875729254116480:12345-0@lo:8:kworker.0 Request processed in 2537us (3682us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835245.941736:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788835245.941824:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1788835245.941835:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875729254117760:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1788835245.941858:0:18570:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 279104 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788835245.941896:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3617:x1875729254117760:12345-0@lo:13:osp-pre-0-0.0 Request processed in 64us (673us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835245.941903:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1788835245.941925:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1788835245.942242:0:17085:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00010000:00080000:3.0:1788835245.942344:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afd9e815f80 x1875729254117760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835245.942514:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254117888 00000100:00100000:1.0:1788835245.942519:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254117888 00000100:00100000:1.0:1788835245.942544:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788835245.942549:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3613:x1875729254116992:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1788835245.942576:0:18567:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0001-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 487 last 0 00000020:00000080:1.0:1788835245.942602:0:18567:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0001-mdtlov_UUID, cookie 0xdf60171e5a5d2fb7 00002000:00100000:1.0:1788835245.942617:0:18567:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0001-mdtlov_UUID/ffff9afdbd9e9800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 1 ocd_group 1 00002000:00080000:1.0:1788835245.942621:0:18567:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 1 00002000:00100000:1.0:1788835245.942624:0:18567:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1788835245.942690:0:18567:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 1 00000100:00080000:1.0:1788835245.942707:0:18567:0:(import.c:65:import_set_state_nolock()) ffff9afdbd9ea000 : changing import state from RECOVER to FULL 00000004:00080000:2.0:1788835245.942899:0:17085:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 487984582440ns, next at 0ns, rc = 0 00080000:00080000:2.0:1788835245.942905:0:17085:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000100:00100000:3.0:1788835245.943438:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e815f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254117760:0@lo:13:osp-pre-0-0.0 00010000:00080000:3.0:1788835245.943492:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc845fdc00 x1875729254116480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788835270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835245.943501:0:3613:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1788835245.943507:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1788835245.943515:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788835245.943519:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788835245.943533:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc8369a000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788835245.943549:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788835245.943554:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3613:1875729254116480:0@lo:8:kworker.0 00010000:00080000:3.0:1788835245.943577:0:3613:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc845ff480 x1875729254116992/t0(0) o8->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 520/416 e 0 to 0 dl 1788835270 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1788835245.943587:0:3613:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0001: connect to target with instance 2 00000100:00080000:3.0:1788835245.943593:0:3613:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0001: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1788835245.943596:0:3613:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1788835245.943598:0:3613:0:(import.c:65:import_set_state_nolock()) ffff9afc830ff800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1788835245.943610:0:3613:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1788835245.943614:0:3613:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0001-mdtlov_UUID:3613:1875729254116992:0@lo:8:kworker.0 00000004:00080000:3.0:1788835245.943665:0:17088:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x2c0000401:0x6:0x0] 00000100:00100000:3.0:1788835245.943684:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17088:1875729254118144:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788835245.945523:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788835245.945548:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254118016:0@lo:13:osp-pre-1-0.0 00000004:00080000:0.0:1788835245.946114:0:17087:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788835245.946202:0:17087:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 487987886002ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788835245.946209:0:17087:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0000: async commit OSD 00000004:00080000:0.0:1788835245.946255:0:17805:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: going to cleanup orphans since [0x2c0000400:0x1:0x0] 00000100:00100000:0.0:1788835245.946291:0:17805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17805:1875729254118400:0@lo:7:osp-pre-1-1.0 00000100:00100000:0.0:1788835245.946368:0:17805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835245.946390:0:17805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc82689900 going to sleep for 11 seconds 00000004:00080000:0.0:1788835245.946405:0:17804:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1788835245.946498:0:17804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0001: add commit cb at 487988182422ns, next at 0ns, rc = 0 00080000:00080000:0.0:1788835245.946503:0:17804:0:(osd_handler.c:2849:osd_commit_async()) lustre-MDT0001: async commit OSD 00000100:00100000:0.0:1788835245.946602:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788835245.946614:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254118272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788835245.946645:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835245.946689:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254118272 00000100:00100000:0.0:1788835245.946696:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254118272 00000100:00100000:0.0:1788835245.946868:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1788835245.946880:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3614:x1875729254118272:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788835245.946908:0:18570:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788835245.946955:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+7:3614:x1875729254118272:12345-0@lo:13:osp-pre-1-1.0 Request processed in 79us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835245.946963:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1788835245.946986:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1788835245.947015:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83ed1880 x1875729254118272/t0(0) o13->lustre-OST0001-osc-MDT0001@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835245.947035:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254118272:0@lo:13:osp-pre-1-1.0 00000100:00100000:0.0:1788835245.947101:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e817b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254116864:12345-0@lo:400:kworker.0 Request processed in 16410us (19233us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835245.947111:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1788835245.947126:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254118400 00000100:00100000:0.0:1788835245.947130:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254118400 00000100:00100000:0.0:1788835245.947148:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1788835245.947155:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17086:x1875729254117888:12345-0@lo:5:osp-pre-0-0.0 00000100:00100000:1.0:1788835245.947956:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+7:3613:x1875729254116992:12345-0@lo:8:kworker.0 Request processed in 5390us (9802us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835245.947967:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788835245.947991:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1788835245.948001:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17805:x1875729254118400:12345-0@lo:7:osp-pre-1-1.0 00000100:00100000:2.0:1788835245.950590:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1788835245.950654:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc845fd880 x1875729254116864/t0(0) o400->lustre-OST0000-osc-MDT0001@0@lo:28/4 lens 224/224 e 0 to 0 dl 1788835261 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835245.950682:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254116864:0@lo:400:kworker.0 00000100:00100000:3.0:1788835245.951152:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835245.951176:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd85234a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788835245.951337:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254118144 00000100:00100000:0.0:1788835245.951345:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254118144 00000100:00080000:0.0:1788835245.951540:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788835245.951601:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254118016 00000100:00100000:0.0:1788835245.951605:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254118016 00000100:00100000:0.0:1788835245.951635:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1788835245.951644:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1875729254118016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1788835245.951681:0:18570:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 280000 pending 0 free 3923505152 avail 3691982848 00000100:00100000:0.0:1788835245.951983:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f38a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3615:x1875729254118016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835245.951991:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1788835245.952231:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc845ff480 x1875729254118016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1788835261 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835245.952251:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254118016:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1788835245.952577:0:19538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1788835245.952586:0:19538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:17088:x1875729254118144:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1788835245.955138:0:18567:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000400 00002000:00080000:1.0:1788835245.955156:0:18567:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788835245.955251:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17805:x1875729254118400:12345-0@lo:7:osp-pre-1-1.0 Request processed in 7250us (8891us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835245.956654:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:1.0:1788835245.960651:0:17805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83ed2300 x1875729254118400/t0(0) o7->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 264/240 e 0 to 0 dl 1788835261 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835245.960685:0:17805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed2300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17805:1875729254118400:0@lo:7:osp-pre-1-1.0 00000004:00080000:1.0:1788835245.960700:0:17805:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0001: Got last_fid [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788835245.964841:0:17805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17805:1875729254118528:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788835245.964916:0:17805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835245.965232:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254118528 00000100:00100000:0.0:1788835245.965241:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254118528 00000100:00100000:0.0:1788835245.965302:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788835245.965311:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17805:x1875729254118528:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:0.0:1788835245.965496:0:19151:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = 0 00000100:00100000:1.0:1788835245.968873:0:17805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82cc2180 going to sleep for 11 seconds 00002000:00080000:2.0:1788835245.970829:0:19538:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x2c0000401 00002000:00080000:2.0:1788835245.970842:0:19538:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:2.0:1788835245.970848:0:19538:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x2c0000401:7 to 0x2c0000401:33) 00000100:00100000:0.0:1788835245.980514:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83109880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+6:17805:x1875729254118528:12345-0@lo:5:osp-pre-1-1.0 Request processed in 15193us (15587us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835245.980530:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000004:00080000:0.0:1788835245.981995:0:17793:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0001: 1 committed 00000004:00080000:0.0:1788835245.982050:0:17040:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00080000:1.0:1788835245.982938:0:17805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83109f80 x1875729254118528/t0(0) o5->lustre-OST0001-osc-MDT0001@0@lo:28/4 lens 432/432 e 0 to 0 dl 1788835261 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835245.982957:0:17805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17805:1875729254118528:0@lo:5:osp-pre-1-1.0 00000004:00080000:1.0:1788835245.982978:0:17805:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0001: Got last_id [0x2c0000400:0x21:0x0] from OST, last_created [0x2c0000400:0x21:0x0]last_used is [0x2c0000400:0x21:0x0] 00000100:00100000:1.0:1788835245.983039:0:17805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17805:1875729254118656:0@lo:5:osp-pre-1-1.0 00000100:00100000:1.0:1788835245.983113:0:17805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835245.983157:0:17805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd82cc2180 going to sleep for 11 seconds 00000100:00100000:1.0:1788835245.983184:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254118656 00000100:00100000:1.0:1788835245.983191:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254118656 00000100:00100000:1.0:1788835245.983250:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788835245.983260:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+6:17805:x1875729254118656:12345-0@lo:5:osp-pre-1-1.0 00002000:00080000:1.0:1788835245.983297:0:18567:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000400 at 34 00000004:00080000:1.0:1788835245.987918:0:17040:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00080000:3.0:1788835245.990107:0:18568:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x280000401 00002000:00080000:3.0:1788835245.990120:0:18568:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:3.0:1788835245.990127:0:18568:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000401:6 to 0x280000401:33) 00002000:00010000:2.0:1788835245.995966:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788835245.995987:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae1d0e4f/0xdf60171e5a5d2fbe lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835245.996008:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788835245.996013:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835245.996026:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae1d0e4f/0xdf60171e5a5d2fbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835245.996049:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae1d0e4f/0xdf60171e5a5d2fbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835245.996061:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae1d0e4f/0xdf60171e5a5d2fbe lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835245.996068:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae1d0e4f/0xdf60171e5a5d2fbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835245.996108:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788835245.996143:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835245.996156:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae1d0e4f/0xdf60171e5a5d2fbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835245.996173:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374c800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835245.996178:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae1d0e4f/0xdf60171e5a5d2fbe lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835245.996189:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae1d0e4f/0xdf60171e5a5d2fbe lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835245.996214:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae1d0e4f/0xdf60171e5a5d2fbe lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835245.996222:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae1d0e4f/0xdf60171e5a5d2fbe lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835245.996251:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835245.996254:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835245.996256:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788835245.998928:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788835245.998943:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000063e52b8/0xdf60171e5a5d2fc5 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835245.998961:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1788835245.998966:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835245.998973:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000063e52b8/0xdf60171e5a5d2fc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835245.999004:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000063e52b8/0xdf60171e5a5d2fc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835245.999017:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000063e52b8/0xdf60171e5a5d2fc5 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835245.999025:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000063e52b8/0xdf60171e5a5d2fc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835245.999049:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788835245.999902:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788835245.999911:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d2fcc lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835245.999923:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1788835245.999928:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835245.999933:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d2fcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835245.999944:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d2fcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835245.999953:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d2fcc lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835245.999973:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d2fcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835245.999992:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788835246.000002:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788835246.000007:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000063e52b8/0xdf60171e5a5d2fc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.000015:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835246.000020:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000063e52b8/0xdf60171e5a5d2fc5 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.000030:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000063e52b8/0xdf60171e5a5d2fc5 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.000050:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000063e52b8/0xdf60171e5a5d2fc5 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.000803:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835246.001458:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000063e52b8/0xdf60171e5a5d2fc5 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.001466:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.001478:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d2fcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.001485:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.001489:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.001497:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5e00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835246.001497:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.001506:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d2fcc lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.001531:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d2fcc lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.001555:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d2fcc lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.001565:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d2fcc lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.001596:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.001598:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.001601:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.001607:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.001610:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788835246.003934:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788835246.003964:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ead74886/0xdf60171e5a5d2fd3 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.003981:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1788835246.003987:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835246.003994:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ead74886/0xdf60171e5a5d2fd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.004008:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ead74886/0xdf60171e5a5d2fd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.004020:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ead74886/0xdf60171e5a5d2fd3 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.004038:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ead74886/0xdf60171e5a5d2fd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.004060:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788835246.004087:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835246.004094:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ead74886/0xdf60171e5a5d2fd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.004102:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4400 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835246.004106:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ead74886/0xdf60171e5a5d2fd3 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.004116:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ead74886/0xdf60171e5a5d2fd3 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.004145:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ead74886/0xdf60171e5a5d2fd3 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.004153:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ead74886/0xdf60171e5a5d2fd3 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.004172:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.004174:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.004177:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788835246.006209:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788835246.006221:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bf095d2/0xdf60171e5a5d2fda lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.006236:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1788835246.006241:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835246.006246:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bf095d2/0xdf60171e5a5d2fda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.006258:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bf095d2/0xdf60171e5a5d2fda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.006268:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bf095d2/0xdf60171e5a5d2fda lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.006276:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bf095d2/0xdf60171e5a5d2fda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.006329:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788835246.008154:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788835246.008166:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d2fe1 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.008180:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1788835246.008184:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835246.008190:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d2fe1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.008203:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d2fe1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.008213:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d2fe1 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.008220:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d2fe1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.008242:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1788835246.009271:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788835246.009287:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bf095d2/0xdf60171e5a5d2fda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.009303:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4a00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.009309:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bf095d2/0xdf60171e5a5d2fda lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.009338:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bf095d2/0xdf60171e5a5d2fda lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.009363:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bf095d2/0xdf60171e5a5d2fda lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.009389:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bf095d2/0xdf60171e5a5d2fda lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.009422:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835246.009427:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d2fe1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.009435:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5400 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.009438:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d2fe1 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.009447:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d2fe1 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.009458:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d2fe1 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.009466:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d2fe1 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.009482:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.009484:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.009486:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.009493:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788835246.012447:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788835246.012473:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee8e9c08/0xdf60171e5a5d2fe8 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.012495:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788835246.012502:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835246.012510:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8e9c08/0xdf60171e5a5d2fe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.012530:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ee8e9c08/0xdf60171e5a5d2fe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.012543:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ee8e9c08/0xdf60171e5a5d2fe8 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.012552:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ee8e9c08/0xdf60171e5a5d2fe8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.012580:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788835246.013197:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835246.013212:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ee8e9c08/0xdf60171e5a5d2fe8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.013226:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835246.013239:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee8e9c08/0xdf60171e5a5d2fe8 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.013249:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ee8e9c08/0xdf60171e5a5d2fe8 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.013269:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ee8e9c08/0xdf60171e5a5d2fe8 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.013276:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ee8e9c08/0xdf60171e5a5d2fe8 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.013297:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.013299:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.013301:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788835246.014275:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788835246.014283:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bf192b5/0xdf60171e5a5d2fef lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.014296:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1788835246.014301:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835246.014307:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001bf192b5/0xdf60171e5a5d2fef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.014337:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001bf192b5/0xdf60171e5a5d2fef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.014804:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001bf192b5/0xdf60171e5a5d2fef lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.014821:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001bf192b5/0xdf60171e5a5d2fef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.014845:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788835246.014999:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835246.015011:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001bf192b5/0xdf60171e5a5d2fef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.015024:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5600 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.015030:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001bf192b5/0xdf60171e5a5d2fef lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.015040:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001bf192b5/0xdf60171e5a5d2fef lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.015083:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001bf192b5/0xdf60171e5a5d2fef lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.015092:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001bf192b5/0xdf60171e5a5d2fef lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.015123:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.015125:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.015127:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788835246.016425:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788835246.016438:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b86c7e54/0xdf60171e5a5d2ff6 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.016455:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788835246.016462:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835246.016469:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b86c7e54/0xdf60171e5a5d2ff6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.016483:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b86c7e54/0xdf60171e5a5d2ff6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.016494:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b86c7e54/0xdf60171e5a5d2ff6 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.016503:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b86c7e54/0xdf60171e5a5d2ff6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.016536:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788835246.016727:0:19542:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835246.016735:0:19542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b86c7e54/0xdf60171e5a5d2ff6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.016745:0:19542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80030400 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.016750:0:19542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b86c7e54/0xdf60171e5a5d2ff6 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.016761:0:19542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b86c7e54/0xdf60171e5a5d2ff6 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.016782:0:19542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b86c7e54/0xdf60171e5a5d2ff6 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.016790:0:19542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b86c7e54/0xdf60171e5a5d2ff6 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.016809:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.016811:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.016813:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788835246.018214:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788835246.018229:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f7ab082/0xdf60171e5a5d2ffd lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.018246:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788835246.018262:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835246.018270:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f7ab082/0xdf60171e5a5d2ffd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.018283:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f7ab082/0xdf60171e5a5d2ffd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.018295:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f7ab082/0xdf60171e5a5d2ffd lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.018304:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f7ab082/0xdf60171e5a5d2ffd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.018348:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788835246.018362:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835246.018368:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f7ab082/0xdf60171e5a5d2ffd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.018377:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80031800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.018382:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f7ab082/0xdf60171e5a5d2ffd lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.018391:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f7ab082/0xdf60171e5a5d2ffd lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.018410:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f7ab082/0xdf60171e5a5d2ffd lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.018430:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f7ab082/0xdf60171e5a5d2ffd lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.018450:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.018452:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.018454:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788835246.024165:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788835246.024182:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d3004 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.024200:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1788835246.024204:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835246.024211:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d3004 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.024239:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d3004 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.024250:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d3004 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.024257:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d3004 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.024279:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788835246.024919:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835246.024932:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d3004 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.024947:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884abc00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.024953:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d3004 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.024966:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d3004 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.024993:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d3004 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.025001:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000088d95542/0xdf60171e5a5d3004 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.025032:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.025034:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.025036:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788835246.025602:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788835246.025610:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f43a724e/0xdf60171e5a5d300b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.025623:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1788835246.025626:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835246.025631:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f43a724e/0xdf60171e5a5d300b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.025642:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f43a724e/0xdf60171e5a5d300b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.025651:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f43a724e/0xdf60171e5a5d300b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.025684:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f43a724e/0xdf60171e5a5d300b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.025707:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788835246.026032:0:19542:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788835246.026047:0:19542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f43a724e/0xdf60171e5a5d300b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.026056:0:19542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884ab800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:1.0:1788835246.026061:0:19542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f43a724e/0xdf60171e5a5d300b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.026070:0:19542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f43a724e/0xdf60171e5a5d300b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.026104:0:19542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f43a724e/0xdf60171e5a5d300b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.026112:0:19542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f43a724e/0xdf60171e5a5d300b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.026135:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835246.026138:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835246.026140:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788835246.026301:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788835246.026308:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1fe9368/0xdf60171e5a5d3012 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.026358:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1788835246.026362:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835246.026367:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1fe9368/0xdf60171e5a5d3012 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.026382:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1fe9368/0xdf60171e5a5d3012 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.026391:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1fe9368/0xdf60171e5a5d3012 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.026398:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1fe9368/0xdf60171e5a5d3012 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.026420:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788835246.026438:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835246.026451:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1fe9368/0xdf60171e5a5d3012 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.026464:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884ab200 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.026470:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1fe9368/0xdf60171e5a5d3012 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.026481:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1fe9368/0xdf60171e5a5d3012 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.026507:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1fe9368/0xdf60171e5a5d3012 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.026515:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1fe9368/0xdf60171e5a5d3012 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.026540:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.026542:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.026544:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788835246.028070:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788835246.028094:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7a933dc/0xdf60171e5a5d3019 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.028115:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1788835246.028120:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835246.028126:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a933dc/0xdf60171e5a5d3019 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.028139:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a7a933dc/0xdf60171e5a5d3019 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.028150:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a7a933dc/0xdf60171e5a5d3019 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.028158:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a7a933dc/0xdf60171e5a5d3019 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.028179:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788835246.028467:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835246.028482:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a7a933dc/0xdf60171e5a5d3019 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.028495:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aae00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.028501:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a933dc/0xdf60171e5a5d3019 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.028528:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a7a933dc/0xdf60171e5a5d3019 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.028551:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a7a933dc/0xdf60171e5a5d3019 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.028559:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a7a933dc/0xdf60171e5a5d3019 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.028586:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.028588:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.028590:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788835246.028688:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788835246.028697:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d9fa20d/0xdf60171e5a5d3020 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.028711:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788835246.028716:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835246.028724:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d9fa20d/0xdf60171e5a5d3020 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.028738:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d9fa20d/0xdf60171e5a5d3020 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.028748:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d9fa20d/0xdf60171e5a5d3020 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.028767:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d9fa20d/0xdf60171e5a5d3020 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.028803:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1788835246.029496:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788835246.029512:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0261293/0xdf60171e5a5d3027 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.029527:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1788835246.029532:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835246.029540:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d0261293/0xdf60171e5a5d3027 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.029557:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d0261293/0xdf60171e5a5d3027 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.029580:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d0261293/0xdf60171e5a5d3027 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.029588:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d0261293/0xdf60171e5a5d3027 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.029609:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1788835246.030007:0:19542:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1788835246.030015:0:19542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d9fa20d/0xdf60171e5a5d3020 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.030025:0:19542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80031000 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:1.0:1788835246.030031:0:19542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d9fa20d/0xdf60171e5a5d3020 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.030053:0:19542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d9fa20d/0xdf60171e5a5d3020 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.030083:0:19542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d9fa20d/0xdf60171e5a5d3020 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.030091:0:19542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d9fa20d/0xdf60171e5a5d3020 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.030115:0:19542:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788835246.030118:0:19542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d0261293/0xdf60171e5a5d3027 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.030124:0:19542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884ab000 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:1.0:1788835246.030127:0:19542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0261293/0xdf60171e5a5d3027 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.030134:0:19542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d0261293/0xdf60171e5a5d3027 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.030145:0:19542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d0261293/0xdf60171e5a5d3027 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.030152:0:19542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d0261293/0xdf60171e5a5d3027 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.030176:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835246.030178:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835246.030180:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.031114:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788835246.033983:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788835246.033998:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009744ecdf/0xdf60171e5a5d302e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.034029:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1788835246.034034:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835246.034041:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009744ecdf/0xdf60171e5a5d302e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.034055:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009744ecdf/0xdf60171e5a5d302e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.034065:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009744ecdf/0xdf60171e5a5d302e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.034072:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009744ecdf/0xdf60171e5a5d302e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.034118:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788835246.034330:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788835246.034338:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009744ecdf/0xdf60171e5a5d302e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.034357:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aba00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:3.0:1788835246.034361:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009744ecdf/0xdf60171e5a5d302e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.034370:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009744ecdf/0xdf60171e5a5d302e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.034385:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009744ecdf/0xdf60171e5a5d302e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.034391:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009744ecdf/0xdf60171e5a5d302e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.034407:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835246.034408:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835246.034410:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788835246.035657:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788835246.035673:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000414d5b8f/0xdf60171e5a5d3035 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.035693:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788835246.035699:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835246.035707:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000414d5b8f/0xdf60171e5a5d3035 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.035724:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000414d5b8f/0xdf60171e5a5d3035 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.035737:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000414d5b8f/0xdf60171e5a5d3035 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.035745:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000414d5b8f/0xdf60171e5a5d3035 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.035766:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788835246.037169:0:19542:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835246.037198:0:19542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000414d5b8f/0xdf60171e5a5d3035 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.037212:0:19542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80031e00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.037217:0:19542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000414d5b8f/0xdf60171e5a5d3035 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.037230:0:19542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000414d5b8f/0xdf60171e5a5d3035 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.037254:0:19542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000414d5b8f/0xdf60171e5a5d3035 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.037263:0:19542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000414d5b8f/0xdf60171e5a5d3035 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.037289:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.037292:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.037296:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788835246.037368:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788835246.037381:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ead74886/0xdf60171e5a5d303c lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.037397:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1788835246.037401:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835246.037407:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ead74886/0xdf60171e5a5d303c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.037422:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ead74886/0xdf60171e5a5d303c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.037432:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ead74886/0xdf60171e5a5d303c lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.037440:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ead74886/0xdf60171e5a5d303c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.037468:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788835246.037477:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835246.037486:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ead74886/0xdf60171e5a5d303c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.037496:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4400 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.037500:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ead74886/0xdf60171e5a5d303c lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.037525:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ead74886/0xdf60171e5a5d303c lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.037542:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ead74886/0xdf60171e5a5d303c lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.037552:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ead74886/0xdf60171e5a5d303c lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.037571:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.037573:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.037575:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788835246.039033:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788835246.039045:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000063e52b8/0xdf60171e5a5d3043 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.039066:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1788835246.039070:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835246.039087:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000063e52b8/0xdf60171e5a5d3043 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.039100:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000063e52b8/0xdf60171e5a5d3043 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.039109:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000063e52b8/0xdf60171e5a5d3043 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.039117:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000063e52b8/0xdf60171e5a5d3043 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.039135:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788835246.039490:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788835246.039498:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d304a lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.039507:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1788835246.039512:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835246.039516:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d304a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.039526:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d304a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.039549:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d304a lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.039557:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d304a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.039580:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:2.0:1788835246.039597:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788835246.039612:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dde96522/0xdf60171e5a5d3051 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.039629:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788835246.039635:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835246.039641:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dde96522/0xdf60171e5a5d3051 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.039656:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dde96522/0xdf60171e5a5d3051 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.039666:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dde96522/0xdf60171e5a5d3051 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.039683:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dde96522/0xdf60171e5a5d3051 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.039703:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:2.0:1788835246.039716:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1788835246.039722:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000063e52b8/0xdf60171e5a5d3043 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.039732:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.039737:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000063e52b8/0xdf60171e5a5d3043 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.039747:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000063e52b8/0xdf60171e5a5d3043 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.039767:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000063e52b8/0xdf60171e5a5d3043 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.039775:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000063e52b8/0xdf60171e5a5d3043 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.039798:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788835246.039802:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d304a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.039819:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5400 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.039823:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d304a lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.039832:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d304a lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.039917:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d304a lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.039927:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006f6b0fed/0xdf60171e5a5d304a lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.039952:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835246.039957:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dde96522/0xdf60171e5a5d3051 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.039967:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80030800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.039971:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dde96522/0xdf60171e5a5d3051 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.039979:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dde96522/0xdf60171e5a5d3051 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.039992:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dde96522/0xdf60171e5a5d3051 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.040009:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dde96522/0xdf60171e5a5d3051 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.040091:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.040094:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.040096:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.040307:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788835246.040456:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788835246.040464:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bf095d2/0xdf60171e5a5d3058 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.040476:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1788835246.040480:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835246.040485:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bf095d2/0xdf60171e5a5d3058 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.040495:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bf095d2/0xdf60171e5a5d3058 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.040504:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bf095d2/0xdf60171e5a5d3058 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.040512:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bf095d2/0xdf60171e5a5d3058 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.040547:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788835246.041118:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835246.041127:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bf095d2/0xdf60171e5a5d3058 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.041139:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4a00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.041143:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bf095d2/0xdf60171e5a5d3058 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.041152:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bf095d2/0xdf60171e5a5d3058 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.041172:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bf095d2/0xdf60171e5a5d3058 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1788835246.042238:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788835246.042250:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d305f lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.042265:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1788835246.042269:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835246.042275:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d305f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.042287:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d305f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.042297:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d305f lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.042304:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d305f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.044171:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1788835246.044952:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788835246.044963:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee8e9c08/0xdf60171e5a5d3066 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.044978:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1788835246.044988:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835246.044994:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee8e9c08/0xdf60171e5a5d3066 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.045008:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee8e9c08/0xdf60171e5a5d3066 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.045018:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ee8e9c08/0xdf60171e5a5d3066 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.045025:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ee8e9c08/0xdf60171e5a5d3066 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.045098:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bf095d2/0xdf60171e5a5d3058 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.045138:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788835246.045145:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d305f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.045170:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5e00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:3.0:1788835246.045998:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788835246.046020:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ee8e9c08/0xdf60171e5a5d3066 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.046032:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374d800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:3.0:1788835246.046046:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee8e9c08/0xdf60171e5a5d3066 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.046055:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ee8e9c08/0xdf60171e5a5d3066 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.046084:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ee8e9c08/0xdf60171e5a5d3066 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.046096:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835246.046098:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835246.046102:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.046112:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d305f lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.046130:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d305f lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.046152:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d305f lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.046160:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000104ec54c/0xdf60171e5a5d305f lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.046396:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1788835246.046403:0:18568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee8e9c08/0xdf60171e5a5d3066 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.046514:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.046518:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.046520:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.046533:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788835246.047028:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788835246.047035:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae1d0e4f/0xdf60171e5a5d306d lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.047046:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1788835246.047050:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835246.047055:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ae1d0e4f/0xdf60171e5a5d306d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.047066:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ae1d0e4f/0xdf60171e5a5d306d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.047094:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ae1d0e4f/0xdf60171e5a5d306d lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.047101:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ae1d0e4f/0xdf60171e5a5d306d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.047126:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788835246.047974:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835246.047982:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ae1d0e4f/0xdf60171e5a5d306d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.047993:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374c800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.047998:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae1d0e4f/0xdf60171e5a5d306d lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.048018:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ae1d0e4f/0xdf60171e5a5d306d lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.048044:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ae1d0e4f/0xdf60171e5a5d306d lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.048052:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae1d0e4f/0xdf60171e5a5d306d lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.048072:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.048083:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.048085:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835246.048533:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1788835246.049154:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788835246.049163:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d3074 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.049176:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788835246.049180:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835246.049185:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d3074 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.049198:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d3074 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.049207:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d3074 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.049215:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d3074 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.049237:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788835246.049711:0:19542:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835246.049719:0:19542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d3074 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.049730:0:19542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61000 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835246.049735:0:19542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d3074 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.049755:0:19542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d3074 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.049772:0:19542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d3074 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.049781:0:19542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000069d28be/0xdf60171e5a5d3074 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.049802:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.049812:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.049815:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788835246.050851:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788835246.050861:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f7ab082/0xdf60171e5a5d307b lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.050874:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788835246.050878:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835246.050883:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001f7ab082/0xdf60171e5a5d307b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.050895:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001f7ab082/0xdf60171e5a5d307b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.050905:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001f7ab082/0xdf60171e5a5d307b lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.050912:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001f7ab082/0xdf60171e5a5d307b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.050988:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788835246.051303:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835246.051310:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001f7ab082/0xdf60171e5a5d307b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.051356:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80031800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835246.051360:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001f7ab082/0xdf60171e5a5d307b lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.051368:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001f7ab082/0xdf60171e5a5d307b lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.051383:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001f7ab082/0xdf60171e5a5d307b lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.051390:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001f7ab082/0xdf60171e5a5d307b lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.051409:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.051410:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.051411:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788835246.051683:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788835246.051688:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b86c7e54/0xdf60171e5a5d3082 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.051697:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788835246.051700:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835246.051704:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b86c7e54/0xdf60171e5a5d3082 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.051714:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b86c7e54/0xdf60171e5a5d3082 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.051722:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b86c7e54/0xdf60171e5a5d3082 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.051729:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b86c7e54/0xdf60171e5a5d3082 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.051882:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788835246.052030:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835246.052036:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b86c7e54/0xdf60171e5a5d3082 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.052044:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80030400 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835246.052048:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b86c7e54/0xdf60171e5a5d3082 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.052064:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b86c7e54/0xdf60171e5a5d3082 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.052092:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b86c7e54/0xdf60171e5a5d3082 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.052100:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b86c7e54/0xdf60171e5a5d3082 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.052114:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.052116:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.052117:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788835246.052284:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788835246.052291:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fac15cb5/0xdf60171e5a5d3089 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.052299:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788835246.052306:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835246.052311:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fac15cb5/0xdf60171e5a5d3089 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.052406:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fac15cb5/0xdf60171e5a5d3089 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.052416:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fac15cb5/0xdf60171e5a5d3089 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.052424:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fac15cb5/0xdf60171e5a5d3089 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.052440:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788835246.052560:0:19542:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835246.052566:0:19542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fac15cb5/0xdf60171e5a5d3089 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.052574:0:19542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80030000 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835246.052577:0:19542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fac15cb5/0xdf60171e5a5d3089 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.052585:0:19542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fac15cb5/0xdf60171e5a5d3089 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.052596:0:19542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fac15cb5/0xdf60171e5a5d3089 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.052616:0:19542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fac15cb5/0xdf60171e5a5d3089 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.052630:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.052632:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.052634:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788835246.052871:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788835246.052878:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6843a98/0xdf60171e5a5d3090 lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.052886:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788835246.052889:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835246.052893:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6843a98/0xdf60171e5a5d3090 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.052902:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6843a98/0xdf60171e5a5d3090 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.052910:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6843a98/0xdf60171e5a5d3090 lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.052922:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6843a98/0xdf60171e5a5d3090 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.052942:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1788835246.053219:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788835246.053226:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbf59396/0xdf60171e5a5d3097 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.053244:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788835246.053247:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835246.053251:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cbf59396/0xdf60171e5a5d3097 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.053261:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cbf59396/0xdf60171e5a5d3097 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.053268:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cbf59396/0xdf60171e5a5d3097 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.053274:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cbf59396/0xdf60171e5a5d3097 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.053292:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788835246.053460:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788835246.053465:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6843a98/0xdf60171e5a5d3090 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.053473:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80031600 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835246.053477:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6843a98/0xdf60171e5a5d3090 lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.053484:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6843a98/0xdf60171e5a5d3090 lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.053495:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6843a98/0xdf60171e5a5d3090 lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.053502:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6843a98/0xdf60171e5a5d3090 lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.053517:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835246.053520:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cbf59396/0xdf60171e5a5d3097 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.053533:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61400 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835246.053535:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbf59396/0xdf60171e5a5d3097 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.053542:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cbf59396/0xdf60171e5a5d3097 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.053553:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cbf59396/0xdf60171e5a5d3097 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.053560:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cbf59396/0xdf60171e5a5d3097 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.053572:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.053573:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.053575:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.053952:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788835246.054268:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788835246.054276:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cd856c9/0xdf60171e5a5d309e lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.054286:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1788835246.054290:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835246.054294:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000cd856c9/0xdf60171e5a5d309e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.054304:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000cd856c9/0xdf60171e5a5d309e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1788835246.054532:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:1.0:1788835246.054538:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000801877f/0xdf60171e5a5d30a5 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.054546:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=488s v=(0 0) 00010000:00010000:1.0:1788835246.054549:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835246.054553:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000801877f/0xdf60171e5a5d30a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.054562:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000801877f/0xdf60171e5a5d30a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.054582:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000801877f/0xdf60171e5a5d30a5 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.054590:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000801877f/0xdf60171e5a5d30a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.054611:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788835246.054837:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000cd856c9/0xdf60171e5a5d309e lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.054845:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000cd856c9/0xdf60171e5a5d309e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.054917:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1788835246.055087:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1788835246.055094:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000801877f/0xdf60171e5a5d30a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.055103:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60200 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835246.055107:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000801877f/0xdf60171e5a5d30a5 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.055117:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000801877f/0xdf60171e5a5d30a5 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.055133:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000801877f/0xdf60171e5a5d30a5 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.055508:0:19542:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788835246.055514:0:19542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000cd856c9/0xdf60171e5a5d309e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.055523:0:19542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd81669800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:1.0:1788835246.055526:0:19542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000cd856c9/0xdf60171e5a5d309e lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.055534:0:19542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000cd856c9/0xdf60171e5a5d309e lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.055546:0:19542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000cd856c9/0xdf60171e5a5d309e lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.055553:0:19542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000cd856c9/0xdf60171e5a5d309e lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.055573:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835246.055581:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835246.055583:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.055633:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000801877f/0xdf60171e5a5d30a5 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.055649:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.055651:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.055730:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1788835246.055910:0:19384:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:2.0:1788835246.055939:0:19384:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0001-mdtlov_UUID 00000001:00100000:2.0:1788835246.055943:0:19384:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00002000:00010000:2.0:1788835246.056309:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x2c0000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788835246.056338:0:19538:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dde96522/0xdf60171e5a5d30ac lrc: 3/0,1 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835246.056504:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:17805:x1875729254118656:12345-0@lo:5:osp-pre-1-1.0 Request processed in 73243us (73389us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1788835246.056514:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788835246.056638:0:17805:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0001: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1788835246.056645:0:17805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0001-mdtlov_UUID:17805:1875729254118656:0@lo:5:osp-pre-1-1.0 00010000:00010000:2.0:1788835246.056733:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788835246.056738:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x2c0000401:0x7:0x0].0x0 since=0s v=(0 0) 00002000:00010000:0.0:1788835246.056847:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788835246.056853:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066795f7f/0xdf60171e5a5d30b3 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.056862:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1788835246.056865:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835246.056870:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000066795f7f/0xdf60171e5a5d30b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.056881:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000066795f7f/0xdf60171e5a5d30b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.056889:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000066795f7f/0xdf60171e5a5d30b3 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.056897:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000066795f7f/0xdf60171e5a5d30b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.056914:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788835246.057085:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dde96522/0xdf60171e5a5d30ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.057097:0:19538:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dde96522/0xdf60171e5a5d30ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.057104:0:19538:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000dde96522/0xdf60171e5a5d30ac lrc: 3/0,1 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.057111:0:19538:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dde96522/0xdf60171e5a5d30ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.057199:0:19538:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00080000:2.0:1788835246.057242:0:19538:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x2c0000401:6 00000100:00100000:2.0:1788835246.057301:0:19538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:17088:x1875729254118144:12345-0@lo:5:osp-pre-1-0.0 Request processed in 104715us (106148us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835246.057308:0:19538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000004:00080000:1.0:1788835246.057436:0:17805:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0001: current precreated pool: [0x2c0000400:0x21:0x0]-[0x2c0000400:0x41:0x0] 00000100:00100000:1.0:1788835246.057490:0:17805:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17805:1875729254118784:0@lo:900:osp-pre-1-1.0 00000100:00100000:1.0:1788835246.057530:0:17805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835246.057561:0:17805:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eac840 going to sleep for 11 seconds 00000100:00100000:1.0:1788835246.057582:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254118784 00000100:00100000:1.0:1788835246.057588:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254118784 00000100:00100000:1.0:1788835246.057624:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788835246.057632:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17805:x1875729254118784:12345-0@lo:900:osp-pre-1-1.0 00010000:00010000:2.0:1788835246.057845:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788835246.057852:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000066795f7f/0xdf60171e5a5d30b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.057861:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd81669400 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.057865:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000066795f7f/0xdf60171e5a5d30b3 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.057875:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000066795f7f/0xdf60171e5a5d30b3 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.057891:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000066795f7f/0xdf60171e5a5d30b3 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.057898:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066795f7f/0xdf60171e5a5d30b3 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.057918:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835246.057922:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dde96522/0xdf60171e5a5d30ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.057940:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80030800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.057944:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dde96522/0xdf60171e5a5d30ac lrc: 2/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.057952:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dde96522/0xdf60171e5a5d30ac lrc: 3/0,0 mode: PW/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.057962:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dde96522/0xdf60171e5a5d30ac lrc: 1/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.057969:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dde96522/0xdf60171e5a5d30ac lrc: 0/0,0 mode: --/PW res: [0x2c0000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.057984:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.057985:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.057987:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.058046:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835246.058111:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83109500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-MDT0001_UUID+5:17805:x1875729254118784:12345-0@lo:900:osp-pre-1-1.0 Request processed in 478us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835246.058119:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:0.0:1788835246.058260:0:17805:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83109f80 x1875729254118784/t0(0) o900->lustre-MDT0000-lwp-MDT0001@0@lo:29/10 lens 264/248 e 0 to 0 dl 1788835262 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-1.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835246.058272:0:17805:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109f80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-1:lustre-MDT0000-lwp-MDT0001_UUID:17805:1875729254118784:0@lo:900:osp-pre-1-1.0 00000100:00100000:2.0:1788835246.058489:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17088:1875729254118144:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1788835246.058499:0:17088:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x2c0000401:0x21:0x0] from OST, last_created [0x2c0000401:0x21:0x0]last_used is [0x2c0000401:0x6:0x0] 00000100:00100000:2.0:1788835246.058527:0:17088:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83f39880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17088:1875729254118912:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1788835246.058557:0:17088:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835246.058578:0:17088:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc836a10c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788835246.058638:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254118912 00000100:00100000:0.0:1788835246.058643:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254118912 00000100:00100000:0.0:1788835246.058817:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788835246.058827:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:17088:x1875729254118912:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1788835246.058859:0:19151:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x2c0000401 at 34 00002000:00010000:2.0:1788835246.064611:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788835246.064625:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000414d5b8f/0xdf60171e5a5d30ba lrc: 3/0,1 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.064654:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788835246.064670:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835246.064677:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000414d5b8f/0xdf60171e5a5d30ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.064692:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000414d5b8f/0xdf60171e5a5d30ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.064702:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000414d5b8f/0xdf60171e5a5d30ba lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.064711:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000414d5b8f/0xdf60171e5a5d30ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.064736:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788835246.064760:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835246.064766:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000414d5b8f/0xdf60171e5a5d30ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.064775:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80031e00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.064780:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000414d5b8f/0xdf60171e5a5d30ba lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.064789:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000414d5b8f/0xdf60171e5a5d30ba lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.064817:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000414d5b8f/0xdf60171e5a5d30ba lrc: 1/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.064825:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000414d5b8f/0xdf60171e5a5d30ba lrc: 0/0,0 mode: --/PW res: [0x280000401:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.064844:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.064846:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.064848:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788835246.066053:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788835246.066063:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fce14218/0xdf60171e5a5d30c1 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.066085:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788835246.066089:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835246.066093:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fce14218/0xdf60171e5a5d30c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.066104:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fce14218/0xdf60171e5a5d30c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.066113:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fce14218/0xdf60171e5a5d30c1 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.066121:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fce14218/0xdf60171e5a5d30c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.066833:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788835246.066847:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835246.066853:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fce14218/0xdf60171e5a5d30c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.066862:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80031c00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.066867:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fce14218/0xdf60171e5a5d30c1 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.066875:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fce14218/0xdf60171e5a5d30c1 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.066891:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fce14218/0xdf60171e5a5d30c1 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.066899:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fce14218/0xdf60171e5a5d30c1 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.066917:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.066919:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.066920:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788835246.069890:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788835246.069904:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004053fb42/0xdf60171e5a5d30c8 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.069920:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788835246.069930:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835246.069937:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004053fb42/0xdf60171e5a5d30c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.069951:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004053fb42/0xdf60171e5a5d30c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.069961:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004053fb42/0xdf60171e5a5d30c8 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.069968:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004053fb42/0xdf60171e5a5d30c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.069988:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788835246.070128:0:19542:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835246.070136:0:19542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004053fb42/0xdf60171e5a5d30c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.070145:0:19542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80030e00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835246.070156:0:19542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004053fb42/0xdf60171e5a5d30c8 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.070165:0:19542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004053fb42/0xdf60171e5a5d30c8 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.070182:0:19542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004053fb42/0xdf60171e5a5d30c8 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.070189:0:19542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004053fb42/0xdf60171e5a5d30c8 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.070206:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.070208:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.070210:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788835246.072967:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788835246.072981:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb1670d4/0xdf60171e5a5d30cf lrc: 3/0,1 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.072997:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788835246.073002:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835246.073008:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1670d4/0xdf60171e5a5d30cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.073023:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fb1670d4/0xdf60171e5a5d30cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.073033:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fb1670d4/0xdf60171e5a5d30cf lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.073049:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fb1670d4/0xdf60171e5a5d30cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.073086:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788835246.073124:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835246.073132:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fb1670d4/0xdf60171e5a5d30cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788835246.076495:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788835246.076507:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c1ab4d9/0xdf60171e5a5d30d6 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.076538:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788835246.076543:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835246.076550:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003c1ab4d9/0xdf60171e5a5d30d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.076564:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003c1ab4d9/0xdf60171e5a5d30d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.076580:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003c1ab4d9/0xdf60171e5a5d30d6 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.076587:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003c1ab4d9/0xdf60171e5a5d30d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.076603:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788835246.076616:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835246.076621:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003c1ab4d9/0xdf60171e5a5d30d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.076636:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80030c00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.076640:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003c1ab4d9/0xdf60171e5a5d30d6 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.076649:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003c1ab4d9/0xdf60171e5a5d30d6 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.076666:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003c1ab4d9/0xdf60171e5a5d30d6 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.076673:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003c1ab4d9/0xdf60171e5a5d30d6 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.076690:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.076691:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.076693:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788835246.079276:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788835246.079288:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adaba520/0xdf60171e5a5d30dd lrc: 3/0,1 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.079305:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788835246.079309:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835246.079330:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adaba520/0xdf60171e5a5d30dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.079345:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adaba520/0xdf60171e5a5d30dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.079362:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adaba520/0xdf60171e5a5d30dd lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.079370:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adaba520/0xdf60171e5a5d30dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.079390:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788835246.079402:0:19542:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835246.079407:0:19542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adaba520/0xdf60171e5a5d30dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.079415:0:19542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80031200 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.079419:0:19542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adaba520/0xdf60171e5a5d30dd lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.079427:0:19542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adaba520/0xdf60171e5a5d30dd lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.079444:0:19542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adaba520/0xdf60171e5a5d30dd lrc: 1/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.079452:0:19542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adaba520/0xdf60171e5a5d30dd lrc: 0/0,0 mode: --/PW res: [0x280000401:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.079469:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.079477:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.079479:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1788835246.081960:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:2.0:1788835246.081974:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d9fa20d/0xdf60171e5a5d30e4 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.081990:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=488s v=(0 0) 00010000:00010000:2.0:1788835246.081995:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835246.082001:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005d9fa20d/0xdf60171e5a5d30e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.082015:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005d9fa20d/0xdf60171e5a5d30e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.082025:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005d9fa20d/0xdf60171e5a5d30e4 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.082033:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005d9fa20d/0xdf60171e5a5d30e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.082050:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788835246.082062:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835246.082068:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005d9fa20d/0xdf60171e5a5d30e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.082085:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80031000 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.082090:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005d9fa20d/0xdf60171e5a5d30e4 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.082110:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005d9fa20d/0xdf60171e5a5d30e4 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.082127:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005d9fa20d/0xdf60171e5a5d30e4 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.082146:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005d9fa20d/0xdf60171e5a5d30e4 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.082166:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.082168:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.082170:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.084877:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80030a00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835246.084884:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb1670d4/0xdf60171e5a5d30cf lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.084894:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fb1670d4/0xdf60171e5a5d30cf lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.084916:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fb1670d4/0xdf60171e5a5d30cf lrc: 1/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.084922:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fb1670d4/0xdf60171e5a5d30cf lrc: 0/0,0 mode: --/PW res: [0x280000401:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.084944:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.084947:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.084949:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835246.088745:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f39500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:17088:x1875729254118912:12345-0@lo:5:osp-pre-1-0.0 Request processed in 29914us (30180us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788835246.088758:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1788835246.088926:0:17088:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83f39880 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:17088:1875729254118912:0@lo:5:osp-pre-1-0.0 00002000:00010000:0.0:1788835246.088936:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00000004:00080000:3.0:1788835246.088942:0:17088:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x2c0000401:0x21:0x0]-[0x2c0000401:0x41:0x0] 00010000:00010000:0.0:1788835246.088945:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95bf27d/0xdf60171e5a5d30eb lrc: 3/0,1 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.088961:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1788835246.088965:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835246.088971:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95bf27d/0xdf60171e5a5d30eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.088986:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95bf27d/0xdf60171e5a5d30eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.089051:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95bf27d/0xdf60171e5a5d30eb lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.089061:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95bf27d/0xdf60171e5a5d30eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.089095:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788835246.089374:0:19542:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788835246.089380:0:19542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95bf27d/0xdf60171e5a5d30eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.089390:0:19542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd81668200 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:3.0:1788835246.089394:0:19542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95bf27d/0xdf60171e5a5d30eb lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.089403:0:19542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95bf27d/0xdf60171e5a5d30eb lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.089420:0:19542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95bf27d/0xdf60171e5a5d30eb lrc: 1/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.089435:0:19542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95bf27d/0xdf60171e5a5d30eb lrc: 0/0,0 mode: --/PW res: [0x280000401:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.089454:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835246.089456:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835246.089457:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788835246.089706:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788835246.089712:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000212c194b/0xdf60171e5a5d30f2 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.089722:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1788835246.089725:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835246.089729:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000212c194b/0xdf60171e5a5d30f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.089739:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000212c194b/0xdf60171e5a5d30f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.089747:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000212c194b/0xdf60171e5a5d30f2 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.089754:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000212c194b/0xdf60171e5a5d30f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.089788:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788835246.089825:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1788835246.089831:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000212c194b/0xdf60171e5a5d30f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.089840:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd81668000 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:3.0:1788835246.089843:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000212c194b/0xdf60171e5a5d30f2 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.089850:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000212c194b/0xdf60171e5a5d30f2 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.089861:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000212c194b/0xdf60171e5a5d30f2 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.089867:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000212c194b/0xdf60171e5a5d30f2 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.089879:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835246.089881:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835246.089882:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1788835246.095096:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:0.0:1788835246.095109:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095cd8689/0xdf60171e5a5d30f9 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.095127:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=488s v=(0 0) 00010000:00010000:0.0:1788835246.095132:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835246.095138:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095cd8689/0xdf60171e5a5d30f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.095161:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095cd8689/0xdf60171e5a5d30f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.095171:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095cd8689/0xdf60171e5a5d30f9 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.095179:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095cd8689/0xdf60171e5a5d30f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.095209:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788835246.095782:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788835246.095790:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095cd8689/0xdf60171e5a5d30f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.095801:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd81668800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:1.0:1788835246.095805:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095cd8689/0xdf60171e5a5d30f9 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.095814:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095cd8689/0xdf60171e5a5d30f9 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.095839:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095cd8689/0xdf60171e5a5d30f9 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.096150:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095cd8689/0xdf60171e5a5d30f9 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.096177:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835246.096179:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835246.096182:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788835246.096200:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788835246.096208:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009744ecdf/0xdf60171e5a5d3100 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.096218:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1788835246.096221:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835246.096226:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009744ecdf/0xdf60171e5a5d3100 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.096237:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009744ecdf/0xdf60171e5a5d3100 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.096246:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009744ecdf/0xdf60171e5a5d3100 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.096253:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009744ecdf/0xdf60171e5a5d3100 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.096275:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788835246.096500:0:19542:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835246.096505:0:19542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009744ecdf/0xdf60171e5a5d3100 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.096513:0:19542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aba00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835246.096524:0:19542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009744ecdf/0xdf60171e5a5d3100 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.096532:0:19542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009744ecdf/0xdf60171e5a5d3100 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.096545:0:19542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009744ecdf/0xdf60171e5a5d3100 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.096552:0:19542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009744ecdf/0xdf60171e5a5d3100 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.096567:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.096569:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.096570:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788835246.096691:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788835246.096697:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7a933dc/0xdf60171e5a5d3107 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.096705:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1788835246.096708:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835246.096712:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a7a933dc/0xdf60171e5a5d3107 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.096734:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a7a933dc/0xdf60171e5a5d3107 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.096810:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a7a933dc/0xdf60171e5a5d3107 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.096820:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a7a933dc/0xdf60171e5a5d3107 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.096842:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788835246.096862:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835246.096868:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a7a933dc/0xdf60171e5a5d3107 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.096876:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aae00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835246.096880:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7a933dc/0xdf60171e5a5d3107 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.096888:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a7a933dc/0xdf60171e5a5d3107 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.096901:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a7a933dc/0xdf60171e5a5d3107 lrc: 1/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.096914:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a7a933dc/0xdf60171e5a5d3107 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.096929:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.096931:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.096933:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788835246.097247:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788835246.097254:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1fe9368/0xdf60171e5a5d310e lrc: 3/0,1 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.097262:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1788835246.097265:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835246.097269:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e1fe9368/0xdf60171e5a5d310e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.097279:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e1fe9368/0xdf60171e5a5d310e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.097286:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e1fe9368/0xdf60171e5a5d310e lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.097305:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e1fe9368/0xdf60171e5a5d310e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.097336:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1788835246.097363:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1788835246.097370:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e1fe9368/0xdf60171e5a5d310e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.097378:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884ab200 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:1.0:1788835246.097382:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1fe9368/0xdf60171e5a5d310e lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.097392:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e1fe9368/0xdf60171e5a5d310e lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.097404:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e1fe9368/0xdf60171e5a5d310e lrc: 1/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.097411:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e1fe9368/0xdf60171e5a5d310e lrc: 0/0,0 mode: --/PW res: [0x280000401:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.097438:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835246.097440:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835246.097442:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788835246.098929:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788835246.098940:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088d95542/0xdf60171e5a5d3115 lrc: 3/0,1 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.098953:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1788835246.098957:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835246.098963:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000088d95542/0xdf60171e5a5d3115 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.098974:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000088d95542/0xdf60171e5a5d3115 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.098983:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000088d95542/0xdf60171e5a5d3115 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.098990:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000088d95542/0xdf60171e5a5d3115 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.099167:0:19542:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835246.099174:0:19542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000088d95542/0xdf60171e5a5d3115 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.099182:0:19542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884abc00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835246.099187:0:19542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000088d95542/0xdf60171e5a5d3115 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.099195:0:19542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000088d95542/0xdf60171e5a5d3115 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.099211:0:19542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000088d95542/0xdf60171e5a5d3115 lrc: 2/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.099219:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.099221:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.099222:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835246.099861:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1788835246.099870:0:18568:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000088d95542/0xdf60171e5a5d3115 lrc: 0/0,0 mode: --/PW res: [0x280000401:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788835246.101130:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788835246.101208:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0261293/0xdf60171e5a5d311c lrc: 3/0,1 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.101221:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1788835246.101226:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835246.101231:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d0261293/0xdf60171e5a5d311c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.101242:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d0261293/0xdf60171e5a5d311c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.101251:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d0261293/0xdf60171e5a5d311c lrc: 3/0,1 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.101258:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d0261293/0xdf60171e5a5d311c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.101365:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788835246.101619:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835246.101627:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d0261293/0xdf60171e5a5d311c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.101647:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884ab000 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835246.101652:0:17048:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0261293/0xdf60171e5a5d311c lrc: 2/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.101672:0:17048:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d0261293/0xdf60171e5a5d311c lrc: 3/0,0 mode: PW/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.101689:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d0261293/0xdf60171e5a5d311c lrc: 1/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.101696:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0261293/0xdf60171e5a5d311c lrc: 0/0,0 mode: --/PW res: [0x280000401:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835246.101937:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835246.101940:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835246.101943:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788835246.102016:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788835246.102023:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f43a724e/0xdf60171e5a5d3123 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.102032:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1788835246.102036:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835246.102047:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f43a724e/0xdf60171e5a5d3123 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.102058:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f43a724e/0xdf60171e5a5d3123 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.102066:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f43a724e/0xdf60171e5a5d3123 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.102082:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f43a724e/0xdf60171e5a5d3123 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.102109:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788835246.102387:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835246.102394:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f43a724e/0xdf60171e5a5d3123 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.102403:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884ab800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835246.102407:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f43a724e/0xdf60171e5a5d3123 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.102415:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f43a724e/0xdf60171e5a5d3123 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.102428:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f43a724e/0xdf60171e5a5d3123 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.102444:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f43a724e/0xdf60171e5a5d3123 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1788835246.102810:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788835246.102817:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012ebc248/0xdf60171e5a5d312a lrc: 3/0,1 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.102826:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1788835246.102830:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835246.102835:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000012ebc248/0xdf60171e5a5d312a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.102845:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000012ebc248/0xdf60171e5a5d312a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.102853:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000012ebc248/0xdf60171e5a5d312a lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.102871:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000012ebc248/0xdf60171e5a5d312a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.102892:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1788835246.103030:0:19542:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835246.103036:0:19542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000012ebc248/0xdf60171e5a5d312a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.103044:0:19542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884aaa00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835246.103047:0:19542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000012ebc248/0xdf60171e5a5d312a lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.103056:0:19542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000012ebc248/0xdf60171e5a5d312a lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.103068:0:19542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000012ebc248/0xdf60171e5a5d312a lrc: 1/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.103084:0:19542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000012ebc248/0xdf60171e5a5d312a lrc: 0/0,0 mode: --/PW res: [0x280000401:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.103098:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.103100:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.103101:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788835246.103553:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788835246.103559:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e82e6ae/0xdf60171e5a5d3131 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.103567:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1788835246.103570:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835246.103574:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e82e6ae/0xdf60171e5a5d3131 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.103583:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e82e6ae/0xdf60171e5a5d3131 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.103591:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e82e6ae/0xdf60171e5a5d3131 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.103597:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e82e6ae/0xdf60171e5a5d3131 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.103619:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1788835246.103790:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835246.103795:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e82e6ae/0xdf60171e5a5d3131 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.103808:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204a400 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:2.0:1788835246.103812:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e82e6ae/0xdf60171e5a5d3131 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.103820:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e82e6ae/0xdf60171e5a5d3131 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.103822:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.103833:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e82e6ae/0xdf60171e5a5d3131 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.103853:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e82e6ae/0xdf60171e5a5d3131 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835246.103868:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.103869:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835246.103871:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1788835246.104216:0:18568:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x0 00010000:00010000:3.0:1788835246.104223:0:18568:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000990a187a/0xdf60171e5a5d3138 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.104238:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=488s v=(0 0) 00010000:00010000:3.0:1788835246.104241:0:18568:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835246.104245:0:18568:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000990a187a/0xdf60171e5a5d3138 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.104255:0:18568:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000990a187a/0xdf60171e5a5d3138 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.104263:0:18568:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000990a187a/0xdf60171e5a5d3138 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.104270:0:18568:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000990a187a/0xdf60171e5a5d3138 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835246.104333:0:18568:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1788835246.104374:0:18568:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x280000401:5 00000100:00100000:3.0:1788835246.104467:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e817100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:17086:x1875729254117888:12345-0@lo:5:osp-pre-0-0.0 Request processed in 157309us (163299us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835246.104476:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1788835246.104549:0:19542:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835246.104554:0:19542:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000990a187a/0xdf60171e5a5d3138 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.104569:0:19542:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204be00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835246.104572:0:19542:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000990a187a/0xdf60171e5a5d3138 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.104578:0:19542:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000990a187a/0xdf60171e5a5d3138 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.104590:0:19542:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000990a187a/0xdf60171e5a5d3138 lrc: 1/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.104597:0:19542:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000990a187a/0xdf60171e5a5d3138 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 18568 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835246.104612:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.104613:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835246.104615:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835246.105179:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e814380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17086:1875729254117888:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788835246.105195:0:17086:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x280000401:0x21:0x0] from OST, last_created [0x280000401:0x21:0x0]last_used is [0x280000401:0x5:0x0] 00000100:00100000:2.0:1788835246.105243:0:17086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83f3b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17086:1875729254119040:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1788835246.105285:0:17086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835246.105595:0:17086:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8308c6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788835246.105672:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254119040 00000100:00100000:0.0:1788835246.105680:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254119040 00000100:00100000:0.0:1788835246.105731:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788835246.105752:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:17086:x1875729254119040:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1788835246.105792:0:18567:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x280000401 at 34 00000001:00080000:2.0:1788835246.120817:0:18563:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934594 is committed 00000001:00100000:2.0:1788835246.120861:0:18563:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1788835246.121569:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f3a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:17086:x1875729254119040:12345-0@lo:5:osp-pre-0-0.0 Request processed in 15825us (16279us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1788835246.121585:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1788835246.122616:0:17086:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:2.0:1788835246.122626:0:17086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83f3b100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:17086:1875729254119040:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1788835246.122642:0:17086:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x280000401:0x21:0x0]-[0x280000401:0x41:0x0] 00010000:00010000:3.0:1788835246.245688:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1788835247.270162:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835247.912951:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254119168:0@lo:13:osp-pre-0-1.0 00000100:00100000:2.0:1788835247.913160:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835247.913224:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254119168 00000100:00100000:2.0:1788835247.913231:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254119168 00000100:00100000:2.0:1788835247.913285:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1788835247.913295:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254119168:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:2.0:1788835247.913338:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788835247.913393:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f38380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254119168:12345-0@lo:13:osp-pre-0-1.0 Request processed in 99us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835247.913400:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:2.0:1788835247.913436:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788835247.913471:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83f3b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254119168:0@lo:13:osp-pre-0-1.0 00010000:00010000:0.0:1788835248.294549:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835248.938846:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254119296:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788835248.940157:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835248.941305:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254119296 00000100:00100000:3.0:1788835248.941348:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254119296 00000100:00100000:3.0:1788835248.941405:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1788835248.941429:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254119296:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788835248.941469:0:17801:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788835248.941528:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254119296:12345-0@lo:41:osp-pre-1-0.0 Request processed in 102us (1375us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835248.941535:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788835248.946523:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254119296:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835248.954144:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254119424:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788835248.954217:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835248.954271:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254119424 00000100:00100000:3.0:1788835248.954279:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254119424 00000100:00100000:3.0:1788835248.954335:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788835248.954343:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254119424:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788835248.954378:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 0 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788835248.954451:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254119424:12345-0@lo:41:osp-pre-0-1.0 Request processed in 109us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835248.954459:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1788835248.954502:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254119424:0@lo:41:osp-pre-0-1.0 00010000:00010000:1.0:1788835249.319613:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788835250.171776:0:19742:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg322-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1788835250.346561:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835250.981501:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254119552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788835250.982749:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835250.982827:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254119552 00000100:00100000:2.0:1788835250.982833:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254119552 00000100:00100000:2.0:1788835250.982878:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1788835250.982888:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254119552:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:2.0:1788835250.982916:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788835250.982976:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f3b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254119552:12345-0@lo:13:osp-pre-1-1.0 Request processed in 90us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835250.982983:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1788835250.983013:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1788835250.983059:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254119552:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788835250.983429:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254119680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788835250.983459:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835250.983542:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254119936:0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.984724:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835250.984777:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254120448:0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.984806:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835250.984824:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254120960:0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.984844:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835250.984882:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [1->0] 00000100:00100000:1.0:1788835250.984888:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254120064:0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.984910:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835250.984923:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254120576:0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.984939:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835250.984952:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875729254121088:0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.984988:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835250.985017:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb888812-a79c-4531-9a69-89c757e37463:3617:1875729254119808:0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.985058:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835250.985080:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254120320:0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.985099:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835250.985113:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254120832:0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.985129:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835250.985157:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254119936 00000100:00100000:1.0:1788835250.985162:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254119936 00000100:00100000:1.0:1788835250.985196:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254120448 00000100:00100000:1.0:1788835250.985198:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254120448 00000100:00100000:1.0:1788835250.985211:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788835250.985218:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254119936:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.985264:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254119936:12345-0@lo:400:kworker.0 Request processed in 45us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835250.985271:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1788835250.985286:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788835250.985291:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254120448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.985329:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83108e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254120448:12345-0@lo:400:kworker.0 Request processed in 22us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835250.985335:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1788835250.985353:0:18569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254120064 00000100:00100000:1.0:1788835250.985356:0:18569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254120064 00000100:00100000:1.0:1788835250.985383:0:18569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254120576 00000100:00100000:1.0:1788835250.985386:0:18569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254120576 00000100:00100000:1.0:1788835250.985401:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788835250.985407:0:18569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254120064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.985442:0:18569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83109180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254120064:12345-0@lo:400:kworker.0 Request processed in 35us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835250.985448:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1788835250.985457:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788835250.985463:0:18569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254120576:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.985483:0:18569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254120576:12345-0@lo:400:kworker.0 Request processed in 20us (542us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835250.985487:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1788835250.985503:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254120960 00000100:00100000:1.0:1788835250.985506:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254120960 00000100:00100000:1.0:1788835250.985521:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254121088 00000100:00100000:1.0:1788835250.985523:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254121088 00000100:00100000:1.0:1788835250.985532:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254120320 00000100:00100000:1.0:1788835250.985534:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254120320 00000100:00100000:1.0:1788835250.985542:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254120832 00000100:00100000:1.0:1788835250.985544:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254120832 00000100:00100000:1.0:1788835250.985555:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788835250.985560:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254120960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.985585:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254120960:12345-0@lo:400:kworker.0 Request processed in 24us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835250.985591:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788835250.985600:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788835250.985604:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875729254121088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.985624:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875729254121088:12345-0@lo:400:kworker.0 Request processed in 19us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835250.985630:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1788835250.985638:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788835250.985650:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254120320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.985676:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254120320:12345-0@lo:400:kworker.0 Request processed in 27us (577us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835250.985681:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1788835250.985690:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788835250.985695:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254120832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.985714:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83108000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254120832:12345-0@lo:400:kworker.0 Request processed in 19us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835250.985720:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1788835250.985733:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254119808 00000100:00100000:1.0:1788835250.985736:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254119808 00000100:00100000:1.0:1788835250.985755:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1788835250.985761:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+24:3617:x1875729254119808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.985785:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cdac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+24:3617:x1875729254119808:12345-0@lo:400:kworker.0 Request processed in 24us (727us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835250.985790:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1788835250.985843:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1788835250.985847:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:1.0:1788835250.985850:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788835250.985868:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:cb888812-a79c-4531-9a69-89c757e37463:3617:1875729254119808:0@lo:400:kworker.0 00010000:00080000:1.0:1788835250.985880:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83ed3480 x1875729254120320/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835250.985891:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254120320:0@lo:400:kworker.0 00010000:00080000:1.0:1788835250.985899:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83ed2300 x1875729254120832/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835250.985919:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254120832:0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.985946:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254120064:0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.985954:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254120576:0@lo:400:kworker.0 00010000:00080000:1.0:1788835250.985962:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa2c700 x1875729254121088/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835250.985970:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875729254121088:0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.985979:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254119936:0@lo:400:kworker.0 00000100:00100000:1.0:1788835250.985986:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254120448:0@lo:400:kworker.0 00010000:00080000:1.0:1788835250.985994:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa2ca80 x1875729254120960/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835250.986002:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254120960:0@lo:400:kworker.0 00000100:00100000:2.0:1788835250.986280:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254120192:0@lo:400:kworker.0 00000100:00100000:2.0:1788835250.986304:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835250.986337:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729254120704:0@lo:400:kworker.0 00000100:00100000:2.0:1788835250.986355:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835250.986369:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254121216:0@lo:400:kworker.0 00000100:00100000:2.0:1788835250.986386:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835250.986417:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254120704 00000100:00100000:2.0:1788835250.986421:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254120704 00000100:00100000:2.0:1788835250.986441:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254121216 00000100:00100000:2.0:1788835250.986443:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254121216 00000100:00100000:2.0:1788835250.986459:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788835250.986464:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729254120704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835250.986494:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729254120704:12345-0@lo:400:kworker.0 Request processed in 29us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835250.986500:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1788835250.986521:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788835250.986526:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254121216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835250.986546:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254121216:12345-0@lo:400:kworker.0 Request processed in 20us (159us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835250.986551:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1788835250.986566:0:19538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254120192 00000100:00100000:2.0:1788835250.986568:0:19538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254120192 00000100:00100000:2.0:1788835250.986586:0:19538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1788835250.986592:0:19538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3616:x1875729254120192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835250.986615:0:19538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f3b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3616:x1875729254120192:12345-0@lo:400:kworker.0 Request processed in 24us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835250.986620:0:19538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1788835250.986636:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788835250.986638:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788835250.986657:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254120192:0@lo:400:kworker.0 00010000:00080000:2.0:1788835250.986666:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83ed1880 x1875729254120704/t0(0) o400->lustre-MDT0000-lwp-MDT0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835250.986674:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729254120704:0@lo:400:kworker.0 00010000:00080000:2.0:1788835250.986691:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfa2f800 x1875729254121216/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835266 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835250.986698:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254121216:0@lo:400:kworker.0 00000100:00100000:2.0:1788835250.988190:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254121344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788835250.988241:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835251.004790:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254119680 00000100:00100000:0.0:1788835251.004804:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254119680 00000100:00100000:2.0:1788835251.006434:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254121344 00000100:00100000:2.0:1788835251.006560:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254121344 00000100:00100000:2.0:1788835251.006766:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788835251.006779:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254121344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788835251.006812:0:18570:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788835251.006887:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f38000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254121344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (18644us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835251.006895:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1788835251.008735:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83f3b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254121344:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788835251.010014:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1788835251.010025:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1875729254119680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788835251.010059:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 278208 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788835251.010310:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3616:x1875729254119680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 286us (26848us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835251.010336:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788835251.010482:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254119680:0@lo:13:osp-pre-1-0.0 00000020:00000004:2.0:1788835251.190388:0:19794:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:2.0:1788835251.192827:0:19794:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00010000:00010000:0.0:1788835251.366396:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788835251.881064:0:17095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00080000:0.0:1788835252.013945:0:19384:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00010000:00010000:2.0:1788835252.394107:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000004:1.0:1788835252.523030:0:19844:0:(tgt_mount.c:2347:server_getattr()) lustre-OST0001: root_inode from vfsmnt ino=2, dev=0 00000020:00000004:1.0:1788835252.524839:0:19844:0:(tgt_mount.c:2362:is_cmd_supported()) ioctl cmd=81009431 00000100:00100000:1.0:1788835252.771541:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835252.771578:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242507776 00000100:00100000:1.0:1788835252.771587:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242507776 00000100:00100000:1.0:1788835252.771634:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:1.0:1788835252.771643:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2384:x1875729242507776:12345-192.168.203.22@tcp:250:mount.lustre.0 00010000:00080000:1.0:1788835252.771669:0:17054:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 30278e9d-0337-40e4-817b-5d5e80a2a1f2@192.168.203.22@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:1.0:1788835252.771692:0:17054:0:(genops.c:1385:class_connect()) connect: client 30278e9d-0337-40e4-817b-5d5e80a2a1f2, cookie 0xdf60171e5a5d313f 00000100:00080000:1.0:1788835252.771827:0:17054:0:(import.c:65:import_set_state_nolock()) ffff9afdbd9eb000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788835252.771889:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+5:2384:x1875729242507776:12345-192.168.203.22@tcp:250:mount.lustre.0 Request processed in 245us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835252.771897:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 114 00000100:00100000:1.0:1788835252.795010:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835252.795101:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242507904 00000100:00100000:2.0:1788835252.795111:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242507904 00000100:00100000:2.0:1788835252.795165:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 115 00000100:00100000:2.0:1788835252.795174:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+5:14856:x1875729242507904:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:2.0:1788835252.795190:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835252.795207:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd80031200/0xdf60171e5a5d3146 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae08ab expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835252.795235:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd80031200/0xdf60171e5a5d3146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae08ab expref: 6 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835252.795263:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd80031200/0xdf60171e5a5d3146 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae08ab expref: 6 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835252.795272:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd80031200, rc 0) 00000100:00100000:2.0:1788835252.795352:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cdb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+6:14856:x1875729242507904:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 179us (350us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835252.795359:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 115 00000100:00100000:0.0:1788835252.797559:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835252.797630:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242508032 00000100:00100000:1.0:1788835252.797639:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242508032 00000100:00100000:1.0:1788835252.797687:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 116 00000100:00100000:1.0:1788835252.797696:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+6:14856:x1875729242508032:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788835252.797806:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cda850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+6:14856:x1875729242508032:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 110us (254us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788835252.797814:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 116 00000100:00100000:3.0:1788835252.800146:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835252.800226:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242508160 00000100:00100000:1.0:1788835252.800235:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242508160 00000100:00100000:1.0:1788835252.800295:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:1.0:1788835252.800306:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+6:14856:x1875729242508160:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788835252.800351:0:17054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835252.800367:0:17054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e61400/0xdf60171e5a5d314d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae08b2 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835252.800396:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e61400/0xdf60171e5a5d314d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae08b2 expref: 7 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835252.800425:0:17054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e61400/0xdf60171e5a5d314d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae08b2 expref: 7 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835252.800435:0:17054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61400, rc 0) 00000100:00100000:1.0:1788835252.800482:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cda050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+7:14856:x1875729242508160:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 178us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835252.800489:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 117 00000100:00100000:0.0:1788835252.811655:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835252.811744:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242508288 00000100:00100000:2.0:1788835252.811754:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242508288 00000100:00100000:2.0:1788835252.811813:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:2.0:1788835252.811823:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+7:14856:x1875729242508288:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:2.0:1788835252.812105:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+8:14856:x1875729242508288:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 161us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835252.812114:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 118 00000100:00100000:0.0:1788835252.816713:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835252.816804:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242508416 00000100:00100000:1.0:1788835252.816814:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242508416 00000100:00100000:1.0:1788835252.816873:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 119 00000100:00100000:1.0:1788835252.816883:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+8:14856:x1875729242508416:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788835252.817073:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cdb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+8:14856:x1875729242508416:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 191us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835252.817082:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 119 00000100:00100000:3.0:1788835252.823692:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835252.824099:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242508544 00000100:00100000:2.0:1788835252.824109:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242508544 00000100:00100000:2.0:1788835252.824168:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 120 00000100:00100000:2.0:1788835252.824178:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+8:14874:x1875729242508544:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788835252.824368:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cdb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+8:14874:x1875729242508544:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 191us (684us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835252.824376:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 120 00000100:00100000:0.0:1788835252.852393:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835252.852480:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242508672 00000100:00100000:2.0:1788835252.852490:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242508672 00000100:00100000:2.0:1788835252.852532:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:2.0:1788835252.852540:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+8:14874:x1875729242508672:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788835252.852682:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cda450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+8:14874:x1875729242508672:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 141us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835252.852690:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 121 00000100:00100000:0.0:1788835252.856462:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835252.856729:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242508800 00000100:00100000:1.0:1788835252.856738:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242508800 00000100:00100000:1.0:1788835252.856787:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:1.0:1788835252.856796:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+8:14874:x1875729242508800:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788835252.856936:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83cd8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+8:14874:x1875729242508800:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 141us (482us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835252.856950:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 122 00000100:00100000:3.0:1788835252.862175:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835252.862458:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242508928 00000100:00100000:1.0:1788835252.862468:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242508928 00000100:00100000:1.0:1788835252.862522:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00100000:1.0:1788835252.862533:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbc360050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+8:14856:x1875729242508928:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788835252.862562:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835252.862579:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e61000/0xdf60171e5a5d3154 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae08e3 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835252.862605:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e61000/0xdf60171e5a5d3154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae08e3 expref: 9 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835252.862616:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e61000/0xdf60171e5a5d3154 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae08e3 expref: 9 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835252.862624:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61000, rc 0) 00000100:00100000:1.0:1788835252.862794:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbc360050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+9:14856:x1875729242508928:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 262us (627us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835252.862802:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 123 00000100:00100000:2.0:1788835252.872198:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835252.873576:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242509056 00000100:00100000:1.0:1788835252.873589:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242509056 00000100:00100000:1.0:1788835252.873698:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 124 00000100:00100000:1.0:1788835252.873708:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbc363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+9:14856:x1875729242509056:12345-192.168.203.22@tcp:256:mount.lustre.0 20000000:01000000:1.0:1788835252.873735:0:17055:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1788835252.873759:0:17055:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1788835252.873763:0:17055:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1788835252.873767:0:17055:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1788835252.873769:0:17055:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:1.0:1788835252.873771:0:17055:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:1.0:1788835252.877657:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbc363850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+9:14856:x1875729242509056:12345-192.168.203.22@tcp:256:mount.lustre.0 Request processed in 3941us (5458us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835252.877682:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 124 00000100:00100000:2.0:1788835252.885368:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835252.885520:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242509184 00000100:00100000:1.0:1788835252.885542:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242509184 00000100:00100000:1.0:1788835252.885590:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 125 00000100:00100000:1.0:1788835252.885599:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbc363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+9:14856:x1875729242509184:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788835252.885615:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835252.885632:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d315b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae08ea expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835252.885658:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d315b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae08ea expref: 10 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835252.885681:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d315b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae08ea expref: 10 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835252.885690:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60200, rc 0) 00000100:00100000:1.0:1788835252.885740:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbc363450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+10:14856:x1875729242509184:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 142us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835252.885746:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 125 00000100:00100000:1.0:1788835252.887872:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835252.887964:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242509312 00000100:00100000:3.0:1788835252.887973:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242509312 00000100:00100000:3.0:1788835252.888037:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 126 00000100:00100000:3.0:1788835252.888047:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbc363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+10:14856:x1875729242509312:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788835252.888193:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbc363c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+10:14856:x1875729242509312:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 147us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835252.888201:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 126 00000100:00100000:3.0:1788835252.891126:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835252.891567:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242509440 00000100:00100000:1.0:1788835252.891575:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242509440 00000100:00100000:1.0:1788835252.891630:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 127 00000100:00100000:1.0:1788835252.891639:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbc360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+10:14856:x1875729242509440:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:1.0:1788835252.891796:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbc360850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+10:14856:x1875729242509440:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 157us (678us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835252.891805:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 127 00000100:00100000:1.0:1788835252.894530:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835252.894698:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242509568 00000100:00100000:2.0:1788835252.894705:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242509568 00000100:00100000:2.0:1788835252.894756:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 128 00000100:00100000:2.0:1788835252.894764:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8304b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+10:14879:x1875729242509568:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:2.0:1788835252.894898:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8304b050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+10:14879:x1875729242509568:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 134us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835252.894905:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 128 00000100:00100000:2.0:1788835252.906232:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835252.906349:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242509696 00000100:00100000:3.0:1788835252.906359:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242509696 00000100:00100000:3.0:1788835252.906411:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 129 00000100:00100000:3.0:1788835252.906421:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+10:14879:x1875729242509696:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788835252.906566:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83048050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+10:14879:x1875729242509696:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 146us (342us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835252.906575:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 129 00000100:00100000:3.0:1788835252.914105:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835252.914187:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835252.914439:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242509824 00000100:00100000:2.0:1788835252.914448:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242509824 00000100:00100000:2.0:1788835252.914489:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242510080 00000100:00100000:2.0:1788835252.914492:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242510080 00000100:00100000:2.0:1788835252.914520:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:2.0:1788835252.914528:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2384:x1875729242509824:12345-192.168.203.22@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788835252.914556:0:17062:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 509130d2-ab52-48a7-b813-2f954b790e9f@192.168.203.22@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:2.0:1788835252.914604:0:17062:0:(genops.c:1385:class_connect()) connect: client 509130d2-ab52-48a7-b813-2f954b790e9f, cookie 0xdf60171e5a5d3162 00000004:00100000:2.0:1788835252.914628:0:17062:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788835252.914813:0:17062:0:(import.c:65:import_set_state_nolock()) ffff9afdbb3a7000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788835252.914880:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+6:2384:x1875729242509824:12345-192.168.203.22@tcp:38:mount.lustre.0 Request processed in 351us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835252.914904:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:2.0:1788835252.914937:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:2.0:1788835252.914943:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2384:x1875729242510080:12345-192.168.203.22@tcp:38:mount.lustre.0 00010000:00080000:2.0:1788835252.914958:0:17062:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 509130d2-ab52-48a7-b813-2f954b790e9f@192.168.203.22@tcp t0 exp 0000000000000000 cur 494 last 0 00000020:00000080:2.0:1788835252.915104:0:17062:0:(genops.c:1385:class_connect()) connect: client 509130d2-ab52-48a7-b813-2f954b790e9f, cookie 0xdf60171e5a5d3169 00000004:00100000:2.0:1788835252.915117:0:17062:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:2.0:1788835252.915297:0:17062:0:(import.c:65:import_set_state_nolock()) ffff9afdbb3a2800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788835252.915663:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+6:2384:x1875729242510080:12345-192.168.203.22@tcp:38:mount.lustre.0 Request processed in 717us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835252.915670:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:1.0:1788835252.923636:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835252.923774:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835252.925379:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242510336 00000100:00100000:2.0:1788835252.925392:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242510336 00000100:00100000:2.0:1788835252.925475:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242509952 00000100:00100000:2.0:1788835252.925479:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242509952 00000100:00100000:2.0:1788835252.925504:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1788835252.925513:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+7:14856:x1875729242510336:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788835252.925550:0:17061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788835252.925636:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83109c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+7:14856:x1875729242510336:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 124us (2011us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835252.925644:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1788835252.925675:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:2.0:1788835252.925683:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+6:0:x1875729242509952:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788835252.925695:0:17061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:2.0:1788835252.925718:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+6:0:x1875729242509952:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 36us (1945us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835252.925736:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00080000:1.0:1788835252.927016:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788835252.936864:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835252.937298:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835252.937491:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242510208 00000100:00100000:2.0:1788835252.937501:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242510208 00000100:00100000:2.0:1788835252.937572:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242510464 00000100:00100000:2.0:1788835252.937575:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242510464 00000100:00100000:2.0:1788835252.937599:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:2.0:1788835252.937607:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+6:0:x1875729242510208:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:2.0:1788835252.937640:0:17061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:2.0:1788835252.937721:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8310b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+6:0:x1875729242510208:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 114us (867us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835252.937729:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:2.0:1788835252.937760:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:2.0:1788835252.937768:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+6:14856:x1875729242510464:12345-192.168.203.22@tcp:40:mount.lustre.0 00000100:00100000:2.0:1788835252.937798:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83108700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+6:14856:x1875729242510464:12345-192.168.203.22@tcp:40:mount.lustre.0 Request processed in 31us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835252.937804:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00080000:1.0:1788835252.938527:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788835252.964500:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835252.964537:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835252.964566:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835252.964641:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242510592 00000100:00100000:3.0:1788835252.964649:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242510592 00000100:00100000:3.0:1788835252.964682:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242510720 00000100:00100000:3.0:1788835252.964685:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242510720 00000100:00100000:3.0:1788835252.964701:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:3.0:1788835252.964708:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2384:x1875729242510592:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788835252.964738:0:19151:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 509130d2-ab52-48a7-b813-2f954b790e9f@192.168.203.22@tcp t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:3.0:1788835252.964765:0:19151:0:(genops.c:1385:class_connect()) connect: client 509130d2-ab52-48a7-b813-2f954b790e9f, cookie 0xdf60171e5a5d3170 00002000:00100000:3.0:1788835252.964775:0:19151:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 509130d2-ab52-48a7-b813-2f954b790e9f/ffff9afc835eb000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788835252.964790:0:19151:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1788835252.964934:0:19151:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1788835252.964982:0:19151:0:(import.c:65:import_set_state_nolock()) ffff9afc835ea800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1788835252.965065:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f3a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:509130d2-ab52-48a7-b813-2f954b790e9f+6:2384:x1875729242510592:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 355us (526us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835252.965073:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:3.0:1788835252.965089:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:3.0:1788835252.965094:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2384:x1875729242510720:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:3.0:1788835252.965109:0:19151:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 509130d2-ab52-48a7-b813-2f954b790e9f@192.168.203.22@tcp t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:3.0:1788835252.965123:0:19151:0:(genops.c:1385:class_connect()) connect: client 509130d2-ab52-48a7-b813-2f954b790e9f, cookie 0xdf60171e5a5d3177 00002000:00100000:3.0:1788835252.965130:0:19151:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 509130d2-ab52-48a7-b813-2f954b790e9f/ffff9afc835ec000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1788835252.965141:0:19151:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:1.0:1788835252.967161:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242510848 00000100:00100000:1.0:1788835252.967173:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242510848 00000100:00100000:1.0:1788835252.967238:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:1.0:1788835252.967258:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:509130d2-ab52-48a7-b813-2f954b790e9f+6:14856:x1875729242510848:12345-192.168.203.22@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788835252.967362:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:509130d2-ab52-48a7-b813-2f954b790e9f+6:14856:x1875729242510848:12345-192.168.203.22@tcp:900:mount.lustre.0 Request processed in 105us (2869us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835252.967369:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00002000:00080000:1.0:1788835252.969399:0:19151:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1788835252.969443:0:19151:0:(import.c:65:import_set_state_nolock()) ffff9afdbd9e9000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1788835252.969513:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f38700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:509130d2-ab52-48a7-b813-2f954b790e9f+6:2384:x1875729242510720:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 4413us (4941us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835252.969523:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:2.0:1788835252.971861:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835252.972122:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242510976 00000100:00100000:3.0:1788835252.972133:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242510976 00000100:00100000:3.0:1788835252.972184:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:3.0:1788835252.972194:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:509130d2-ab52-48a7-b813-2f954b790e9f+6:14856:x1875729242510976:12345-192.168.203.22@tcp:33:mount.lustre.0 00000004:00080000:3.0:1788835252.975653:0:17063:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3366us 00000004:00200000:3.0:1788835252.991209:0:17063:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:3.0:1788835252.991371:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:509130d2-ab52-48a7-b813-2f954b790e9f+6:14856:x1875729242510976:12345-192.168.203.22@tcp:33:mount.lustre.0 Request processed in 19173us (19513us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835252.991381:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:1.0:1788835253.029740:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254121472:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835253.029806:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835253.029913:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254121472 00000100:00100000:3.0:1788835253.029920:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254121472 00000100:00100000:3.0:1788835253.029994:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788835253.030004:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254121472:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788835253.030025:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788835253.030083:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83108380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254121472:12345-0@lo:13:osp-pre-0-1.0 Request processed in 81us (276us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835253.030113:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1788835253.030156:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254121472:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788835253.030402:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788835253.187013:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835253.187281:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242511104 00000100:00100000:0.0:1788835253.187291:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242511104 00000100:00100000:0.0:1788835253.187385:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:0.0:1788835253.187394:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+6:14901:x1875729242511104:12345-192.168.203.22@tcp:101:mkdir.0 00010000:00010000:0.0:1788835253.187412:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835253.187436:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668000/0xdf60171e5a5d317e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae091b expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835253.187497:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668800/0xdf60171e5a5d3185 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835253.187512:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668800/0xdf60171e5a5d3185 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835253.187525:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668800/0xdf60171e5a5d3185 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788835253.187571:0:17061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:0.0:1788835253.187575:0:17061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788835253.187607:0:17061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668800/0xdf60171e5a5d3185 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835253.187630:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668000/0xdf60171e5a5d317e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae091b expref: 8 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835253.187669:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668800/0xdf60171e5a5d3185 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae091b expref: 7 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835253.187678:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc835cf000) 00010000:00010000:0.0:1788835253.187681:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1788835253.187685:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd81668800, rc 0) 00000100:00100000:0.0:1788835253.187743:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82074000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+7:14901:x1875729242511104:12345-192.168.203.22@tcp:101:mkdir.0 Request processed in 351us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835253.187751:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00010000:00010000:1.0:1788835253.415829:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835254.053538:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1788835254.053561:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254121600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788835254.053612:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254121728:0@lo:41:osp-pre-1-0.0 00000100:00100000:1.0:1788835254.053630:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835254.053668:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835254.053701:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254121600 00000100:00100000:1.0:1788835254.053709:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254121600 00000100:00100000:1.0:1788835254.053757:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254121728 00000100:00100000:1.0:1788835254.053760:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254121728 00000100:00100000:1.0:1788835254.053794:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788835254.053802:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254121600:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788835254.053832:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788835254.053899:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83109f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254121600:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (260us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835254.053908:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1788835254.053923:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788835254.053930:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254121728:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788835254.053974:0:17065:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788835254.054005:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254121728:12345-0@lo:41:osp-pre-1-0.0 Request processed in 75us (336us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835254.054011:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1788835254.054211:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254121600:0@lo:41:osp-pre-0-1.0 00000100:00100000:0.0:1788835254.054296:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254121728:0@lo:41:osp-pre-1-0.0 00010000:00010000:0.0:1788835254.440125:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1788835254.886029:0:17814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1788835255.368305:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835255.368660:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242511232 00000100:00100000:0.0:1788835255.368674:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242511232 00000100:00100000:0.0:1788835255.369069:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:0.0:1788835255.369084:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+7:14954:x1875729242511232:12345-192.168.203.22@tcp:41:lfs.0 00000004:00000024:0.0:1788835255.369147:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788835255.369264:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82076680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+7:14954:x1875729242511232:12345-192.168.203.22@tcp:41:lfs.0 Request processed in 184us (973us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835255.369273:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00080000:1.0:1788835255.369737:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788835255.382951:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835255.383650:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242511360 00000100:00100000:0.0:1788835255.383664:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242511360 00000100:00100000:0.0:1788835255.383901:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:0.0:1788835255.383914:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+6:14954:x1875729242511360:12345-192.168.203.22@tcp:41:lfs.0 00000004:00000024:0.0:1788835255.383982:0:17061:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2146304 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788835255.384118:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+6:14954:x1875729242511360:12345-192.168.203.22@tcp:41:lfs.0 Request processed in 206us (1647us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835255.384127:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00080000:1.0:1788835255.386933:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788835255.390684:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835255.390913:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242511488 00000100:00100000:3.0:1788835255.390926:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242511488 00000100:00100000:3.0:1788835255.391036:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:3.0:1788835255.391049:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:509130d2-ab52-48a7-b813-2f954b790e9f+6:14954:x1875729242511488:12345-192.168.203.22@tcp:13:lfs.0 00002000:00000024:3.0:1788835255.391093:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788835255.391210:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82077480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:509130d2-ab52-48a7-b813-2f954b790e9f+6:14954:x1875729242511488:12345-192.168.203.22@tcp:13:lfs.0 Request processed in 162us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835255.391219:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00080000:1.0:1788835255.392566:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788835255.396088:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835255.396395:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242511616 00000100:00100000:1.0:1788835255.396410:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242511616 00000100:00100000:1.0:1788835255.396577:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:1.0:1788835255.396591:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:509130d2-ab52-48a7-b813-2f954b790e9f+6:14954:x1875729242511616:12345-192.168.203.22@tcp:13:lfs.0 00002000:00000024:1.0:1788835255.396640:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 8715968 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788835255.396763:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:509130d2-ab52-48a7-b813-2f954b790e9f+6:14954:x1875729242511616:12345-192.168.203.22@tcp:13:lfs.0 Request processed in 175us (698us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835255.396772:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00080000:2.0:1788835255.396836:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1788835255.463990:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835255.646294:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835255.646618:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242511744 00000100:00100000:1.0:1788835255.646631:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242511744 00000100:00100000:1.0:1788835255.646704:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 130 00000100:00100000:1.0:1788835255.646716:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+10:14985:x1875729242511744:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788835255.646873:0:17054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835255.646898:0:17054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e61600/0xdf60171e5a5d318c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0922 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835255.646937:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e61600/0xdf60171e5a5d318c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0922 expref: 11 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835255.646949:0:17054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e61600/0xdf60171e5a5d318c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0922 expref: 11 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835255.646959:0:17054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61600, rc 0) 00000100:00100000:1.0:1788835255.647050:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83049850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+11:14985:x1875729242511744:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 336us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835255.647058:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 130 00000100:00100000:2.0:1788835255.656972:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835255.658086:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242511872 00000100:00100000:1.0:1788835255.658103:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242511872 00000100:00100000:1.0:1788835255.658185:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 131 00000100:00100000:1.0:1788835255.658199:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8304a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+11:14985:x1875729242511872:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:1.0:1788835255.658474:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8304a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+11:14985:x1875729242511872:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 278us (1517us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835255.658485:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 131 00000100:00100000:2.0:1788835255.674085:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835255.674393:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242512000 00000100:00100000:3.0:1788835255.674404:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242512000 00000100:00100000:3.0:1788835255.674459:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 132 00000100:00100000:3.0:1788835255.674469:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+11:14985:x1875729242512000:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788835255.674637:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83049450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+11:14985:x1875729242512000:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 166us (568us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835255.674645:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 132 00000100:00100000:2.0:1788835255.733415:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835255.733968:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242512128 00000100:00100000:1.0:1788835255.733979:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242512128 00000100:00100000:1.0:1788835255.734046:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 133 00000100:00100000:1.0:1788835255.734057:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+11:14994:x1875729242512128:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788835255.734221:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83049c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+11:14994:x1875729242512128:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 165us (813us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835255.734237:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 133 00000100:00100000:2.0:1788835255.775995:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835255.776977:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242512256 00000100:00100000:3.0:1788835255.776990:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242512256 00000100:00100000:3.0:1788835255.777077:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 134 00000100:00100000:3.0:1788835255.777088:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8304b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+11:14994:x1875729242512256:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788835255.777252:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8304b850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+11:14994:x1875729242512256:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 165us (1268us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835255.777269:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 134 00000100:00100000:2.0:1788835255.783282:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835255.783979:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242512384 00000100:00100000:3.0:1788835255.783990:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242512384 00000100:00100000:3.0:1788835255.784067:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 135 00000100:00100000:3.0:1788835255.784090:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+11:14994:x1875729242512384:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788835255.784257:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+11:14994:x1875729242512384:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 170us (982us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835255.784267:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 135 00000100:00100000:2.0:1788835255.801380:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835255.801472:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242512512 00000100:00100000:3.0:1788835255.801484:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242512512 00000100:00100000:3.0:1788835255.801544:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 136 00000100:00100000:3.0:1788835255.801555:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+11:14985:x1875729242512512:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:3.0:1788835255.801571:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835255.801598:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdc204aa00/0xdf60171e5a5d3193 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0953 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835255.801629:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdc204aa00/0xdf60171e5a5d3193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0953 expref: 12 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835255.801641:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdc204aa00/0xdf60171e5a5d3193 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0953 expref: 12 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835255.801651:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204aa00, rc 0) 00000100:00100000:3.0:1788835255.801716:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+12:14985:x1875729242512512:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 163us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835255.801723:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 136 00000100:00100000:2.0:1788835255.807997:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835255.809204:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242512640 00000100:00100000:3.0:1788835255.809219:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242512640 00000100:00100000:3.0:1788835255.809286:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 137 00000100:00100000:3.0:1788835255.809341:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+12:14985:x1875729242512640:12345-192.168.203.22@tcp:256:mount.lustre.0 20000000:01000000:3.0:1788835255.809366:0:17054:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1788835255.809388:0:17054:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1788835255.809392:0:17054:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1788835255.809395:0:17054:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1788835255.809398:0:17054:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3920/1/256/255. 20000000:01000000:3.0:1788835255.809400:0:17054:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 176, version 10 00000100:00100000:3.0:1788835255.820598:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+12:14985:x1875729242512640:12345-192.168.203.22@tcp:256:mount.lustre.0 Request processed in 11292us (12598us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835255.820613:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 137 00000100:00100000:2.0:1788835255.832745:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835255.832845:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242512768 00000100:00100000:1.0:1788835255.832856:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242512768 00000100:00100000:1.0:1788835255.833445:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 138 00000100:00100000:1.0:1788835255.833457:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+12:14985:x1875729242512768:12345-192.168.203.22@tcp:101:mount.lustre.0 00010000:00010000:1.0:1788835255.833473:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835255.833493:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdb2e61800/0xdf60171e5a5d319a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae095a expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835255.833524:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdb2e61800/0xdf60171e5a5d319a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae095a expref: 13 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835255.833536:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdb2e61800/0xdf60171e5a5d319a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae095a expref: 13 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835255.833546:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61800, rc 0) 00000100:00100000:1.0:1788835255.833607:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:14985:x1875729242512768:12345-192.168.203.22@tcp:101:mount.lustre.0 Request processed in 153us (938us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835255.833614:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 138 00000100:00100000:2.0:1788835255.843121:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835255.843209:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242512896 00000100:00100000:3.0:1788835255.843220:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242512896 00000100:00100000:3.0:1788835255.843276:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 139 00000100:00100000:3.0:1788835255.843286:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:14985:x1875729242512896:12345-192.168.203.22@tcp:501:mount.lustre.0 00000100:00100000:3.0:1788835255.843457:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:14985:x1875729242512896:12345-192.168.203.22@tcp:501:mount.lustre.0 Request processed in 173us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835255.843465:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 139 00000100:00100000:2.0:1788835255.860611:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835255.860782:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242513024 00000100:00100000:3.0:1788835255.860791:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242513024 00000100:00100000:3.0:1788835255.860849:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 140 00000100:00100000:3.0:1788835255.860859:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:14985:x1875729242513024:12345-192.168.203.22@tcp:503:mount.lustre.0 00000100:00100000:3.0:1788835255.862545:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:14985:x1875729242513024:12345-192.168.203.22@tcp:503:mount.lustre.0 Request processed in 1679us (1936us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835255.862574:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 140 00000100:00100000:2.0:1788835255.866465:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835255.866557:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242513152 00000100:00100000:1.0:1788835255.866568:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242513152 00000100:00100000:1.0:1788835255.866635:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 141 00000100:00100000:1.0:1788835255.866644:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:14999:x1875729242513152:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:1.0:1788835255.866803:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:14999:x1875729242513152:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 160us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835255.866810:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 141 00000100:00100000:2.0:1788835255.869768:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835255.869852:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242513280 00000100:00100000:3.0:1788835255.869863:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242513280 00000100:00100000:3.0:1788835255.869926:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 142 00000100:00100000:3.0:1788835255.869937:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:14999:x1875729242513280:12345-192.168.203.22@tcp:502:llog_process_th.0 00000100:00100000:3.0:1788835255.870653:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:14999:x1875729242513280:12345-192.168.203.22@tcp:502:llog_process_th.0 Request processed in 714us (888us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835255.870662:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 142 00000100:00100000:2.0:1788835255.874930:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835255.875162:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835255.875881:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242513408 00000100:00100000:3.0:1788835255.875891:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242513408 00000100:00100000:0.0:1788835255.876028:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242513664 00000100:00100000:0.0:1788835255.876033:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242513664 00000100:00100000:0.0:1788835255.876070:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:0.0:1788835255.878715:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2384:x1875729242513408:12345-192.168.203.22@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788835255.878896:0:17062:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 29ff5b29-0bb6-41bb-a110-0090199a3fb2@192.168.203.22@tcp t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:0.0:1788835255.878938:0:17062:0:(genops.c:1385:class_connect()) connect: client 29ff5b29-0bb6-41bb-a110-0090199a3fb2, cookie 0xdf60171e5a5d31a1 00000004:00100000:0.0:1788835255.879031:0:17062:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788835255.879204:0:17062:0:(import.c:65:import_set_state_nolock()) ffff9afd85bd0000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788835255.879303:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82075f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:2384:x1875729242513408:12345-192.168.203.22@tcp:38:mount.lustre.0 Request processed in 609us (4381us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835255.879312:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:0.0:1788835255.879364:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:0.0:1788835255.879371:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2384:x1875729242513664:12345-192.168.203.22@tcp:38:mount.lustre.0 00010000:00080000:0.0:1788835255.879388:0:17062:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0001: connection from 29ff5b29-0bb6-41bb-a110-0090199a3fb2@192.168.203.22@tcp t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:0.0:1788835255.879411:0:17062:0:(genops.c:1385:class_connect()) connect: client 29ff5b29-0bb6-41bb-a110-0090199a3fb2, cookie 0xdf60171e5a5d31a8 00000004:00100000:0.0:1788835255.879423:0:17062:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0001: cli supports cksum type f7, return f7 00000100:00080000:0.0:1788835255.879464:0:17062:0:(import.c:65:import_set_state_nolock()) ffff9afd85bd2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1788835255.879488:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82075500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:2384:x1875729242513664:12345-192.168.203.22@tcp:38:mount.lustre.0 Request processed in 116us (4325us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835255.879495:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:2.0:1788835255.883277:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835255.883313:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835255.883378:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835255.883502:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242513792 00000100:00100000:0.0:1788835255.883512:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242513792 00000100:00100000:0.0:1788835255.883574:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242513536 00000100:00100000:0.0:1788835255.883577:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242513536 00000100:00100000:0.0:1788835255.883594:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242513920 00000100:00100000:0.0:1788835255.883596:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242513920 00000100:00100000:0.0:1788835255.883611:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:0.0:1788835255.883619:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:0:x1875729242513792:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788835255.883649:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:0.0:1788835255.883724:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82074700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:0:x1875729242513792:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 105us (455us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835255.883730:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:0.0:1788835255.883747:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:0.0:1788835255.883763:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29ff5b29-0bb6-41bb-a110-0090199a3fb2+7:0:x1875729242513536:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788835255.883774:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788835255.883802:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82075880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29ff5b29-0bb6-41bb-a110-0090199a3fb2+7:0:x1875729242513536:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 40us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835255.883809:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:0.0:1788835255.883820:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:0.0:1788835255.883826:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:14985:x1875729242513920:12345-192.168.203.22@tcp:41:mount.lustre.0 00000004:00000024:0.0:1788835255.883836:0:17062:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:0.0:1788835255.883857:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82076d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:14985:x1875729242513920:12345-192.168.203.22@tcp:41:mount.lustre.0 Request processed in 30us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835255.883863:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00080000:2.0:1788835255.884353:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788835255.884358:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788835255.886422:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835255.886570:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242514048 00000100:00100000:0.0:1788835255.886579:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242514048 00000100:00100000:0.0:1788835255.886655:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:0.0:1788835255.886665:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:14985:x1875729242514048:12345-192.168.203.22@tcp:40:mount.lustre.0 00000100:00100000:0.0:1788835255.890578:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:14985:x1875729242514048:12345-192.168.203.22@tcp:40:mount.lustre.0 Request processed in 3901us (4150us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835255.890592:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:0.0:1788835255.903944:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835255.903997:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835255.904042:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835255.904173:0:18569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242514176 00000100:00100000:2.0:1788835255.904184:0:18569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242514176 00000100:00100000:2.0:1788835255.904235:0:18569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242514304 00000100:00100000:2.0:1788835255.904238:0:18569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242514304 00000100:00100000:2.0:1788835255.904260:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:2.0:1788835255.904268:0:18569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2384:x1875729242514176:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788835255.904303:0:18569:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 29ff5b29-0bb6-41bb-a110-0090199a3fb2@192.168.203.22@tcp t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:2.0:1788835255.904363:0:18569:0:(genops.c:1385:class_connect()) connect: client 29ff5b29-0bb6-41bb-a110-0090199a3fb2, cookie 0xdf60171e5a5d31af 00002000:00100000:2.0:1788835255.904392:0:18569:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 29ff5b29-0bb6-41bb-a110-0090199a3fb2/ffff9afdbb3a1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788835255.904402:0:18569:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788835255.904485:0:18569:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1788835255.904516:0:18569:0:(import.c:65:import_set_state_nolock()) ffff9afdbb3a3000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788835255.904583:0:18569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:2384:x1875729242514176:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 314us (584us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835255.904590:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:2.0:1788835255.904624:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:2.0:1788835255.904629:0:18569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2384:x1875729242514304:12345-192.168.203.22@tcp:8:mount.lustre.0 00010000:00080000:2.0:1788835255.904646:0:18569:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 29ff5b29-0bb6-41bb-a110-0090199a3fb2@192.168.203.22@tcp t0 exp 0000000000000000 cur 497 last 0 00000020:00000080:2.0:1788835255.904663:0:18569:0:(genops.c:1385:class_connect()) connect: client 29ff5b29-0bb6-41bb-a110-0090199a3fb2, cookie 0xdf60171e5a5d31b6 00002000:00100000:2.0:1788835255.904668:0:18569:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 29ff5b29-0bb6-41bb-a110-0090199a3fb2/ffff9afdbb3a6800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1788835255.904674:0:18569:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1788835255.904712:0:18569:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1788835255.904726:0:18569:0:(import.c:65:import_set_state_nolock()) ffff9afd9098f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1788835255.904766:0:18569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:2384:x1875729242514304:12345-192.168.203.22@tcp:8:mount.lustre.0 Request processed in 120us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835255.904772:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:1.0:1788835255.905460:0:17073:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242514432 00000100:00100000:1.0:1788835255.905468:0:17073:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242514432 00000100:00100000:1.0:1788835255.905514:0:17073:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:1.0:1788835255.905523:0:17073:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:14985:x1875729242514432:12345-192.168.203.22@tcp:900:mount.lustre.0 00000100:00100000:1.0:1788835255.905576:0:17073:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:14985:x1875729242514432:12345-192.168.203.22@tcp:900:mount.lustre.0 Request processed in 54us (1642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835255.905583:0:17073:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:0.0:1788835255.916502:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835255.916665:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242514560 00000100:00100000:2.0:1788835255.916675:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242514560 00000100:00100000:2.0:1788835255.916725:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:2.0:1788835255.916735:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:14985:x1875729242514560:12345-192.168.203.22@tcp:33:mount.lustre.0 00000004:00200000:2.0:1788835255.916830:0:17064:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788835255.916914:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:14985:x1875729242514560:12345-192.168.203.22@tcp:33:mount.lustre.0 Request processed in 180us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835255.916930:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:0.0:1788835256.101494:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788835256.101516:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1788835256.101519:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254121856:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788835256.101529:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254121984:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788835256.101638:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788835256.101661:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254122112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788835256.101748:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254122368:0@lo:400:kworker.0 00000100:00100000:0.0:1788835256.101889:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835256.101947:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb888812-a79c-4531-9a69-89c757e37463:3616:1875729254122240:0@lo:400:kworker.0 00000100:00100000:0.0:1788835256.101977:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835256.102004:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254122752:0@lo:400:kworker.0 00000100:00100000:0.0:1788835256.102041:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835256.103934:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835256.103989:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254122624:0@lo:400:kworker.0 00000100:00100000:0.0:1788835256.103993:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729254123264:0@lo:400:kworker.0 00000100:00100000:0.0:1788835256.105566:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835256.105608:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254123776:0@lo:400:kworker.0 00000100:00100000:0.0:1788835256.105636:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835256.105687:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254121856 00000100:00100000:0.0:1788835256.105694:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254121856 00000100:00100000:0.0:1788835256.105736:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254121984 00000100:00100000:0.0:1788835256.105739:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254121984 00000100:00100000:0.0:1788835256.105758:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1788835256.105765:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254121856:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788835256.108299:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835256.108364:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254122496:0@lo:400:kworker.0 00000100:00100000:3.0:1788835256.108406:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835256.108435:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254123008:0@lo:400:kworker.0 00000100:00100000:3.0:1788835256.108458:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835256.108475:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254123520:0@lo:400:kworker.0 00000100:00100000:3.0:1788835256.108499:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835256.108544:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254122496 00000100:00100000:3.0:1788835256.108551:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254122496 00000100:00100000:3.0:1788835256.108605:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254123008 00000100:00100000:3.0:1788835256.109404:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254123008 00000100:00100000:3.0:1788835256.109454:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788835256.109464:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254122496:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835256.109548:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e815f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254122496:12345-0@lo:400:kworker.0 Request processed in 86us (1141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835256.109555:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1788835256.109572:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788835256.109578:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254123008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835256.109606:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254123008:12345-0@lo:400:kworker.0 Request processed in 28us (1147us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835256.109611:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1788835256.109937:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254122496:0@lo:400:kworker.0 00000100:00100000:3.0:1788835256.109951:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254123008:0@lo:400:kworker.0 00000100:00100000:3.0:1788835256.109983:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254122752 00000100:00100000:3.0:1788835256.109987:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254122752 00000100:00100000:3.0:1788835256.110018:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254123264 00000100:00100000:3.0:1788835256.110022:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254123264 00000100:00100000:3.0:1788835256.110033:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254123776 00000100:00100000:3.0:1788835256.110035:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254123776 00000100:00100000:3.0:1788835256.110049:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254123520 00000100:00100000:3.0:1788835256.110052:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254123520 00000100:00100000:3.0:1788835256.110067:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1788835256.110074:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254122752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835256.110202:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788835256.110212:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729254123264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835256.110259:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729254123264:12345-0@lo:400:kworker.0 Request processed in 50us (4698us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835256.110266:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1788835256.110279:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788835256.110286:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254123776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835256.110330:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254123776:12345-0@lo:400:kworker.0 Request processed in 31us (4679us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835256.110336:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1788835256.110348:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788835256.110355:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254123520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835256.110391:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254123520:12345-0@lo:400:kworker.0 Request processed in 36us (1890us total) trans 0 rc 0/0 00002000:00000024:0.0:1788835256.110395:0:18570:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788835256.110399:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1788835256.110436:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729254123264:0@lo:400:kworker.0 00000100:00100000:0.0:1788835256.110444:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254121856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4677us (8554us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835256.110453:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1788835256.110455:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfb96a00 x1875729254123776/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835256.110469:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254122112 00000100:00100000:0.0:1788835256.110475:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254122112 00000100:00100000:2.0:1788835256.110486:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb96a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254123776:0@lo:400:kworker.0 00000100:00100000:0.0:1788835256.110499:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788835256.110504:0:3616:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934594 gen 2 00000100:00100000:0.0:1788835256.110510:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82074380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254121984:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:0.0:1788835256.110522:0:18570:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788835256.110526:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254121856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788835256.110555:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82074380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254121984:12345-0@lo:13:osp-pre-1-1.0 Request processed in 48us (6626us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835256.110562:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1788835256.110576:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835256.110578:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788835256.110584:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254122112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1788835256.110593:0:18570:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788835256.110619:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e814380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254122112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 35us (2328us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835256.110624:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1788835256.110642:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:0.0:1788835256.110645:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788835256.110648:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788835256.110662:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254122240 00000100:00100000:0.0:1788835256.110666:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254122240 00000100:00100000:0.0:1788835256.110700:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1788835256.110706:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+24:3616:x1875729254122240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835256.110757:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+24:3616:x1875729254122240:12345-0@lo:400:kworker.0 Request processed in 39us (8767us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835256.110770:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1788835256.110941:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254122752:12345-0@lo:400:kworker.0 Request processed in 867us (8899us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835256.110948:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:3.0:1788835256.110979:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdbfb96300 x1875729254123520/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835272 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835256.110989:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb96300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254123520:0@lo:400:kworker.0 00000100:00100000:3.0:1788835256.111031:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254122112:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788835256.111221:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb888812-a79c-4531-9a69-89c757e37463:3616:1875729254122240:0@lo:400:kworker.0 00000100:00100000:3.0:1788835256.111234:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254122752:0@lo:400:kworker.0 00000100:00100000:2.0:1788835256.111385:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254123136:0@lo:400:kworker.0 00000100:00100000:2.0:1788835256.111414:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835256.111476:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254123648:0@lo:400:kworker.0 00000100:00100000:1.0:1788835256.111507:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835256.111513:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835256.111543:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254122368 00000100:00100000:2.0:1788835256.111546:0:19148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254123648 00000100:00100000:1.0:1788835256.111548:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254122368 00000100:00100000:2.0:1788835256.111551:0:19148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254123648 00000100:00100000:1.0:1788835256.111587:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788835256.111597:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788835256.111598:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254122368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835256.111610:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729254123648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835256.111644:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb96680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254122368:12345-0@lo:400:kworker.0 Request processed in 50us (138us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835256.111650:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1788835256.111678:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254122368:0@lo:400:kworker.0 00000100:00100000:1.0:1788835256.111685:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254122880:0@lo:400:kworker.0 00000100:00100000:1.0:1788835256.111707:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835256.111725:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254123392:0@lo:400:kworker.0 00000100:00100000:1.0:1788835256.111760:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835256.111802:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82077100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3615:x1875729254123648:12345-0@lo:400:kworker.0 Request processed in 195us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835256.111811:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1788835256.111814:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254123392 00000100:00100000:1.0:1788835256.111819:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254123392 00000100:00100000:2.0:1788835256.111844:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1788835256.111853:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254123392:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1788835256.111854:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1788835256.111880:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254122880 00000100:00100000:1.0:1788835256.111891:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254122880 00000100:00100000:2.0:1788835256.111893:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb95c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254123392:12345-0@lo:400:kworker.0 Request processed in 42us (147us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835256.111901:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1788835256.111921:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1788835256.111929:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254122880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835256.111933:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb95f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3615:1875729254123648:0@lo:400:kworker.0 00000100:00100000:2.0:1788835256.111952:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82077b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254121984:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788835256.111972:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb97480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254122880:12345-0@lo:400:kworker.0 Request processed in 43us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835256.111980:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1788835256.112052:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254122624 00000100:00100000:3.0:1788835256.112057:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254122624 00000100:00100000:3.0:1788835256.112082:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254123136 00000100:00100000:3.0:1788835256.112190:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254123136 00000100:00100000:3.0:1788835256.112216:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788835256.112222:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82075180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254122624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835256.112260:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82075180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254122624:12345-0@lo:400:kworker.0 Request processed in 37us (1686us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835256.112265:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1788835256.112278:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788835256.112283:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82074e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254123136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835256.112308:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82074e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254123136:12345-0@lo:400:kworker.0 Request processed in 25us (893us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835256.112335:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1788835256.112374:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254122624:0@lo:400:kworker.0 00000100:00100000:3.0:1788835256.112385:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254123136:0@lo:400:kworker.0 00000100:00100000:1.0:1788835256.112859:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254122880:0@lo:400:kworker.0 00000100:00100000:1.0:1788835256.112870:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb95180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254123392:0@lo:400:kworker.0 00000100:00100000:2.0:1788835256.138877:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835256.140413:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242514688 00000100:00100000:1.0:1788835256.140425:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242514688 00000100:00100000:1.0:1788835256.140481:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:1.0:1788835256.140490:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:15022:x1875729242514688:12345-192.168.203.22@tcp:101:mkdir.0 00010000:00010000:1.0:1788835256.140509:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835256.140531:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d31bd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae098b expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835256.140593:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d31c4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835256.140607:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d31c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835256.140623:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d31c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835256.140670:0:17062:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788835256.140674:0:17062:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835256.140695:0:17062:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d31c4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835256.140731:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d31bd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae098b expref: 8 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835256.140749:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d31c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae098b expref: 7 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835256.140757:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc835cf000) 00010000:00010000:1.0:1788835256.140759:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788835256.140762:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc2166800, rc 0) 00000100:00100000:1.0:1788835256.140835:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82077b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29ff5b29-0bb6-41bb-a110-0090199a3fb2+7:15022:x1875729242514688:12345-192.168.203.22@tcp:101:mkdir.0 Request processed in 345us (1968us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835256.140842:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00010000:00010000:1.0:1788835256.490098:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835257.512696:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835258.152794:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254123904:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835258.152863:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835258.153003:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254123904 00000100:00100000:0.0:1788835258.153124:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254123904 00000100:00100000:0.0:1788835258.153190:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1788835258.153201:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254123904:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788835258.153229:0:18570:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788835258.153284:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb95180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254123904:12345-0@lo:13:osp-pre-0-1.0 Request processed in 85us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835258.153291:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788835258.153426:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254123904:0@lo:13:osp-pre-0-1.0 00000100:00080000:1.0:1788835258.155709:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1788835258.535657:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1788835258.663884:0:17793:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 29ff5b29-0bb6-41bb-a110-0090199a3fb2 00000001:00100000:0.0:1788835258.663904:0:17793:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0001: committing for initial connect of 509130d2-ab52-48a7-b813-2f954b790e9f 00000001:00100000:0.0:1788835258.670378:0:19384:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 29ff5b29-0bb6-41bb-a110-0090199a3fb2 00000001:00100000:0.0:1788835258.670394:0:19384:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 509130d2-ab52-48a7-b813-2f954b790e9f 00000001:00100000:3.0:1788835258.671405:0:18563:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 29ff5b29-0bb6-41bb-a110-0090199a3fb2 00000001:00100000:3.0:1788835258.671419:0:18563:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 509130d2-ab52-48a7-b813-2f954b790e9f 00000001:00100000:0.0:1788835258.672370:0:17040:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 29ff5b29-0bb6-41bb-a110-0090199a3fb2 00000001:00100000:0.0:1788835258.672385:0:17040:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 509130d2-ab52-48a7-b813-2f954b790e9f 00000100:00100000:2.0:1788835259.173530:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788835259.173607:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254124032:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788835259.173690:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835259.173817:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1788835259.173828:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254124160:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788835259.173857:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835259.174090:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254124032 00000100:00100000:1.0:1788835259.174099:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254124032 00000100:00100000:3.0:1788835259.174159:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254124160 00000100:00100000:3.0:1788835259.174173:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254124160 00000100:00100000:3.0:1788835259.174213:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788835259.174222:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254124032:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:3.0:1788835259.174252:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:3.0:1788835259.174310:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82076300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254124032:12345-0@lo:41:osp-pre-0-1.0 Request processed in 89us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835259.174342:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1788835259.174359:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788835259.174366:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254124160:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788835259.174381:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788835259.174412:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254124160:12345-0@lo:41:osp-pre-1-0.0 Request processed in 48us (556us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835259.174417:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1788835259.174448:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254124160:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788835259.174512:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254124032:0@lo:41:osp-pre-0-1.0 00000001:02000400:3.0:1788835259.330854:0:19942:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1788835259.561658:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835260.582259:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1788835261.023203:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835261.023243:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835261.023274:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835261.023293:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835261.023310:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835261.023435:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242515072 00000100:00100000:0.0:1788835261.023445:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242515072 00000100:00100000:1.0:1788835261.023478:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835261.023504:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835261.023511:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242515584 00000100:00100000:0.0:1788835261.023516:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242515584 00000100:00100000:0.0:1788835261.023534:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242514944 00000100:00100000:1.0:1788835261.023537:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835261.023539:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242514944 00000100:00100000:0.0:1788835261.023557:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242515456 00000100:00100000:1.0:1788835261.023563:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835261.023575:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242515456 00000100:00100000:1.0:1788835261.023598:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242515328 00000100:00100000:0.0:1788835261.023604:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:1.0:1788835261.023605:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242515328 00000100:00100000:0.0:1788835261.023615:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+5:2388:x1875729242515072:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835261.023640:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242515840 00000100:00100000:0.0:1788835261.023688:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb94000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+5:2388:x1875729242515072:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 75us (444us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835261.023694:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:0.0:1788835261.023710:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:0.0:1788835261.023717:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:2388:x1875729242515584:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835261.023744:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb95880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:2388:x1875729242515584:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835261.023750:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:0.0:1788835261.023762:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:0.0:1788835261.023769:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+6:2387:x1875729242514944:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835261.023790:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242515840 00000100:00100000:0.0:1788835261.023795:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb97b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+6:2387:x1875729242514944:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835261.023804:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:0.0:1788835261.023816:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:0.0:1788835261.023823:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:2387:x1875729242515456:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835261.023850:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb94700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:2387:x1875729242515456:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 29us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835261.023856:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00080000:0.0:1788835261.023872:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788835261.023876:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788835261.023878:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:0.0:1788835261.024010:0:19538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242515200 00000100:00100000:0.0:1788835261.024020:0:19538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242515200 00000100:00100000:0.0:1788835261.024043:0:19538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242515712 00000100:00100000:0.0:1788835261.024045:0:19538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242515712 00000100:00100000:0.0:1788835261.024057:0:19538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:0.0:1788835261.024063:0:19538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:509130d2-ab52-48a7-b813-2f954b790e9f+5:2388:x1875729242515328:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835261.024091:0:19538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb97800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:509130d2-ab52-48a7-b813-2f954b790e9f+5:2388:x1875729242515328:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 28us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835261.024096:0:19538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:0.0:1788835261.024108:0:19538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:0.0:1788835261.024113:0:19538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:509130d2-ab52-48a7-b813-2f954b790e9f+5:2387:x1875729242515200:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835261.024135:0:19538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb97100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:509130d2-ab52-48a7-b813-2f954b790e9f+5:2387:x1875729242515200:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 22us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835261.024141:0:19538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:0.0:1788835261.024151:0:19538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:0.0:1788835261.024157:0:19538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:2387:x1875729242515712:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835261.024176:0:19538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb94380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:2387:x1875729242515712:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 20us (614us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835261.024182:0:19538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00080000:0.0:1788835261.024198:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788835261.024261:0:19538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:0.0:1788835261.024270:0:19538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:2388:x1875729242515840:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835261.024296:0:19538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb96d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:2388:x1875729242515840:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 28us (985us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835261.024301:0:19538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 12 00000100:00100000:3.0:1788835261.025861:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242514816 00000100:00100000:3.0:1788835261.025870:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242514816 00000100:00100000:3.0:1788835261.025969:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 144 00000100:00100000:3.0:1788835261.025988:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:2388:x1875729242514816:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:3.0:1788835261.026051:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:2388:x1875729242514816:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 64us (2847us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835261.026058:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 144 00000040:00080000:3.0:1788835261.100969:0:17095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788835261.224615:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8458c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254124288:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788835261.224680:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835261.224758:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254124288 00000100:00100000:3.0:1788835261.224765:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254124288 00000100:00100000:3.0:1788835261.224817:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1788835261.224825:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254124288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1788835261.224852:0:18570:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:3.0:1788835261.224899:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254124288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835261.224906:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1788835261.224926:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788835261.224957:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8458c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254124288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788835261.225158:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254124672:0@lo:400:kworker.0 00000100:00100000:0.0:1788835261.225197:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835261.225221:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254125184:0@lo:400:kworker.0 00000100:00100000:0.0:1788835261.225246:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835261.225263:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729254125696:0@lo:400:kworker.0 00000100:00100000:0.0:1788835261.225285:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835261.225304:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [0->1] 00000100:00100000:0.0:1788835261.225309:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb888812-a79c-4531-9a69-89c757e37463:3615:1875729254124544:0@lo:400:kworker.0 00000100:00100000:0.0:1788835261.225357:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835261.225379:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254125056:0@lo:400:kworker.0 00000100:00100000:1.0:1788835261.225591:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254124672 00000100:00100000:1.0:1788835261.225596:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254124672 00000100:00100000:1.0:1788835261.225633:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788835261.225640:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254124672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835261.225682:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254124672:12345-0@lo:400:kworker.0 Request processed in 43us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835261.225689:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1788835261.225724:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254125696 00000100:00100000:1.0:1788835261.225729:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254125696 00000100:00100000:1.0:1788835261.225758:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788835261.225765:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729254125696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835261.225795:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaabb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3615:x1875729254125696:12345-0@lo:400:kworker.0 Request processed in 31us (508us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835261.225801:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1788835261.225818:0:18569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254125184 00000100:00100000:1.0:1788835261.225822:0:18569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254125184 00000100:00100000:1.0:1788835261.225848:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788835261.225854:0:18569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254125184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835261.225882:0:18569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254125184:12345-0@lo:400:kworker.0 Request processed in 28us (636us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835261.225888:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1788835261.225917:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254124544 00000100:00100000:1.0:1788835261.225921:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254124544 00000100:00100000:1.0:1788835261.225943:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1788835261.225949:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+24:3615:x1875729254124544:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835261.225995:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+24:3615:x1875729254124544:12345-0@lo:400:kworker.0 Request processed in 46us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835261.226002:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1788835261.226094:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254126080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788835261.226123:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835261.226166:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254124416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788835261.226191:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835261.226208:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254124928:0@lo:400:kworker.0 00000100:00100000:3.0:1788835261.226228:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835261.226246:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729254125440:0@lo:400:kworker.0 00000100:00100000:3.0:1788835261.226266:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835261.226284:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254125952:0@lo:400:kworker.0 00000100:00100000:3.0:1788835261.226304:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835261.226343:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [2->3] 00000100:00100000:3.0:1788835261.226349:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254124800:0@lo:400:kworker.0 00000100:00100000:3.0:1788835261.226372:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835261.226752:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254124928 00000100:00100000:2.0:1788835261.226757:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254124928 00000100:00100000:2.0:1788835261.226784:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254125440 00000100:00100000:2.0:1788835261.226787:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254125440 00000100:00100000:2.0:1788835261.226799:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254125952 00000100:00100000:2.0:1788835261.226801:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254125952 00000100:00100000:2.0:1788835261.226817:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788835261.226823:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254124928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835261.228076:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254126080 00000100:00100000:1.0:1788835261.228083:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254126080 00000100:00100000:1.0:1788835261.228113:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254124416 00000100:00100000:1.0:1788835261.228117:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254124416 00000100:00100000:1.0:1788835261.228133:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788835261.228139:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254126080:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788835261.228163:0:18570:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:2.0:1788835261.229549:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3617:x1875729254124928:12345-0@lo:400:kworker.0 Request processed in 2720us (3313us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835261.229560:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1788835261.229606:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788835261.229617:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729254125440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835261.229658:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0001_UUID+5:3617:x1875729254125440:12345-0@lo:400:kworker.0 Request processed in 45us (3391us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835261.229665:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1788835261.229680:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1788835261.229687:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875729254125952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835261.229718:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0001-lwp-OST0001_UUID+5:3617:x1875729254125952:12345-0@lo:400:kworker.0 Request processed in 32us (3412us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835261.229724:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:2.0:1788835261.229775:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788835261.229793:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788835261.229796:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788835261.229842:0:19538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254124800 00000100:00100000:2.0:1788835261.229848:0:19538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254124800 00000100:00100000:2.0:1788835261.229877:0:19538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1788835261.229883:0:19538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3617:x1875729254124800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835261.229911:0:19538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3617:x1875729254124800:12345-0@lo:400:kworker.0 Request processed in 29us (3539us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835261.229917:0:19538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1788835261.231079:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835261.231122:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875729254125568:0@lo:400:kworker.0 00000100:00100000:0.0:1788835261.231157:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835261.231198:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254124672:0@lo:400:kworker.0 00000100:00100000:0.0:1788835261.231212:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254125184:0@lo:400:kworker.0 00010000:00080000:0.0:1788835261.231226:0:3615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc844ab100 x1875729254125696/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1788835261.231237:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-lwp-OST0000_UUID:3615:1875729254125696:0@lo:400:kworker.0 00000100:00100000:0.0:1788835261.231277:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb888812-a79c-4531-9a69-89c757e37463:3615:1875729254124544:0@lo:400:kworker.0 00000100:00100000:0.0:1788835261.231301:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254125568 00000100:00100000:0.0:1788835261.231306:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254125568 00000100:00100000:0.0:1788835261.231368:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1788835261.231374:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875729254125568:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835261.231430:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875729254125568:12345-0@lo:400:kworker.0 Request processed in 55us (272us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835261.231444:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:0.0:1788835261.231465:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1788835261.231486:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875729254125568:0@lo:400:kworker.0 00000100:00100000:1.0:1788835261.232060:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254126080:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3919us (5933us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835261.232069:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1788835261.232090:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1788835261.232099:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8458d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254124416:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788835261.232117:0:18570:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788835261.232150:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8458d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254124416:12345-0@lo:13:osp-pre-1-1.0 Request processed in 54us (5959us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835261.232157:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1788835261.232420:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb94e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254126080:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1788835261.232558:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254124800:0@lo:400:kworker.0 00000100:00100000:3.0:1788835261.232575:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254125312:0@lo:400:kworker.0 00000100:00100000:3.0:1788835261.232607:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835261.232633:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254125312 00000100:00100000:3.0:1788835261.232638:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254125312 00000100:00100000:3.0:1788835261.232669:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788835261.232676:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254125312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835261.232707:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254125312:12345-0@lo:400:kworker.0 Request processed in 31us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835261.232712:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1788835261.232739:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254125312:0@lo:400:kworker.0 00000100:00100000:3.0:1788835261.232747:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729254125824:0@lo:400:kworker.0 00000100:00100000:3.0:1788835261.232769:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835261.232791:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254125824 00000100:00100000:3.0:1788835261.232794:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254125824 00000100:00100000:3.0:1788835261.232828:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1788835261.232835:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729254125824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835261.232873:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3617:x1875729254125824:12345-0@lo:400:kworker.0 Request processed in 39us (103us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835261.232879:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1788835261.232894:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788835261.232912:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3617:1875729254125824:0@lo:400:kworker.0 00000100:00100000:3.0:1788835261.232926:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254124416:0@lo:13:osp-pre-1-1.0 00000100:00100000:3.0:1788835261.232937:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3617:1875729254124928:0@lo:400:kworker.0 00000100:00100000:3.0:1788835261.232947:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0001_UUID:3617:1875729254125440:0@lo:400:kworker.0 00010000:00080000:3.0:1788835261.232968:0:3617:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc844a8a80 x1875729254125952/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835277 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835261.232991:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-lwp-OST0001_UUID:3617:1875729254125952:0@lo:400:kworker.0 00000100:00100000:2.0:1788835261.233641:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254125056 00000100:00100000:2.0:1788835261.233647:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254125056 00000100:00100000:2.0:1788835261.233687:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788835261.233696:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254125056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835261.233747:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaaa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254125056:12345-0@lo:400:kworker.0 Request processed in 52us (2670us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835261.233753:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1788835261.233798:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254125056:0@lo:400:kworker.0 00010000:00010000:1.0:1788835261.606552:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835262.631658:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835263.269927:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1788835263.269952:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254126208:0@lo:13:osp-pre-0-1.0 00000100:00100000:3.0:1788835263.270041:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835263.270193:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254126208 00000100:00100000:0.0:1788835263.270202:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254126208 00000100:00100000:0.0:1788835263.270272:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1788835263.270282:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254126208:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:0.0:1788835263.270334:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:0.0:1788835263.270381:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254126208:12345-0@lo:13:osp-pre-0-1.0 Request processed in 101us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835263.270388:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1788835263.270594:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1788835263.270630:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254126208:0@lo:13:osp-pre-0-1.0 00000020:00000080:3.0:1788835263.517807:0:20089:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff3fe3c5c0 20000000:00000080:3.0:1788835263.517824:0:20089:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9afdaf271400 uarg=0000000000000000 20000000:01000000:3.0:1788835263.517863:0:20089:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788835263.517869:0:20089:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1788835263.517873:0:20089:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1788835263.524733:0:20090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 13 20000000:00000400:3.0:1788835263.525157:0:20089:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1788835263.539888:0:20089:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1788835263.540257:0:20089:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d31cb lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 20089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.540278:0:20089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd884abe00/0xdf60171e5a5d2e60 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2e59 expref: 23 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.540287:0:20089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd884aa600/0xdf60171e5a5d2e6e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2e67 expref: 23 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.540293:0:20089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afc8374c600/0xdf60171e5a5d2ead lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2ea6 expref: 23 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.540345:0:20089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afd884aa200/0xdf60171e5a5d2f47 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d2f40 expref: 23 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.540355:0:20089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d315b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae08ea expref: 12 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.540363:0:20089:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9afdb2e61800/0xdf60171e5a5d319a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae095a expref: 12 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.540369:0:20089:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d31cb lrc: 9/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 20089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.540413:0:20089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdb2e61800/0xdf60171e5a5d319a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae095a expref: 12 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.540430:0:20089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afdb2e61800/0xdf60171e5a5d319a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae095a expref: 12 pid: 17053 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835263.540446:0:20089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82076a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20089:1875729254126336:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788835263.540549:0:20089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d315b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae08ea expref: 12 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.540558:0:20089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d315b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae08ea expref: 12 pid: 17053 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835263.540566:0:20089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82074a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20089:1875729254126464:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788835263.540596:0:20089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd884aa200/0xdf60171e5a5d2f47 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d2f40 expref: 23 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.540618:0:20089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afd884aa200/0xdf60171e5a5d2f47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d2f40 expref: 23 pid: 17055 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835263.540627:0:20089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82075c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20089:1875729254126592:0@lo:104: 00000100:00100000:2.0:1788835263.540670:0:20089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1788835263.540709:0:20089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afc8374c600/0xdf60171e5a5d2ead lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d2ea6 expref: 23 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.540718:0:20089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afc8374c600/0xdf60171e5a5d2ead lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d2ea6 expref: 23 pid: 17055 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835263.540726:0:20089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfa2f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20089:1875729254126720:0@lo:104: 00000100:00100000:2.0:1788835263.540748:0:20089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835263.540778:0:17043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254126592 00000100:00100000:2.0:1788835263.540785:0:17043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254126592 00000100:00100000:2.0:1788835263.540821:0:17043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254126720 00000100:00100000:2.0:1788835263.540824:0:17043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254126720 00000100:00100000:2.0:1788835263.540839:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788835263.540847:0:17043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82077800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+4:20089:x1875729254126592:12345-0@lo:104: 00010000:00010000:2.0:1788835263.540857:0:17043:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61200/0xdf60171e5a5d2f40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2f47 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.540902:0:17043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788835263.540907:0:17043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82077800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+4:20089:x1875729254126592:12345-0@lo:104: Request processed in 62us (237us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835263.540914:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788835263.540945:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788835263.540952:0:17043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+3:20089:x1875729254126720:12345-0@lo:104: 00010000:00010000:2.0:1788835263.540979:0:17043:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2ea6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2ead expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.541015:0:17043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788835263.541020:0:17043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f39880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+3:20089:x1875729254126720:12345-0@lo:104: Request processed in 70us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835263.541027:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:2.0:1788835263.541048:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788835263.541054:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61200/0xdf60171e5a5d2f40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2f47 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.541061:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61200 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788835263.541065:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61200/0xdf60171e5a5d2f40 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d2f47 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.541073:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61200/0xdf60171e5a5d2f40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d2f47 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788835263.541080:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61200/0xdf60171e5a5d2f40 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d2f47 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835263.541086:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788835263.541116:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61200/0xdf60171e5a5d2f40 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2f47 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.541123:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788835263.541143:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61200/0xdf60171e5a5d2f40 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2f47 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.541150:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afdb2e61200/0xdf60171e5a5d2f40 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2f47 expref: -99 pid: 19383 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.541168:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835263.541171:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2ea6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2ead expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.541177:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374ce00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788835263.541180:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2ea6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d2ead expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.541187:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2ea6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d2ead expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788835263.541193:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2ea6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d2ead expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835263.541199:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788835263.541212:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2ea6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2ead expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.541218:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788835263.541225:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2ea6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2ead expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.541231:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afc8374ce00/0xdf60171e5a5d2ea6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2ead expref: -99 pid: 18562 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.541240:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835263.541242:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835263.541244:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835263.541264:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb888812-a79c-4531-9a69-89c757e37463:3616:1875729254126848:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788835263.541298:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835263.541344:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1788835263.541351:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb888812-a79c-4531-9a69-89c757e37463:3616:1875729254126976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788835263.541373:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835263.541401:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254126848 00000100:00100000:2.0:1788835263.541405:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254126848 00010000:00010000:2.0:1788835263.541422:0:17046:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd884aa200/0xdf60171e5a5d2f47 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2f40 expref: 24 pid: 17055 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835263.541443:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254126976 00000100:00100000:2.0:1788835263.541446:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254126976 00010000:00010000:2.0:1788835263.541457:0:17046:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afc8374c600/0xdf60171e5a5d2ead lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2ea6 expref: 25 pid: 17055 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835263.541475:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788835263.541482:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb888812-a79c-4531-9a69-89c757e37463+25:3616:x1875729254126848:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788835263.541492:0:17046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835263.541496:0:17046:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd884aa200/0xdf60171e5a5d2f47 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2f40 expref: 25 pid: 17055 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.541505:0:17046:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd884aa200/0xdf60171e5a5d2f47 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d2f40 expref: 25 pid: 17055 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.541520:0:17046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835263.541550:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb888812-a79c-4531-9a69-89c757e37463+25:3616:x1875729254126848:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (251us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835263.541556:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1788835263.541572:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788835263.541578:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb888812-a79c-4531-9a69-89c757e37463+24:3616:x1875729254126976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788835263.541592:0:17046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835263.541596:0:17046:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afc8374c600/0xdf60171e5a5d2ead lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2ea6 expref: 24 pid: 17055 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.541604:0:17046:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afc8374c600/0xdf60171e5a5d2ead lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d2ea6 expref: 24 pid: 17055 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.541613:0:17046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835263.541635:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:cb888812-a79c-4531-9a69-89c757e37463+24:3616:x1875729254126976:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835263.541644:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1788835263.541689:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb888812-a79c-4531-9a69-89c757e37463:3616:1875729254126976:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788835263.541697:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb888812-a79c-4531-9a69-89c757e37463:3616:1875729254126848:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788835263.541729:0:20089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd884aa600/0xdf60171e5a5d2e6e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d2e67 expref: 23 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.541738:0:20089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afd884aa600/0xdf60171e5a5d2e6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d2e67 expref: 23 pid: 17055 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835263.541746:0:20089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20089:1875729254127104:0@lo:104: 00000100:00100000:2.0:1788835263.541767:0:20089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835263.541787:0:17043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254127104 00000100:00100000:2.0:1788835263.541791:0:17043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254127104 00000100:00100000:2.0:1788835263.541807:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788835263.541812:0:17043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+3:20089:x1875729254127104:12345-0@lo:104: 00010000:00010000:2.0:1788835263.541819:0:17043:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afd884ab600/0xdf60171e5a5d2e67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2e6e expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.541860:0:17043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1788835263.541867:0:17043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90fb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+3:20089:x1875729254127104:12345-0@lo:104: Request processed in 53us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835263.541873:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:2.0:1788835263.541903:0:20089:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9afd884abe00/0xdf60171e5a5d2e60 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xdf60171e5a5d2e59 expref: 23 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.541911:0:20089:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9afd884abe00/0xdf60171e5a5d2e60 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xdf60171e5a5d2e59 expref: 23 pid: 17053 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835263.541918:0:20089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20089:1875729254127232:0@lo:104: 00000100:00100000:2.0:1788835263.541939:0:20089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835263.541969:0:17043:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254127232 00000100:00100000:2.0:1788835263.541973:0:17043:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254127232 00000100:00100000:2.0:1788835263.541989:0:17043:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788835263.541994:0:17043:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+3:20089:x1875729254127232:12345-0@lo:104: 00010000:00010000:2.0:1788835263.542001:0:17043:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.122@tcp lock: ffff9afc8374da00/0xdf60171e5a5d2e59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2e60 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.542032:0:17043:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1788835263.542036:0:17043:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:cb888812-a79c-4531-9a69-89c757e37463+3:20089:x1875729254127232:12345-0@lo:104: Request processed in 43us (97us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835263.542041:0:17043:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:2.0:1788835263.542056:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1788835263.542061:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afd884ab600/0xdf60171e5a5d2e67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2e6e expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.542067:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd884ab600 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788835263.542075:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afd884ab600/0xdf60171e5a5d2e67 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d2e6e expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.542081:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afd884ab600/0xdf60171e5a5d2e67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d2e6e expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788835263.542086:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afd884ab600/0xdf60171e5a5d2e67 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d2e6e expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835263.542091:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788835263.542110:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afd884ab600/0xdf60171e5a5d2e67 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2e6e expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.542116:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788835263.542129:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afd884ab600/0xdf60171e5a5d2e67 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2e6e expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.542135:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afd884ab600/0xdf60171e5a5d2e67 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2e6e expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.542145:0:17048:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1788835263.542148:0:17048:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.122@tcp lock: ffff9afc8374da00/0xdf60171e5a5d2e59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xdf60171e5a5d2e60 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.542155:0:17048:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afc8374da00 already unused, calling callback (ffffffffc149fc20) 10000000:00010000:2.0:1788835263.542157:0:17048:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.122@tcp lock: ffff9afc8374da00/0xdf60171e5a5d2e59 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xdf60171e5a5d2e60 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.542164:0:17048:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.122@tcp lock: ffff9afc8374da00/0xdf60171e5a5d2e59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xdf60171e5a5d2e60 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1788835263.542183:0:17048:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.122@tcp lock: ffff9afc8374da00/0xdf60171e5a5d2e59 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xdf60171e5a5d2e60 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835263.542188:0:17048:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1788835263.542202:0:17048:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.122@tcp lock: ffff9afc8374da00/0xdf60171e5a5d2e59 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2e60 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.542207:0:17048:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1788835263.542213:0:17048:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.122@tcp lock: ffff9afc8374da00/0xdf60171e5a5d2e59 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2e60 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.542218:0:17048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.122@tcp lock: ffff9afc8374da00/0xdf60171e5a5d2e59 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xdf60171e5a5d2e60 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.542230:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835263.542231:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1788835263.542233:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1788835263.542247:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb888812-a79c-4531-9a69-89c757e37463:3615:1875729254127488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788835263.542271:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835263.542290:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788835263.542294:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb888812-a79c-4531-9a69-89c757e37463:3615:1875729254127360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788835263.542311:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835263.542352:0:18215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254127488 00000100:00100000:2.0:1788835263.542356:0:18215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254127488 00010000:00010000:2.0:1788835263.542370:0:18215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd884abe00/0xdf60171e5a5d2e60 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2e59 expref: 24 pid: 17053 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835263.542385:0:18215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254127360 00000100:00100000:2.0:1788835263.542388:0:18215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254127360 00010000:00010000:2.0:1788835263.542405:0:18215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afd884aa600/0xdf60171e5a5d2e6e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2e67 expref: 25 pid: 17055 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835263.542422:0:18215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788835263.542428:0:18215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cb888812-a79c-4531-9a69-89c757e37463+25:3615:x1875729254127488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788835263.542436:0:18215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835263.542440:0:18215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd884abe00/0xdf60171e5a5d2e60 lrc: 6/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2e59 expref: 25 pid: 17053 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.542447:0:18215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd884abe00/0xdf60171e5a5d2e60 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d2e59 expref: 25 pid: 17053 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.542457:0:18215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835263.542483:0:18215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cb888812-a79c-4531-9a69-89c757e37463+25:3615:x1875729254127488:12345-0@lo:103:ldlm_bl.0 Request processed in 56us (212us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835263.542490:0:18215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1788835263.542505:0:18215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788835263.542511:0:18215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cb888812-a79c-4531-9a69-89c757e37463+24:3615:x1875729254127360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1788835263.542518:0:18215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835263.542522:0:18215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afd884aa600/0xdf60171e5a5d2e6e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xdf60171e5a5d2e67 expref: 24 pid: 17055 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.542530:0:18215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afd884aa600/0xdf60171e5a5d2e6e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xdf60171e5a5d2e67 expref: 24 pid: 17055 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.542539:0:18215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835263.542561:0:18215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:cb888812-a79c-4531-9a69-89c757e37463+24:3615:x1875729254127360:12345-0@lo:103:ldlm_bl.0 Request processed in 51us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835263.542567:0:18215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1788835263.542607:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb888812-a79c-4531-9a69-89c757e37463:3615:1875729254127360:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788835263.542615:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:cb888812-a79c-4531-9a69-89c757e37463:3615:1875729254127488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1788835263.542638:0:20089:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8109b000 going to sleep for 11 seconds 00010000:00010000:2.0:1788835263.542651:0:20089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd884aa200/0xdf60171e5a5d2f47 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d2f40 expref: 23 pid: 17055 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835263.542660:0:20089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82075c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20089:1875729254126592:0@lo:104: 00010000:00010000:2.0:1788835263.542670:0:20089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afc8374c600/0xdf60171e5a5d2ead lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d2ea6 expref: 22 pid: 17055 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835263.542677:0:20089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfa2f800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20089:1875729254126720:0@lo:104: 00010000:00010000:2.0:1788835263.542684:0:20089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd884aa600/0xdf60171e5a5d2e6e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d2e67 expref: 21 pid: 17055 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835263.542690:0:20089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20089:1875729254127104:0@lo:104: 00010000:00010000:2.0:1788835263.542697:0:20089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd884abe00/0xdf60171e5a5d2e60 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xdf60171e5a5d2e59 expref: 20 pid: 17053 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835263.542704:0:20089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fa680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20089:1875729254127232:0@lo:104: 00010000:00010000:0.0:1788835263.544438:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1788835263.551308:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835263.551561:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835263.551588:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835263.551617:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242516096 00000100:00100000:3.0:1788835263.551625:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242516096 00010000:00010000:3.0:1788835263.551664:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d315b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae08ea expref: 13 pid: 17053 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835263.551693:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242515968 00000100:00100000:3.0:1788835263.551697:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242515968 00010000:00010000:3.0:1788835263.551724:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9afdb2e61800/0xdf60171e5a5d319a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae095a expref: 14 pid: 17053 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835263.551765:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:3.0:1788835263.551774:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbc366c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+14:2385:x1875729242516096:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788835263.551788:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835263.551794:0:17045:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d315b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae08ea expref: 14 pid: 17053 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835263.551804:0:17045:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d315b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae08ea expref: 14 pid: 17053 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835263.551823:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1788835263.551868:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbc366c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+14:2385:x1875729242516096:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 95us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835263.551875:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 13 00000100:00100000:0.0:1788835263.552443:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 14 00000100:00100000:0.0:1788835263.552454:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:2385:x1875729242515968:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788835263.552464:0:17047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835263.552469:0:17047:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9afdb2e61800/0xdf60171e5a5d319a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae095a expref: 13 pid: 17053 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835263.552480:0:17047:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9afdb2e61800/0xdf60171e5a5d319a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae095a expref: 13 pid: 17053 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835263.552494:0:17047:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d31cb lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835263.552502:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d31cb lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 20089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835263.552526:0:17047:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d31cb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 20089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835263.552533:0:17047:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d31cb lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835263.552540:0:17047:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d31cb lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 20089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835263.552548:0:17047:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d31cb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835263.552554:0:17047:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80031c00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835263.552558:0:17047:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d31cb lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 20089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835263.552565:0:17047:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d31cb lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 20089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835263.552574:0:17047:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d31cb lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835263.552583:0:17047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835263.552607:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:2385:x1875729242515968:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 156us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835263.552614:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 14 00010000:00010000:2.0:1788835263.554578:0:20089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e61800/0xdf60171e5a5d319a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae095a expref: 12 pid: 17053 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835263.554597:0:20089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82076a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20089:1875729254126336:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788835263.554609:0:20089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afdb2e60200/0xdf60171e5a5d315b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae08ea expref: 11 pid: 17053 timeout: 605 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835263.554617:0:20089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82074a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:20089:1875729254126464:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788835263.555686:0:20089:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d31cb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.555700:0:20089:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d31cb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.555706:0:20089:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d31cb lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.555723:0:20089:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d31cb lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 20089 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835263.653540:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1788835264.102489:0:17814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788835264.293771:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254127744:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835264.293844:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835264.293901:0:3617:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1788835264.293903:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254127744 00000100:00100000:3.0:1788835264.293911:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254127616:0@lo:41:osp-pre-0-1.0 00000100:00100000:1.0:1788835264.293912:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254127744 00000100:00100000:3.0:1788835264.293948:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835264.295625:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254127616 00000100:00100000:1.0:1788835264.295636:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254127616 00000100:00100000:1.0:1788835264.295744:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788835264.295757:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254127744:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:1.0:1788835264.295803:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:1.0:1788835264.295935:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254127744:12345-0@lo:41:osp-pre-1-0.0 Request processed in 182us (2091us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835264.295943:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1788835264.295971:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1788835264.295978:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254127616:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:1.0:1788835264.295995:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446313984 avail 1300074496 00000100:00100000:1.0:1788835264.296024:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254127616:12345-0@lo:41:osp-pre-0-1.0 Request processed in 47us (2076us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835264.296030:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1788835264.297149:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb94a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254127744:0@lo:41:osp-pre-1-0.0 00000100:00100000:2.0:1788835264.297180:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83ed2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254127616:0@lo:41:osp-pre-0-1.0 00000100:00100000:3.0:1788835264.670157:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835264.670206:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242516224 00000100:00100000:3.0:1788835264.670216:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242516224 00000100:00100000:3.0:1788835264.670268:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 146 00000100:00100000:3.0:1788835264.670278:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+11:14870:x1875729242516224:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788835264.670294:0:17054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835264.671018:0:17054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdc204a000/0xdf60171e5a5d31d2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0992 expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835264.671058:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdc204a000/0xdf60171e5a5d31d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0992 expref: 12 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835264.671071:0:17054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdc204a000/0xdf60171e5a5d31d2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0992 expref: 12 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835264.671080:0:17054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204a000, rc 0) 00000100:00100000:3.0:1788835264.672523:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+12:14870:x1875729242516224:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 2239us (2369us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835264.672533:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 146 00000100:00100000:3.0:1788835264.675902:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835264.675938:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242516352 00000100:00100000:3.0:1788835264.675948:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242516352 00000100:00100000:3.0:1788835264.676006:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 147 00000100:00100000:3.0:1788835264.676016:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+12:14870:x1875729242516352:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788835264.676154:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+12:14870:x1875729242516352:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 137us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835264.676162:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 147 00010000:00010000:3.0:1788835264.678615:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835264.679262:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835264.679292:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242516480 00000100:00100000:3.0:1788835264.679302:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242516480 00000100:00100000:3.0:1788835264.679371:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 148 00000100:00100000:3.0:1788835264.679381:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+12:14870:x1875729242516480:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788835264.679500:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+12:14870:x1875729242516480:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 120us (242us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835264.679514:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 148 00000100:00100000:3.0:1788835264.685072:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835264.685191:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242516608 00000100:00100000:2.0:1788835264.685200:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242516608 00000100:00100000:2.0:1788835264.685542:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 149 00000100:00100000:2.0:1788835264.685554:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+12:14870:x1875729242516608:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788835264.685572:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835264.685590:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d31d9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0999 expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835264.685617:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d31d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0999 expref: 13 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835264.685628:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd80031c00/0xdf60171e5a5d31d9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0999 expref: 13 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835264.685644:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd80031c00, rc 0) 00000100:00100000:2.0:1788835264.685702:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:14870:x1875729242516608:12345-192.168.203.22@tcp:101:ll_cfg_requeue.0 Request processed in 150us (636us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835264.685709:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 149 00000100:00100000:2.0:1788835264.688108:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835264.688192:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242516736 00000100:00100000:3.0:1788835264.688201:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242516736 00000100:00100000:3.0:1788835264.688342:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 150 00000100:00100000:3.0:1788835264.688354:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:14870:x1875729242516736:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788835264.688490:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:14870:x1875729242516736:12345-192.168.203.22@tcp:501:ll_cfg_requeue.0 Request processed in 137us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835264.688499:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 150 00000100:00100000:2.0:1788835264.690124:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835264.690188:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242516864 00000100:00100000:3.0:1788835264.690194:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242516864 00000100:00100000:3.0:1788835264.690253:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 151 00000100:00100000:3.0:1788835264.690260:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:14870:x1875729242516864:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788835264.690390:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:14870:x1875729242516864:12345-192.168.203.22@tcp:503:ll_cfg_requeue.0 Request processed in 130us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835264.690397:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 151 10000000:01000000:2.0:1788835265.259568:0:17057:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788835265.259575:0:17057:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afc8239b800 from 13 10000000:01000000:2.0:1788835265.259579:0:17057:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788835265.259623:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80030e00/0xdf60171e5a5d31e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835265.259634:0:17057:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd80030e00/0xdf60171e5a5d31e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835265.259645:0:17057:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd80030e00/0xdf60171e5a5d31e0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835265.259669:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254127872:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788835265.259733:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835265.259769:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8109b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788835265.260162:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254127872 00000100:00100000:3.0:1788835265.260169:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254127872 00000100:00100000:3.0:1788835265.260224:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1788835265.260233:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+20:17057:x1875729254127872:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788835265.260245:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835265.260257:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdc204ac00/0xdf60171e5a5d31e7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d31e0 expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835265.260278:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdc204ac00/0xdf60171e5a5d31e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d31e0 expref: 21 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835265.260300:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdc204ac00/0xdf60171e5a5d31e7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d31e0 expref: 21 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835265.260309:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204ac00, rc 0) 00000100:00100000:3.0:1788835265.260371:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+21:17057:x1875729254127872:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835265.260377:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1788835265.261232:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fa680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254127872:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1788835265.261250:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd80030e00/0xdf60171e5a5d31e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d31e7 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835265.261273:0:17057:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd80030e00/0xdf60171e5a5d31e0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d31e7 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835265.261367:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254128000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1788835265.261402:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835265.261424:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2e0e600 going to sleep for 11 seconds 00000100:00100000:3.0:1788835265.261850:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254128000 00000100:00100000:3.0:1788835265.261856:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254128000 00000100:00100000:3.0:1788835265.261914:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788835265.261922:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+21:17057:x1875729254128000:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788835265.262280:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+21:17057:x1875729254128000:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 358us (876us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835265.262288:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1788835265.262348:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254128000:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1788835265.262379:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254128128:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788835265.262421:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835265.262446:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd81254a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788835265.262458:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254128128 00000100:00100000:3.0:1788835265.262461:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254128128 00000100:00100000:3.0:1788835265.262484:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788835265.262490:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+21:17057:x1875729254128128:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1788835265.262564:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+21:17057:x1875729254128128:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 73us (141us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835265.262570:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:3.0:1788835265.262613:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254128128:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1788835265.266600:0:20175:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788835265.266761:0:17057:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788835265.266785:0:17057:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788835265.266796:0:17057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80030e00/0xdf60171e5a5d31e0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d31e7 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835265.266819:0:17057:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd80030e00/0xdf60171e5a5d31e0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d31e7 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835265.266842:0:17057:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788835265.266844:0:17057:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afdc1d5c800 from 13 10000000:01000000:2.0:1788835265.266847:0:17057:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788835265.266888:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031600/0xdf60171e5a5d31ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835265.266896:0:17057:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd80031600/0xdf60171e5a5d31ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835265.266907:0:17057:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd80031600/0xdf60171e5a5d31ee lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835265.266931:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254128256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788835265.267002:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835265.267160:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8109b000 going to sleep for 11 seconds 00000100:00100000:3.0:1788835265.267526:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254128256 00000100:00100000:3.0:1788835265.267533:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254128256 00000100:00100000:3.0:1788835265.267605:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1788835265.267614:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+21:17057:x1875729254128256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1788835265.267627:0:17053:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835265.267641:0:17053:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdc204b400/0xdf60171e5a5d31f5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d31ee expref: -99 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835265.267662:0:17053:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdc204b400/0xdf60171e5a5d31f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d31ee expref: 22 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835265.267672:0:17053:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdc204b400/0xdf60171e5a5d31f5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d31ee expref: 22 pid: 17053 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835265.267680:0:17053:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204b400, rc 0) 00000100:00100000:3.0:1788835265.267730:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+22:17057:x1875729254128256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (728us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835265.267736:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1788835265.269435:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fa300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254128256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788835265.269456:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd80031600/0xdf60171e5a5d31ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d31f5 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835265.269467:0:17057:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd80031600/0xdf60171e5a5d31ee lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d31f5 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835265.269553:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254128384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788835265.269599:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835265.272165:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eace40 going to sleep for 11 seconds 00000100:00100000:2.0:1788835265.275173:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254128384 00000100:00100000:2.0:1788835265.275187:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254128384 00000100:00100000:2.0:1788835265.275241:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788835265.275251:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+22:17057:x1875729254128384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788835265.275435:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+22:17057:x1875729254128384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 185us (5835us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835265.275444:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1788835265.275513:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254128384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788835265.275558:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254128512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788835265.275601:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835265.275629:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8109b480 going to sleep for 11 seconds 00000100:00100000:2.0:1788835265.275645:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254128512 00000100:00100000:2.0:1788835265.275649:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254128512 00000100:00100000:2.0:1788835265.275666:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788835265.275672:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd83dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+22:17057:x1875729254128512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788835265.275745:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd83dc5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+22:17057:x1875729254128512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 72us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835265.275751:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1788835265.275790:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254128512:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788835265.281946:0:20178:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:2.0:1788835265.282041:0:17057:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:2.0:1788835265.282064:0:17057:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1788835265.282075:0:17057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80031600/0xdf60171e5a5d31ee lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d31f5 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835265.282086:0:17057:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd80031600/0xdf60171e5a5d31ee lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d31f5 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1788835265.282097:0:17057:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1788835265.282100:0:17057:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afd87f3f800 from 13 10000000:01000000:2.0:1788835265.282103:0:17057:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1788835265.282141:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80030000/0xdf60171e5a5d31fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835265.282148:0:17057:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afd80030000/0xdf60171e5a5d31fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835265.282160:0:17057:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afd80030000/0xdf60171e5a5d31fc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835265.282184:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254128640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1788835265.282253:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835265.282287:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8109bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788835265.282308:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254128640 00000100:00100000:2.0:1788835265.282330:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254128640 00000100:00100000:2.0:1788835265.282364:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788835265.282372:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86964050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+22:17057:x1875729254128640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788835265.282384:0:17055:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835265.282396:0:17055:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afd80030400/0xdf60171e5a5d3203 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d31fc expref: -99 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835265.282417:0:17055:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afd80030400/0xdf60171e5a5d3203 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d31fc expref: 23 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835265.282427:0:17055:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afd80030400/0xdf60171e5a5d3203 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d31fc expref: 23 pid: 17055 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835265.282436:0:17055:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd80030400, rc 0) 00000100:00100000:2.0:1788835265.282472:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86964050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+23:17057:x1875729254128640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 100us (218us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835265.282479:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1788835265.282535:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254128640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1788835265.282548:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afd80030000/0xdf60171e5a5d31fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d3203 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835265.282556:0:17057:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afd80030000/0xdf60171e5a5d31fc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d3203 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835265.282608:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254128768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788835265.282642:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835265.282659:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8109bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1788835265.282669:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254128768 00000100:00100000:2.0:1788835265.282673:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254128768 00000100:00100000:2.0:1788835265.282703:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788835265.282709:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86965450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+23:17057:x1875729254128768:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788835265.284183:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86965450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+23:17057:x1875729254128768:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 93us (160us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835265.284199:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1788835265.284274:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254128768:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1788835265.284333:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254128896:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1788835265.284386:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835265.284421:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc8109bb40 going to sleep for 11 seconds 00000100:00100000:0.0:1788835265.284577:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254128896 00000100:00100000:0.0:1788835265.284583:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254128896 00000100:00100000:0.0:1788835265.284613:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1788835265.284619:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+23:17057:x1875729254128896:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1788835265.284726:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86967c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+23:17057:x1875729254128896:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 106us (339us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835265.284733:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1788835265.286167:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254128896:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788835265.291205:0:20179:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:3.0:1788835265.292553:0:17057:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:3.0:1788835265.292585:0:17057:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1788835265.292596:0:17057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afd80030000/0xdf60171e5a5d31fc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d3203 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835265.292607:0:17057:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afd80030000/0xdf60171e5a5d31fc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d3203 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1788835265.292617:0:17057:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1788835265.292626:0:17057:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9afc8447d000 from 13 10000000:01000000:3.0:1788835265.292629:0:17057:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1788835265.292664:0:17057:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdc204ae00/0xdf60171e5a5d320a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835265.292672:0:17057:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.122@tcp lock: ffff9afdc204ae00/0xdf60171e5a5d320a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835265.292682:0:17057:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.122@tcp lock: ffff9afdc204ae00/0xdf60171e5a5d320a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835265.292706:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254129024:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1788835265.292766:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835265.292966:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd85234840 going to sleep for 11 seconds 00000100:00100000:1.0:1788835265.293890:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254129024 00000100:00100000:1.0:1788835265.293906:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254129024 00000100:00100000:1.0:1788835265.293971:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788835265.293979:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd86965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+23:17057:x1875729254129024:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788835265.293993:0:17054:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835265.294007:0:17054:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9afdc2167200/0xdf60171e5a5d3211 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xdf60171e5a5d320a expref: -99 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835265.294039:0:17054:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9afdc2167200/0xdf60171e5a5d3211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xdf60171e5a5d320a expref: 24 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835265.294050:0:17054:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9afdc2167200/0xdf60171e5a5d3211 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xdf60171e5a5d320a expref: 24 pid: 17054 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835265.294059:0:17054:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc2167200, rc 0) 00000100:00100000:1.0:1788835265.294115:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd86965050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+24:17057:x1875729254129024:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (1348us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835265.294123:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1788835265.294161:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845ffb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254129024:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1788835265.294176:0:17057:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.122@tcp lock: ffff9afdc204ae00/0xdf60171e5a5d320a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d3211 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835265.294185:0:17057:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.122@tcp lock: ffff9afdc204ae00/0xdf60171e5a5d320a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xdf60171e5a5d3211 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835265.294242:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254129152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788835265.294268:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835265.294278:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eac900 going to sleep for 11 seconds 00000100:00100000:1.0:1788835265.294294:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254129152 00000100:00100000:1.0:1788835265.294297:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254129152 00000100:00100000:1.0:1788835265.294311:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788835265.294342:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+24:17057:x1875729254129152:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788835265.294443:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+24:17057:x1875729254129152:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 101us (173us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835265.294459:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1788835265.294482:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254129152:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1788835265.294506:0:17057:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254129280:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788835265.294540:0:17057:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835265.294547:0:17057:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eac900 going to sleep for 11 seconds 00000100:00100000:1.0:1788835265.294561:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254129280 00000100:00100000:1.0:1788835265.294565:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254129280 00000100:00100000:1.0:1788835265.294580:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788835265.294585:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+24:17057:x1875729254129280:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1788835265.294651:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:cb888812-a79c-4531-9a69-89c757e37463+24:17057:x1875729254129280:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 65us (110us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835265.294658:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1788835265.294686:0:17057:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb95500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:cb888812-a79c-4531-9a69-89c757e37463:17057:1875729254129280:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1788835265.307563:0:20181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 13 00000020:01000000:1.0:1788835265.316775:0:17057:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 13-12 (rc=0) 10000000:01000000:1.0:1788835265.316815:0:17057:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.122@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1788835265.316827:0:17057:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.122@tcp lock: ffff9afdc204ae00/0xdf60171e5a5d320a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d3211 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835265.316839:0:17057:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.122@tcp lock: ffff9afdc204ae00/0xdf60171e5a5d320a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xdf60171e5a5d3211 expref: -99 pid: 17057 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835265.712619:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835266.144440:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835266.144486:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835266.144518:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835266.144549:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835266.144597:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835266.144622:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835266.144640:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835266.144661:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835266.144682:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835266.144712:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242517248 00000100:00100000:0.0:1788835266.144721:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242517248 00000100:00100000:0.0:1788835266.144770:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242517760 00000100:00100000:0.0:1788835266.144774:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242517760 00000100:00100000:0.0:1788835266.144804:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242517120 00000100:00100000:0.0:1788835266.144807:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242517120 00000100:00100000:0.0:1788835266.144818:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242517632 00000100:00100000:0.0:1788835266.144821:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242517632 00000100:00100000:0.0:1788835266.144853:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:0.0:1788835266.144862:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:509130d2-ab52-48a7-b813-2f954b790e9f+5:2387:x1875729242517248:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835266.144939:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:509130d2-ab52-48a7-b813-2f954b790e9f+5:2387:x1875729242517248:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 77us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835266.144957:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:0.0:1788835266.144974:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:0.0:1788835266.144981:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:2387:x1875729242517760:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835266.145022:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaaaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:2387:x1875729242517760:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 40us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835266.145028:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:0.0:1788835266.145041:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:0.0:1788835266.145047:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:509130d2-ab52-48a7-b813-2f954b790e9f+6:2387:x1875729242517120:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835266.145072:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:509130d2-ab52-48a7-b813-2f954b790e9f+6:2387:x1875729242517120:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 25us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835266.145078:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:0.0:1788835266.145089:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:0.0:1788835266.145095:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:2387:x1875729242517632:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835266.145116:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:2387:x1875729242517632:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 21us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835266.145122:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:0.0:1788835266.145141:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242517504 00000100:00100000:0.0:1788835266.145152:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242517504 00000100:00100000:0.0:1788835266.145180:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242518016 00000100:00100000:0.0:1788835266.145183:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242518016 00000100:00100000:0.0:1788835266.145194:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242517376 00000100:00100000:0.0:1788835266.145196:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242517376 00000100:00100000:0.0:1788835266.145207:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242517888 00000100:00100000:0.0:1788835266.145209:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242517888 00000100:00100000:0.0:1788835266.145221:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:0.0:1788835266.145227:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:509130d2-ab52-48a7-b813-2f954b790e9f+5:2387:x1875729242517504:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835266.145254:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:509130d2-ab52-48a7-b813-2f954b790e9f+5:2387:x1875729242517504:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835266.145260:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:0.0:1788835266.145270:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:0.0:1788835266.145276:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:2387:x1875729242518016:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835266.145295:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:2387:x1875729242518016:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 19us (707us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835266.145300:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:0.0:1788835266.145309:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:0.0:1788835266.145355:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:509130d2-ab52-48a7-b813-2f954b790e9f+5:2387:x1875729242517376:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835266.145376:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:509130d2-ab52-48a7-b813-2f954b790e9f+5:2387:x1875729242517376:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 61us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835266.145382:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:0.0:1788835266.145393:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:0.0:1788835266.145399:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:2387:x1875729242517888:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835266.145417:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaaa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:2387:x1875729242517888:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 19us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835266.145431:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00080000:0.0:1788835266.145450:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788835266.145454:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1788835266.145456:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788835266.145458:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:2.0:1788835266.145829:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242516992 00000100:00100000:2.0:1788835266.145834:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242516992 00000100:00100000:2.0:1788835266.145873:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 164 00000100:00100000:2.0:1788835266.145882:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd87f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:2387:x1875729242516992:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835266.145907:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd87f13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:2387:x1875729242516992:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 27us (1476us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835266.145912:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 164 00000100:00100000:2.0:1788835266.341949:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254129408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788835266.342306:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835266.342649:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254129664:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1788835266.342685:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835266.342762:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254129408 00000100:00100000:1.0:1788835266.342771:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254129408 00000100:00100000:1.0:1788835266.342825:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254129664 00000100:00100000:1.0:1788835266.342828:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254129664 00000100:00100000:1.0:1788835266.342849:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788835266.342868:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254129408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788835266.343272:0:18570:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788835266.343349:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90fad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254129408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 483us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835266.343357:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1788835266.343376:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1788835266.343383:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254129664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1788835266.343399:0:18570:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:1.0:1788835266.343429:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254129664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 47us (743us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835266.343435:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:0.0:1788835266.344263:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1788835266.344269:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1788835266.344312:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb95500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254129664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1788835266.344432:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254129536:0@lo:13:osp-pre-1-1.0 00000100:00100000:2.0:1788835266.344473:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835266.344528:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254129408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1788835266.344608:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254129920:0@lo:400:kworker.0 00000100:00100000:2.0:1788835266.344633:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835266.344675:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875729254130048:0@lo:400:kworker.0 00000100:00100000:2.0:1788835266.344699:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835266.344753:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254130432:0@lo:400:kworker.0 00000100:00100000:2.0:1788835266.344776:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835266.344818:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875729254130560:0@lo:400:kworker.0 00000100:00100000:2.0:1788835266.344839:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835266.344904:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729254130944:0@lo:400:kworker.0 00000100:00100000:2.0:1788835266.344928:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835266.345574:0:19148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254130048 00000100:00100000:3.0:1788835266.345581:0:19148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254130048 00000100:00100000:3.0:1788835266.345615:0:19148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254130432 00000100:00100000:3.0:1788835266.345618:0:19148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254130432 00000100:00100000:3.0:1788835266.345630:0:19148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254130560 00000100:00100000:3.0:1788835266.345632:0:19148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254130560 00000100:00100000:3.0:1788835266.345663:0:19148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254130944 00000100:00100000:3.0:1788835266.345666:0:19148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254130944 00000100:00100000:3.0:1788835266.345683:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788835266.345690:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875729254130048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835266.345751:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90fb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3615:x1875729254130048:12345-0@lo:400:kworker.0 Request processed in 61us (1050us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835266.345758:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1788835266.345774:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788835266.345780:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254130432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835266.345812:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90fa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3614:x1875729254130432:12345-0@lo:400:kworker.0 Request processed in 31us (1035us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835266.345830:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1788835266.345843:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788835266.345850:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875729254130560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835266.345881:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3615:x1875729254130560:12345-0@lo:400:kworker.0 Request processed in 32us (1041us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835266.345897:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788835266.345909:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788835266.345915:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729254130944:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1788835266.345950:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0001-lwp-OST0001_UUID+5:3614:x1875729254130944:12345-0@lo:400:kworker.0 Request processed in 26us (1012us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835266.345955:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1788835266.345978:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254129536 00000100:00100000:3.0:1788835266.345982:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254129536 00000100:00100000:1.0:1788835266.347185:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254129920 00000100:00100000:1.0:1788835266.347193:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254129920 00000100:00100000:1.0:1788835266.347246:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788835266.347255:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254129920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835266.347340:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90fbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254129920:12345-0@lo:400:kworker.0 Request processed in 60us (2679us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835266.347348:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1788835266.347383:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254130176:0@lo:400:kworker.0 00000100:00100000:1.0:1788835266.347418:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835266.347445:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729254130688:0@lo:400:kworker.0 00000100:00100000:1.0:1788835266.347468:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835266.347491:0:3616:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 3 async RPCs [3->2] 00000100:00100000:1.0:1788835266.347498:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb888812-a79c-4531-9a69-89c757e37463:3616:1875729254129792:0@lo:400:kworker.0 00000100:00100000:1.0:1788835266.347524:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835266.347565:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254130304:0@lo:400:kworker.0 00000100:00100000:1.0:1788835266.347592:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835266.347610:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875729254130816:0@lo:400:kworker.0 00000100:00100000:1.0:1788835266.347630:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835266.347658:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254130688 00000100:00100000:1.0:1788835266.347662:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254130688 00000100:00100000:1.0:1788835266.347688:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254130816 00000100:00100000:1.0:1788835266.347691:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254130816 00000100:00100000:1.0:1788835266.347708:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788835266.347715:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729254130688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835266.347750:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb94e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0000_UUID+5:3616:x1875729254130688:12345-0@lo:400:kworker.0 Request processed in 35us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835266.347757:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788835266.347768:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788835266.347774:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875729254130816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835266.347801:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb96300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3616:x1875729254130816:12345-0@lo:400:kworker.0 Request processed in 28us (170us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835266.347807:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1788835266.347828:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788835266.347836:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254129536:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788835266.347851:0:18570:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788835266.347882:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254129536:12345-0@lo:13:osp-pre-1-1.0 Request processed in 47us (3408us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835266.347888:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1788835266.347926:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3616:1875729254130816:0@lo:400:kworker.0 00010000:00080000:1.0:1788835266.347940:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb90f9c00 x1875729254130688/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835266.347969:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0000_UUID:3616:1875729254130688:0@lo:400:kworker.0 00000100:00100000:1.0:1788835266.348021:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3615:1875729254130560:0@lo:400:kworker.0 00000100:00100000:1.0:1788835266.348032:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3615:1875729254130048:0@lo:400:kworker.0 00000100:00100000:2.0:1788835266.348204:0:17053:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254129792 00000100:00100000:2.0:1788835266.348208:0:17053:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254129792 00000100:00100000:2.0:1788835266.348237:0:17053:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1788835266.348244:0:17053:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+24:3616:x1875729254129792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835266.348285:0:17053:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:cb888812-a79c-4531-9a69-89c757e37463+24:3616:x1875729254129792:12345-0@lo:400:kworker.0 Request processed in 41us (760us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835266.348292:0:17053:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:2.0:1788835266.348348:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788835266.348353:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00080000:2.0:1788835266.348356:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1788835266.348380:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afdb90f9180 x1875729254130944/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835282 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1788835266.348397:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0001_UUID:3614:1875729254130944:0@lo:400:kworker.0 00000100:00100000:2.0:1788835266.348410:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0001_UUID:3614:1875729254130432:0@lo:400:kworker.0 00000100:00100000:2.0:1788835266.348420:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254129920:0@lo:400:kworker.0 00000100:00100000:2.0:1788835266.348446:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90faa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:cb888812-a79c-4531-9a69-89c757e37463:3616:1875729254129792:0@lo:400:kworker.0 00000100:00100000:2.0:1788835266.348471:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254130176 00000100:00100000:2.0:1788835266.348474:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254130176 00000100:00100000:2.0:1788835266.348498:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788835266.348505:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254130176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835266.348540:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb94a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254130176:12345-0@lo:400:kworker.0 Request processed in 35us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835266.348546:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1788835266.348575:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254130176:0@lo:400:kworker.0 00000100:00100000:0.0:1788835266.348959:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254130304 00000100:00100000:0.0:1788835266.348964:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254130304 00000100:00100000:0.0:1788835266.349033:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788835266.349041:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254130304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1788835266.349099:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb95f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0001-mdtlov_UUID+5:3616:x1875729254130304:12345-0@lo:400:kworker.0 Request processed in 60us (1506us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835266.349106:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1788835266.349138:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-mdtlov_UUID:3616:1875729254130304:0@lo:400:kworker.0 00000100:00080000:2.0:1788835266.350309:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788835266.350676:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfaa8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254129536:0@lo:13:osp-pre-1-1.0 00010000:00010000:2.0:1788835266.725547:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835266.739906:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835266.740128:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242518144 00000100:00100000:2.0:1788835266.740138:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242518144 00000100:00100000:2.0:1788835266.740209:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:2.0:1788835266.740220:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc845ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+6:15538:x1875729242518144:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788835266.740239:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835266.740265:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d3218 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae09a0 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740378:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031000/0xdf60171e5a5d321f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740406:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031000/0xdf60171e5a5d321f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740419:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031000/0xdf60171e5a5d321f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740435:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030c00/0xdf60171e5a5d3226 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740443:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030c00/0xdf60171e5a5d3226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740450:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030c00/0xdf60171e5a5d3226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740579:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031e00/0xdf60171e5a5d322d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740588:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031e00/0xdf60171e5a5d322d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740597:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031e00/0xdf60171e5a5d322d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835266.740628:0:17061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788835266.740632:0:17061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788835266.740678:0:17061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031e00/0xdf60171e5a5d322d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740689:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031000/0xdf60171e5a5d321f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740707:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031000/0xdf60171e5a5d321f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740715:0:17061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031000/0xdf60171e5a5d321f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740721:0:17061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80031000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835266.740725:0:17061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031000/0xdf60171e5a5d321f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740732:0:17061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031000/0xdf60171e5a5d321f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740746:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc835cf000) 00010000:00010000:2.0:1788835266.740750:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835266.740754:0:17061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031000/0xdf60171e5a5d321f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740761:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031000/0xdf60171e5a5d321f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740775:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030c00/0xdf60171e5a5d3226 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740780:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030c00/0xdf60171e5a5d3226 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740785:0:17061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030c00/0xdf60171e5a5d3226 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740790:0:17061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80030c00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835266.740799:0:17061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030c00/0xdf60171e5a5d3226 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740806:0:17061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030c00/0xdf60171e5a5d3226 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740814:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9afdb2e5e800) 00010000:00010000:2.0:1788835266.740817:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835266.740821:0:17061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030c00/0xdf60171e5a5d3226 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740826:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030c00/0xdf60171e5a5d3226 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740858:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d3218 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09a0 expref: 8 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740872:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031e00/0xdf60171e5a5d322d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09a0 expref: 7 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.740879:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9afdb2e5e000) 00010000:00010000:2.0:1788835266.740882:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788835266.740898:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd80031e00, rc 0) 00000100:00100000:2.0:1788835266.740973:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc845ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+7:15538:x1875729242518144:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 755us (1088us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835266.740981:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:2.0:1788835266.744239:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835266.744382:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242518272 00000100:00100000:0.0:1788835266.744392:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242518272 00000100:00100000:0.0:1788835266.744443:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:0.0:1788835266.744452:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:509130d2-ab52-48a7-b813-2f954b790e9f+7:15538:x1875729242518272:12345-192.168.203.22@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1788835266.744529:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:509130d2-ab52-48a7-b813-2f954b790e9f+7:15538:x1875729242518272:12345-192.168.203.22@tcp:900:lhsmtool_posix.0 Request processed in 78us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835266.744537:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:0.0:1788835266.749936:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835266.751524:0:19148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242518528 00000100:00100000:1.0:1788835266.751542:0:19148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242518528 00000100:00100000:1.0:1788835266.751719:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:1.0:1788835266.751731:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+7:15538:x1875729242518528:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788835266.751753:0:19148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835266.751774:0:19148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d3234 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae09a7 expref: -99 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.751849:0:19148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d323b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.751863:0:19148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d323b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.751874:0:19148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d323b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.751950:0:19148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3242 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.751958:0:19148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3242 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.751984:0:19148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3242 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.758034:0:19148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166600/0xdf60171e5a5d3249 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.758057:0:19148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166600/0xdf60171e5a5d3249 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.758068:0:19148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166600/0xdf60171e5a5d3249 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835266.758079:0:19148:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 4096 00010000:00010000:1.0:1788835266.758234:0:19148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d323b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.758243:0:19148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d323b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.758250:0:19148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d323b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.758256:0:19148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc2166c00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835266.758260:0:19148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d323b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.758268:0:19148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d323b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.758281:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9afdb2e5e000) 00010000:00010000:1.0:1788835266.758285:0:19148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835266.758296:0:19148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d323b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.758303:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d323b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.758339:0:19148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3242 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.758346:0:19148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3242 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.758353:0:19148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3242 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.758358:0:19148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc2166000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835266.758361:0:19148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3242 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.758366:0:19148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3242 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.758373:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9afd84cf1500) 00010000:00010000:1.0:1788835266.758375:0:19148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835266.758378:0:19148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3242 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.758383:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3242 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.760263:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d3234 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09a7 expref: 10 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.760308:0:19148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166600/0xdf60171e5a5d3249 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09a7 expref: 9 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.760344:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afd84cf1a00) 00010000:00010000:1.0:1788835266.760347:0:19148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835266.760350:0:19148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc2166600, rc 0) 00000100:00100000:1.0:1788835266.760435:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+9:15538:x1875729242518528:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 8704us (10508us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1788835266.760444:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:3.0:1788835266.767973:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835266.768269:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242518656 00000100:00100000:0.0:1788835266.768279:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242518656 00000100:00100000:0.0:1788835266.768373:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:0.0:1788835266.768384:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+9:15538:x1875729242518656:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1788835266.768483:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+9:15538:x1875729242518656:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 Request processed in 101us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835266.768492:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:0.0:1788835266.774640:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835266.774739:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242518784 00000100:00100000:2.0:1788835266.774749:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242518784 00000100:00100000:2.0:1788835266.774809:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:2.0:1788835266.774833:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:509130d2-ab52-48a7-b813-2f954b790e9f+5:15538:x1875729242518784:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 00000004:00080000:0.0:1788835266.777703:0:17060:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0001: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0001 0, time 2828us 00000100:00100000:2.0:1788835266.802643:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:509130d2-ab52-48a7-b813-2f954b790e9f+5:15538:x1875729242518784:12345-192.168.203.22@tcp:59:lhsmtool_posix.0 Request processed in 27794us (28006us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835266.802657:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 26 00000100:00100000:3.0:1788835266.820788:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835266.820863:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242518912 00000100:00100000:0.0:1788835266.820872:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242518912 00000100:00100000:0.0:1788835266.820935:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:0.0:1788835266.820955:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+9:15544:x1875729242518912:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:0.0:1788835266.820975:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835266.821367:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669200/0xdf60171e5a5d3257 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae09ae expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821437:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d325e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821452:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d325e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821465:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d325e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821479:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669e00/0xdf60171e5a5d3265 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821498:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669e00/0xdf60171e5a5d3265 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821506:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669e00/0xdf60171e5a5d3265 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821548:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d325e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821556:0:17062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d325e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821564:0:17062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d325e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821570:0:17062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd81668c00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835266.821573:0:17062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d325e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821581:0:17062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d325e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821593:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc835cf000) 00010000:00010000:0.0:1788835266.821596:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835266.821601:0:17062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d325e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821607:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d325e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821620:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669e00/0xdf60171e5a5d3265 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821649:0:17062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669e00/0xdf60171e5a5d3265 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821655:0:17062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669e00/0xdf60171e5a5d3265 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821661:0:17062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd81669e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835266.821664:0:17062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669e00/0xdf60171e5a5d3265 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821670:0:17062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669e00/0xdf60171e5a5d3265 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821679:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9afc835ce900) 00010000:00010000:0.0:1788835266.821681:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835266.821684:0:17062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669e00/0xdf60171e5a5d3265 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821690:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669e00/0xdf60171e5a5d3265 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821725:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669200/0xdf60171e5a5d3257 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09ae expref: 10 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821735:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc835cf000) 00010000:00010000:0.0:1788835266.821737:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1788835266.821741:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669200/0xdf60171e5a5d3257 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09ae expref: 10 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.821761:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd81669200, rc 0) 00000100:00100000:0.0:1788835266.821826:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83eff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+9:15544:x1875729242518912:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 874us (1046us total) trans 0 rc 301/301 00000100:00100000:0.0:1788835266.821834:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 27 00000100:00100000:0.0:1788835266.831085:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835266.831226:0:17070:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242519040 00000100:00100000:1.0:1788835266.831236:0:17070:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242519040 00000100:00100000:1.0:1788835266.831291:0:17070:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:1.0:1788835266.831302:0:17070:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:509130d2-ab52-48a7-b813-2f954b790e9f+9:15544:x1875729242519040:12345-192.168.203.22@tcp:700:lfs.0 00000100:00100000:0.0:1788835266.834607:0:17070:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaaad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:509130d2-ab52-48a7-b813-2f954b790e9f+9:15544:x1875729242519040:12345-192.168.203.22@tcp:700:lfs.0 Request processed in 3297us (3521us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835266.834638:0:17070:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:2.0:1788835266.837232:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835266.837817:0:19148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242519296 00000100:00100000:1.0:1788835266.837827:0:19148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242519296 00000100:00100000:1.0:1788835266.837883:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:1.0:1788835266.837893:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+9:15544:x1875729242519296:12345-192.168.203.22@tcp:36:lfs.0 00010000:00010000:1.0:1788835266.837965:0:19148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835266.837992:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668800/0xdf60171e5a5d3185 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae091b expref: 9 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.838025:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc835cf000) 00010000:00010000:1.0:1788835266.838030:0:19148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788835266.838087:0:19148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d326c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.838129:0:19148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d31c4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae098b expref: 5 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.838139:0:19148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d326c lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.838172:0:19148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d31c4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae098b expref: 5 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.838187:0:19148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d31c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae098b expref: 5 pid: 17062 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835266.838202:0:19148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbfb96a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19148:1875729254131072:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788835266.838284:0:19148:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2eace40 going to sleep for 11 seconds 00000100:00100000:3.0:1788835266.840151:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835266.840265:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242519424 00000100:00100000:0.0:1788835266.840272:0:17047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242519424 00010000:00010000:0.0:1788835266.840341:0:17047:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d31c4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae098b expref: 6 pid: 17062 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835266.840370:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 15 00000100:00100000:0.0:1788835266.840378:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:2385:x1875729242519424:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788835266.840391:0:17047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835266.840396:0:17047:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d31c4 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae098b expref: 6 pid: 17062 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.840409:0:17047:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d31c4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae098b expref: 6 pid: 17062 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.840429:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc835cf000) 00010000:00010000:0.0:1788835266.840434:0:17047:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d326c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.840458:0:17047:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d326c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.840464:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d326c lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835266.840490:0:17047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1788835266.840528:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:2385:x1875729242519424:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 151us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835266.840536:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 15 00010000:00010000:1.0:1788835266.840893:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d31c4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae098b expref: 5 pid: 17062 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835266.840921:0:19148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbfb96a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:19148:1875729254131072:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788835266.840951:0:19148:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d326c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.840961:0:19148:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d326c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.840966:0:19148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d326c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.840990:0:19148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3273 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.841016:0:19148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3273 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.841025:0:19148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3273 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.844828:0:19148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d327a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.844850:0:19148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d327a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.844862:0:19148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d327a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788835266.844880:0:19148:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d398ea59 reply state 00000000349976f5 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d327a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.844892:0:19148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d327a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.844899:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9afd84cf1b00) 00010000:00010000:1.0:1788835266.844903:0:19148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788835266.844906:0:19148:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1788835266.845069:0:19148:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788835266.845079:0:19148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d326c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.845087:0:19148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d326c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.845093:0:19148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d326c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.845107:0:19148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc2167e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835266.845112:0:19148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d326c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.845130:0:19148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d326c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.845141:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afc835cf000) 00010000:00010000:1.0:1788835266.845144:0:19148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835266.845147:0:19148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d326c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.845152:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d326c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1788835266.845172:0:19148:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d398ea59 reply state 00000000349976f5 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3273 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.845181:0:19148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3273 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835266.845187:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9afd84cf1500) 00010000:00010000:1.0:1788835266.845189:0:19148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788835266.845191:0:19148:0:(service.c:179:ptlrpc_save_lock()) nlocks 1 00000100:00100000:1.0:1788835266.845279:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82074a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+10:15544:x1875729242519296:12345-192.168.203.22@tcp:36:lfs.0 Request processed in 7384us (8052us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1788835266.845288:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 28 00000100:00100000:3.0:1788835266.949369:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835266.949502:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242519552 00000100:00100000:2.0:1788835266.949512:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242519552 00000100:00100000:2.0:1788835266.949576:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:2.0:1788835266.949586:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+10:15552:x1875729242519552:12345-192.168.203.22@tcp:101:lctl.0 00010000:00010000:2.0:1788835266.949611:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835266.949632:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031000/0xdf60171e5a5d3281 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae09b5 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.949693:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030800/0xdf60171e5a5d3288 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.949707:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030800/0xdf60171e5a5d3288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.949719:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030800/0xdf60171e5a5d3288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835266.949758:0:17061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788835266.949761:0:17061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788835266.949797:0:17061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030800/0xdf60171e5a5d3288 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.949823:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031000/0xdf60171e5a5d3281 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09b5 expref: 12 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.949860:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030800/0xdf60171e5a5d3288 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09b5 expref: 11 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.949868:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afdb2e5e800) 00010000:00010000:2.0:1788835266.949871:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788835266.949875:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd80030800, rc 0) 00000100:00100000:2.0:1788835266.949960:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+11:15552:x1875729242519552:12345-192.168.203.22@tcp:101:lctl.0 Request processed in 375us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835266.949967:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 29 00000100:00100000:0.0:1788835266.994235:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835266.994380:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242519680 00000100:00100000:2.0:1788835266.994391:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242519680 00000100:00100000:2.0:1788835266.994454:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:2.0:1788835266.994464:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:15553:x1875729242519680:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788835266.994485:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835266.994505:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031000/0xdf60171e5a5d328f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae09bc expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.994579:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030c00/0xdf60171e5a5d3296 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.994593:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030c00/0xdf60171e5a5d3296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.994607:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030c00/0xdf60171e5a5d3296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835266.994649:0:17060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788835266.994666:0:17060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788835266.994691:0:17060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030c00/0xdf60171e5a5d3296 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.994718:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031000/0xdf60171e5a5d328f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09bc expref: 7 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.994735:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030c00/0xdf60171e5a5d3296 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09bc expref: 6 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835266.994743:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afdb2e5e800) 00010000:00010000:2.0:1788835266.994746:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788835266.994749:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd80030c00, rc 0) 00000100:00100000:2.0:1788835266.994811:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:15553:x1875729242519680:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 348us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835266.994818:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 30 00000100:00100000:3.0:1788835267.002278:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835267.002376:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242519808 00000100:00100000:2.0:1788835267.002386:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242519808 00000100:00100000:2.0:1788835267.002444:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:2.0:1788835267.002452:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:15553:x1875729242519808:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788835267.002469:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835267.002484:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031000/0xdf60171e5a5d329d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae09c3 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002539:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d32a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002550:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d32a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002571:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d32a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002579:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031800/0xdf60171e5a5d32ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002583:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031800/0xdf60171e5a5d32ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002587:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031800/0xdf60171e5a5d32ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002645:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d32b2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002649:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d32b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002653:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d32b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835267.002680:0:17061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:2.0:1788835267.002683:0:17061:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788835267.002696:0:17061:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d32b2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002703:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d32a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002708:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d32a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002720:0:17061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d32a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002724:0:17061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80030a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835267.002727:0:17061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d32a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002732:0:17061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d32a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002741:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afdb2e5e800) 00010000:00010000:2.0:1788835267.002743:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835267.002746:0:17061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d32a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002750:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80030a00/0xdf60171e5a5d32a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002758:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031800/0xdf60171e5a5d32ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002761:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031800/0xdf60171e5a5d32ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002764:0:17061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031800/0xdf60171e5a5d32ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002768:0:17061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd80031800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835267.002770:0:17061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031800/0xdf60171e5a5d32ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002779:0:17061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031800/0xdf60171e5a5d32ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002783:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9afd84cf1500) 00010000:00010000:2.0:1788835267.002785:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835267.002786:0:17061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031800/0xdf60171e5a5d32ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002789:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031800/0xdf60171e5a5d32ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002806:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd80031000/0xdf60171e5a5d329d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09c3 expref: 8 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002813:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d32b2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09c3 expref: 7 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.002817:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9afd84cf1b00) 00010000:00010000:2.0:1788835267.002818:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1788835267.002820:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5e00, rc 0) 00000100:00100000:2.0:1788835267.002870:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83effb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+7:15553:x1875729242519808:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 419us (600us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835267.002875:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 31 00000100:00100000:0.0:1788835267.009436:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835267.009578:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242519936 00000100:00100000:1.0:1788835267.009587:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242519936 00000100:00100000:1.0:1788835267.009646:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:1.0:1788835267.009671:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:15553:x1875729242519936:12345-192.168.203.22@tcp:900:lfs.0 00000100:00100000:1.0:1788835267.009759:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:15553:x1875729242519936:12345-192.168.203.22@tcp:900:lfs.0 Request processed in 91us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835267.009766:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:3.0:1788835267.016456:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835267.016612:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242520192 00000100:00100000:2.0:1788835267.016621:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242520192 00000100:00100000:2.0:1788835267.016681:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:2.0:1788835267.016691:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29ff5b29-0bb6-41bb-a110-0090199a3fb2+7:15553:x1875729242520192:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788835267.016725:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835267.016747:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d32b9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae09ca expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835267.016840:0:17060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788835267.016968:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d32b9 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09ca expref: 9 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.016982:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afdb2e5e800) 00010000:00010000:2.0:1788835267.016985:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788835267.016990:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d32b9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09ca expref: 9 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.017017:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f4a00, rc 0) 00000100:00100000:2.0:1788835267.017079:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29ff5b29-0bb6-41bb-a110-0090199a3fb2+8:15553:x1875729242520192:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 389us (632us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1788835267.017087:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 32 00000100:00100000:3.0:1788835267.020573:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835267.020953:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242520448 00000100:00100000:2.0:1788835267.020962:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242520448 00000100:00100000:2.0:1788835267.021021:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:2.0:1788835267.021030:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+8:15553:x1875729242520448:12345-192.168.203.22@tcp:36:lfs.0 00010000:00010000:2.0:1788835267.021078:0:17061:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835267.021103:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d32b2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09c3 expref: 8 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.021121:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9afd84cf1b00) 00010000:00010000:2.0:1788835267.021126:0:17061:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1788835267.021163:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d32c7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.021177:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d32c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.021186:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d32c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788835267.021658:0:17061:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000731bc8b6 reply state 00000000bd0bf43f transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d32c7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.021672:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d32c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.021678:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9afd84cf1b00) 00010000:00010000:2.0:1788835267.021680:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00000100:00100000:2.0:1788835267.021683:0:17061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1788835267.021690:0:17061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000100:00100000:2.0:1788835267.021768:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+9:15553:x1875729242520448:12345-192.168.203.22@tcp:36:lfs.0 Request processed in 738us (1202us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1788835267.021775:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 33 00000100:00100000:0.0:1788835267.026222:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835267.026442:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242520704 00000100:00100000:3.0:1788835267.026452:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242520704 00000100:00100000:3.0:1788835267.026503:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:3.0:1788835267.026513:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29ff5b29-0bb6-41bb-a110-0090199a3fb2+9:15553:x1875729242520704:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1788835267.026882:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29ff5b29-0bb6-41bb-a110-0090199a3fb2+10:15553:x1875729242520704:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 370us (669us total) trans 8589934597 rc 0/0 00000100:00100000:3.0:1788835267.026920:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:3.0:1788835267.049430:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835267.049663:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242520960 00000100:00100000:2.0:1788835267.049673:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242520960 00000100:00100000:2.0:1788835267.049733:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:2.0:1788835267.049743:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29ff5b29-0bb6-41bb-a110-0090199a3fb2+10:15553:x1875729242520960:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788835267.049767:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835267.049788:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d32ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae09d1 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.049857:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d32d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.049881:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d32d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.049905:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d32d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.049924:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d32dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.049932:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d32dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.050235:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d32dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835267.050373:0:17060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:2.0:1788835267.050443:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d32d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.050451:0:17060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d32d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.050458:0:17060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d32d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.050463:0:17060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835267.050467:0:17060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d32d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.050474:0:17060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d32d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.050496:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afdb2e5e800) 00010000:00010000:2.0:1788835267.050498:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835267.050503:0:17060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d32d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.050509:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d32d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.050521:0:17060:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d32dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.050528:0:17060:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d32dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.050534:0:17060:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d32dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.050538:0:17060:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835267.050541:0:17060:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d32dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.050546:0:17060:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d32dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.050552:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9afd84cf1500) 00010000:00010000:2.0:1788835267.050554:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835267.050557:0:17060:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d32dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.050563:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d32dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.050605:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d32ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09d1 expref: 12 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.050616:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afdb2e5e800) 00010000:00010000:2.0:1788835267.050618:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1788835267.050622:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d32ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09d1 expref: 12 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.050633:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5e00, rc 0) 00000100:00100000:2.0:1788835267.050691:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29ff5b29-0bb6-41bb-a110-0090199a3fb2+11:15553:x1875729242520960:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 950us (1271us total) trans 8589934598 rc 301/301 00000100:00100000:2.0:1788835267.050699:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 34 00000100:00100000:0.0:1788835267.054269:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835267.060638:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242521088 00000100:00100000:1.0:1788835267.060654:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242521088 00000100:00100000:1.0:1788835267.060763:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:1.0:1788835267.060774:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29ff5b29-0bb6-41bb-a110-0090199a3fb2+11:15553:x1875729242521088:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788835267.060799:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835267.060821:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d32ea lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae09d8 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.060930:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d32f1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.060953:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d32f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.060965:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d32f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835267.060989:0:17062:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788835267.060993:0:17062:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835267.061022:0:17062:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d32f1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.061048:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d32ea lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09d8 expref: 13 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.061088:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d32f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09d8 expref: 12 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.061097:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9afd84cf1b00) 00010000:00010000:1.0:1788835267.061099:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1788835267.061103:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc2166800, rc 0) 00000100:00100000:1.0:1788835267.061161:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:29ff5b29-0bb6-41bb-a110-0090199a3fb2+12:15553:x1875729242521088:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 390us (6902us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835267.061168:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 35 00000100:00100000:3.0:1788835267.071298:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835267.071430:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242521216 00000100:00100000:2.0:1788835267.071440:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242521216 00000100:00100000:2.0:1788835267.071491:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:2.0:1788835267.071502:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+12:15553:x1875729242521216:12345-192.168.203.22@tcp:37:lfs.0 00000100:00100000:2.0:1788835267.078785:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+12:15553:x1875729242521216:12345-192.168.203.22@tcp:37:lfs.0 Request processed in 7274us (7485us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835267.078798:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 3 00000100:00100000:0.0:1788835267.082741:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835267.082834:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242521472 00000100:00100000:3.0:1788835267.082843:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242521472 00000100:00100000:3.0:1788835267.082904:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:3.0:1788835267.082921:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83d15050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29ff5b29-0bb6-41bb-a110-0090199a3fb2+12:15553:x1875729242521472:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1788835267.083151:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83d15050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:29ff5b29-0bb6-41bb-a110-0090199a3fb2+13:15553:x1875729242521472:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 237us (417us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1788835267.083159:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 4 00000100:00100000:3.0:1788835267.136366:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835267.136516:0:19148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242521600 00000100:00100000:1.0:1788835267.136536:0:19148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242521600 00000100:00100000:1.0:1788835267.136596:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:1.0:1788835267.136606:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+11:15559:x1875729242521600:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:1.0:1788835267.136626:0:19148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835267.136647:0:19148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d32f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae09df expref: -99 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.136709:0:19148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d32ff lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.136723:0:19148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d32ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.136735:0:19148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d32ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.136747:0:19148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d3306 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.136768:0:19148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d3306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.136776:0:19148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d3306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.136846:0:19148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d330d lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.136855:0:19148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d330d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.136862:0:19148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d330d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835267.136908:0:19148:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00000004:00200000:1.0:1788835267.137156:0:19148:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835267.137197:0:19148:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d330d lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.137210:0:19148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d32ff lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.137216:0:19148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d32ff lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.137223:0:19148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d32ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.137230:0:19148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835267.137234:0:19148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d32ff lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.137248:0:19148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d32ff lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.137260:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afdb2e5e800) 00010000:00010000:1.0:1788835267.137263:0:19148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835267.137268:0:19148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d32ff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.137273:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d32ff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.137288:0:19148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d3306 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.137294:0:19148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d3306 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.137300:0:19148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d3306 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.137305:0:19148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835267.137307:0:19148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d3306 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.137362:0:19148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d3306 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.137370:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9afd84cf1500) 00010000:00010000:1.0:1788835267.137372:0:19148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835267.137375:0:19148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d3306 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.137391:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d3306 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.137418:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d32f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09df expref: 13 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.137433:0:19148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61200/0xdf60171e5a5d330d lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09df expref: 12 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.137441:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9afd84cf1b00) 00010000:00010000:1.0:1788835267.137443:0:19148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1788835267.137446:0:19148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61200, rc 0) 00000100:00100000:1.0:1788835267.137498:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+12:15559:x1875729242521600:12345-192.168.203.22@tcp:101:bash.0 Request processed in 894us (1185us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835267.137504:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 36 00000100:00100000:0.0:1788835267.140710:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835267.140788:0:17072:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242521728 00000100:00100000:1.0:1788835267.140797:0:17072:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242521728 00000100:00100000:1.0:1788835267.140851:0:17072:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:1.0:1788835267.140860:0:17072:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:509130d2-ab52-48a7-b813-2f954b790e9f+5:15559:x1875729242521728:12345-192.168.203.22@tcp:900:bash.0 00000100:00100000:1.0:1788835267.140968:0:17072:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:509130d2-ab52-48a7-b813-2f954b790e9f+5:15559:x1875729242521728:12345-192.168.203.22@tcp:900:bash.0 Request processed in 109us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835267.140976:0:17072:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:0.0:1788835267.144107:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835267.144290:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242521984 00000100:00100000:3.0:1788835267.144299:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242521984 00000100:00100000:3.0:1788835267.144387:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:3.0:1788835267.144397:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+12:15559:x1875729242521984:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:3.0:1788835267.144417:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835267.144439:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d3314 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae09e6 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.144804:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d331b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.144820:0:17061:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d32f1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09d8 expref: 12 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.144830:0:17061:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d331b lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.144870:0:17061:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d32f1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09d8 expref: 12 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.144883:0:17061:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d32f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09d8 expref: 12 pid: 17062 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835267.144897:0:17061:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc82076a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17061:1875729254131200:192.168.203.22@tcp:104: 00000100:00100000:2.0:1788835267.144990:0:17061:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2ef56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788835267.149514:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835267.149617:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242522112 00000100:00100000:1.0:1788835267.149626:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242522112 00010000:00010000:1.0:1788835267.149667:0:17046:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d32f1 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09d8 expref: 13 pid: 17062 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835267.149726:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 16 00000100:00100000:1.0:1788835267.149734:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+13:2386:x1875729242522112:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788835267.149749:0:17046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835267.149755:0:17046:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d32f1 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09d8 expref: 13 pid: 17062 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.149768:0:17046:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d32f1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 8 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09d8 expref: 13 pid: 17062 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.149789:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9afd84cf1b00) 00010000:00010000:1.0:1788835267.149794:0:17046:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d331b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.149803:0:17046:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d331b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.149810:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d331b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 8 type: IBT flags: 0x50290000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.149829:0:17046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788835267.149879:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+13:2386:x1875729242522112:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 145us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835267.149891:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 16 00010000:00010000:2.0:1788835267.151505:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d32f1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09d8 expref: 12 pid: 17062 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835267.151598:0:17061:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc82076a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:17061:1875729254131200:192.168.203.22@tcp:104: 00010000:00010000:2.0:1788835267.151621:0:17061:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d331b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.151631:0:17061:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d331b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.151637:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d331b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.151662:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d3322 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.151672:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d3322 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.151680:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d3322 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.152646:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d3329 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.152660:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d3329 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.152668:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d3329 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835267.152678:0:17061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788835267.152703:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d331b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.152710:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d331b lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.152717:0:17061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d331b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.152723:0:17061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5e00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835267.152727:0:17061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d331b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.152735:0:17061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d331b lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.152745:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9afd84cf1b00) 00010000:00010000:2.0:1788835267.152748:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1788835267.152751:0:17061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d331b lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.152771:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d331b lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1788835267.152785:0:17061:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bbe1aa9c reply state 000000009cc80baa transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d3322 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.152796:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d3322 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.152803:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9afdb2e5e500) 00010000:00010000:2.0:1788835267.152805:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:2.0:1788835267.152807:0:17061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1788835267.152843:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204bc00/0xdf60171e5a5d3314 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09e6 expref: 15 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.152858:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d3329 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09e6 expref: 14 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.152866:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:2.0:1788835267.152868:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1788835267.152870:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f4a00, rc 0) 00000100:00100000:2.0:1788835267.152965:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+15:15559:x1875729242521984:12345-192.168.203.22@tcp:101:bash.0 Request processed in 8569us (8866us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1788835267.152974:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 37 00000100:00100000:0.0:1788835267.167409:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835267.167496:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242522240 00000100:00100000:2.0:1788835267.167506:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242522240 00000100:00100000:2.0:1788835267.167562:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:2.0:1788835267.167572:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:509130d2-ab52-48a7-b813-2f954b790e9f+15:15559:x1875729242522240:12345-192.168.203.22@tcp:101:bash.0 00010000:00010000:2.0:1788835267.167605:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835267.167623:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d3337 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae09ed expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.167692:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d333e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.167705:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d333e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.167716:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d333e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835267.167756:0:17060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1788835267.167759:0:17060:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:2.0:1788835267.167775:0:17060:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d333e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.167784:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d333e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.167807:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d3337 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09ed expref: 17 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.167823:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d333e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09ed expref: 16 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.167831:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:2.0:1788835267.167834:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788835267.167837:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f4400, rc 0) 00000100:00100000:2.0:1788835267.167903:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:509130d2-ab52-48a7-b813-2f954b790e9f+16:15559:x1875729242522240:12345-192.168.203.22@tcp:101:bash.0 Request processed in 332us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835267.167910:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 38 00000100:00100000:0.0:1788835267.173204:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835267.173285:0:17063:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242522496 00000100:00100000:3.0:1788835267.173295:0:17063:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242522496 00000100:00100000:3.0:1788835267.173381:0:17063:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 5 00000100:00100000:3.0:1788835267.173392:0:17063:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:509130d2-ab52-48a7-b813-2f954b790e9f+16:15559:x1875729242522496:12345-192.168.203.22@tcp:35:bash.0 00000040:00080000:0.0:1788835267.174282:0:17814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1788835267.175818:0:17063:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:509130d2-ab52-48a7-b813-2f954b790e9f+17:15559:x1875729242522496:12345-192.168.203.22@tcp:35:bash.0 Request processed in 2422us (2617us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1788835267.175843:0:17063:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 5 00000040:00080000:3.0:1788835267.239740:0:17095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1788835267.283421:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835267.283573:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242522752 00000100:00100000:1.0:1788835267.283583:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242522752 00000100:00100000:1.0:1788835267.283643:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:1.0:1788835267.283652:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+17:15569:x1875729242522752:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:1.0:1788835267.283688:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835267.283708:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d3345 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae09f4 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835267.283802:0:17062:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 4096 00010000:00010000:1.0:1788835267.283908:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d3345 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09f4 expref: 19 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.283922:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9afdb2e5e800) 00010000:00010000:1.0:1788835267.283926:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788835267.283931:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d3345 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09f4 expref: 19 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.283956:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60200, rc 0) 00000100:00100000:1.0:1788835267.284015:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+18:15569:x1875729242522752:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 364us (603us total) trans 8589934602 rc 301/301 00000100:00100000:1.0:1788835267.284022:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 39 00000100:00100000:1.0:1788835267.287365:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835267.287488:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242523008 00000100:00100000:3.0:1788835267.287498:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242523008 00000100:00100000:3.0:1788835267.287559:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:3.0:1788835267.287569:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:509130d2-ab52-48a7-b813-2f954b790e9f+18:15569:x1875729242523008:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1788835267.287783:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb96a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:509130d2-ab52-48a7-b813-2f954b790e9f+19:15569:x1875729242523008:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 215us (435us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1788835267.287791:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 6 00000100:00100000:0.0:1788835267.346782:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835267.346871:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242523264 00000100:00100000:2.0:1788835267.346881:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242523264 00000100:00100000:2.0:1788835267.346960:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:2.0:1788835267.346969:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:509130d2-ab52-48a7-b813-2f954b790e9f+19:15572:x1875729242523264:12345-192.168.203.22@tcp:101:lfs.0 00010000:00010000:2.0:1788835267.346992:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835267.347206:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d3353 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae09fb expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.347305:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d335a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.347506:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d335a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.347519:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d335a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1788835267.347532:0:17060:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1788835267.347634:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5e00/0xdf60171e5a5d3353 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09fb expref: 22 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.347654:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d335a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09fb expref: 21 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.347663:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:2.0:1788835267.347666:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1788835267.347682:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f5600, rc 0) 00000100:00100000:2.0:1788835267.347781:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:509130d2-ab52-48a7-b813-2f954b790e9f+21:15572:x1875729242523264:12345-192.168.203.22@tcp:101:lfs.0 Request processed in 813us (1008us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1788835267.347789:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 40 00000100:00100000:1.0:1788835267.356956:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835267.357001:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835267.357075:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242523392 00000100:00100000:0.0:1788835267.357086:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242523392 00000100:00100000:0.0:1788835267.357141:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:0.0:1788835267.357151:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfb95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+21:15572:x1875729242523392:12345-192.168.203.22@tcp:54:lfs.0 00010000:00010000:0.0:1788835267.357226:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d3368 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835267.357242:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d3368 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835267.357254:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d3368 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835267.357291:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d3368 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835267.357299:0:17062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d3368 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835267.357306:0:17062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d3368 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835267.357359:0:17062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd81668c00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:0.0:1788835267.357364:0:17062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d3368 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835267.357372:0:17062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d3368 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835267.357383:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:0.0:1788835267.357387:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1788835267.357391:0:17062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d3368 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835267.357397:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d3368 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835267.357468:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfb95500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+21:15572:x1875729242523392:12345-192.168.203.22@tcp:54:lfs.0 Request processed in 318us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835267.357475:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 41 00000100:00100000:2.0:1788835267.357725:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242523520 00000100:00100000:2.0:1788835267.357730:0:17047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242523520 00000100:00100000:2.0:1788835267.357769:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:2.0:1788835267.357778:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:509130d2-ab52-48a7-b813-2f954b790e9f+21:2385:x1875729242523520:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835267.357789:0:17047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835267.357803:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d335a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09fb expref: 21 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.357817:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:2.0:1788835267.357820:0:17047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835267.357839:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90fb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:509130d2-ab52-48a7-b813-2f954b790e9f+20:2385:x1875729242523520:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 63us (838us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835267.357845:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:1.0:1788835267.361615:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835267.361737:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242523776 00000100:00100000:3.0:1788835267.361746:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242523776 00000100:00100000:3.0:1788835267.361792:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 7 00000100:00100000:3.0:1788835267.361801:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:509130d2-ab52-48a7-b813-2f954b790e9f+20:15572:x1875729242523776:12345-192.168.203.22@tcp:35:lfs.0 00000100:00100000:3.0:1788835267.362156:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90fa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:509130d2-ab52-48a7-b813-2f954b790e9f+21:15572:x1875729242523776:12345-192.168.203.22@tcp:35:lfs.0 Request processed in 355us (551us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1788835267.362164:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 7 00010000:00010000:3.0:1788835267.749533:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835267.757865:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835267.757945:0:19148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242524032 00000100:00100000:1.0:1788835267.757956:0:19148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242524032 00000100:00100000:1.0:1788835267.758020:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:1.0:1788835267.758031:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+21:15603:x1875729242524032:12345-192.168.203.22@tcp:101:cat.0 00010000:00010000:1.0:1788835267.758055:0:19148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835267.758075:0:19148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d336f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0a02 expref: -99 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.758195:0:19148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d3376 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.758209:0:19148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d3376 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.758220:0:19148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d3376 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835267.758230:0:19148:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788835267.758385:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d336f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a02 expref: 24 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.758403:0:19148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d3376 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a02 expref: 23 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.758411:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:1.0:1788835267.758414:0:19148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1788835267.758417:0:19148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e61800, rc 0) 00000100:00100000:1.0:1788835267.758473:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+23:15603:x1875729242524032:12345-192.168.203.22@tcp:101:cat.0 Request processed in 444us (618us total) trans 8589934606 rc 0/0 00000100:00100000:1.0:1788835267.758479:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 42 00000100:00100000:1.0:1788835267.762837:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835267.762918:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242524288 00000100:00100000:3.0:1788835267.762927:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242524288 00000100:00100000:3.0:1788835267.763003:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:3.0:1788835267.763014:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:509130d2-ab52-48a7-b813-2f954b790e9f+23:15603:x1875729242524288:12345-192.168.203.22@tcp:35:cat.0 00000100:00100000:3.0:1788835267.763303:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:509130d2-ab52-48a7-b813-2f954b790e9f+24:15603:x1875729242524288:12345-192.168.203.22@tcp:35:cat.0 Request processed in 290us (473us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1788835267.763348:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 8 00000100:00100000:0.0:1788835267.767273:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835267.767648:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242524416 00000100:00100000:1.0:1788835267.767658:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242524416 00000100:00100000:1.0:1788835267.767747:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:1.0:1788835267.767758:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:509130d2-ab52-48a7-b813-2f954b790e9f+24:2385:x1875729242524416:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1788835267.767787:0:17046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835267.767820:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d3376 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a02 expref: 24 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.767839:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:1.0:1788835267.767843:0:17046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1788835267.767903:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844aa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:509130d2-ab52-48a7-b813-2f954b790e9f+23:2385:x1875729242524416:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 147us (642us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835267.767910:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:1.0:1788835267.807687:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835267.807789:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242524672 00000100:00100000:0.0:1788835267.807799:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242524672 00000100:00100000:0.0:1788835267.807861:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:0.0:1788835267.807871:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+23:15609:x1875729242524672:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:0.0:1788835267.807896:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835267.807915:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668800/0xdf60171e5a5d3384 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0a09 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835267.808040:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669200/0xdf60171e5a5d338b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835267.808055:0:17062:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d3329 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09e6 expref: 24 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835267.808063:0:17062:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d333e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09ed expref: 24 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835267.808071:0:17062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669200/0xdf60171e5a5d338b lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835267.808101:0:17062:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d333e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09ed expref: 24 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835267.808132:0:17062:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d333e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09ed expref: 24 pid: 17060 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835267.808145:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17062:1875729254131328:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788835267.808232:0:17062:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d3329 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09e6 expref: 24 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835267.808241:0:17062:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d3329 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09e6 expref: 24 pid: 17061 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835267.808250:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc844ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17062:1875729254131456:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788835267.808272:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2e0e540 going to sleep for 11 seconds 00000100:00100000:0.0:1788835267.815473:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835267.815511:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835267.815593:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242524800 00000100:00100000:2.0:1788835267.815602:0:17047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242524800 00010000:00010000:2.0:1788835267.815642:0:17047:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d333e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09ed expref: 25 pid: 17060 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835267.815682:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242524928 00000100:00100000:2.0:1788835267.815686:0:17047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242524928 00010000:00010000:2.0:1788835267.815700:0:17047:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d3329 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09e6 expref: 26 pid: 17061 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835267.815723:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:2.0:1788835267.815746:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:509130d2-ab52-48a7-b813-2f954b790e9f+26:2386:x1875729242524800:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835267.815761:0:17047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835267.815768:0:17047:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d333e lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09ed expref: 26 pid: 17060 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.815781:0:17047:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d333e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09ed expref: 26 pid: 17060 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.815802:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:2.0:1788835267.815807:0:17047:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669200/0xdf60171e5a5d338b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.815817:0:17047:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669200/0xdf60171e5a5d338b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.815823:0:17047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835267.815875:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:509130d2-ab52-48a7-b813-2f954b790e9f+26:2386:x1875729242524800:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 130us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835267.815893:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 17 00000100:00100000:2.0:1788835267.815925:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 18 00000100:00100000:2.0:1788835267.815944:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbc364c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:509130d2-ab52-48a7-b813-2f954b790e9f+25:2386:x1875729242524928:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835267.815952:0:17047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835267.815958:0:17047:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d3329 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09e6 expref: 25 pid: 17061 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.815968:0:17047:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d3329 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09e6 expref: 25 pid: 17061 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.815990:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:2.0:1788835267.816004:0:17047:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669200/0xdf60171e5a5d338b lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.816012:0:17047:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669200/0xdf60171e5a5d338b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.816019:0:17047:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669200/0xdf60171e5a5d338b lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.816036:0:17047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835267.816056:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbc364c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:509130d2-ab52-48a7-b813-2f954b790e9f+25:2386:x1875729242524928:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 124us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835267.816062:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 18 00010000:00010000:1.0:1788835267.817266:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4400/0xdf60171e5a5d333e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09ed expref: 24 pid: 17060 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835267.817287:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844a8000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17062:1875729254131328:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788835267.817299:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4a00/0xdf60171e5a5d3329 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae09e6 expref: 23 pid: 17061 timeout: 609 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835267.817309:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc844ab100 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17062:1875729254131456:192.168.203.22@tcp:104: 00010000:00010000:1.0:1788835267.817376:0:17062:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669200/0xdf60171e5a5d338b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.817386:0:17062:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669200/0xdf60171e5a5d338b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.817392:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669200/0xdf60171e5a5d338b lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835267.817427:0:17062:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788835267.817571:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668800/0xdf60171e5a5d3384 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a09 expref: 24 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.817587:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669200/0xdf60171e5a5d338b lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a09 expref: 23 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.817594:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:1.0:1788835267.817597:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1788835267.817600:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd81669200, rc 0) 00000100:00100000:1.0:1788835267.817640:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+23:15609:x1875729242524672:12345-192.168.203.22@tcp:101:dd.0 Request processed in 9771us (9963us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1788835267.817648:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 43 00000100:00100000:0.0:1788835267.820548:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835267.820618:0:19148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242525056 00000100:00100000:1.0:1788835267.820626:0:19148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242525056 00000100:00100000:1.0:1788835267.820681:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:1.0:1788835267.820690:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+23:15609:x1875729242525056:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:1.0:1788835267.820713:0:19148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835267.820732:0:19148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d3399 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0a10 expref: -99 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.820764:0:19148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d33a0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.820777:0:19148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d33a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.820803:0:19148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d33a0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.820910:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d3399 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a10 expref: 25 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.820927:0:19148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d33a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a10 expref: 24 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.820947:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:1.0:1788835267.820950:0:19148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1788835267.820953:0:19148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdb2e60800, rc 0) 00000100:00100000:1.0:1788835267.821207:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+24:15609:x1875729242525056:12345-192.168.203.22@tcp:101:dd.0 Request processed in 516us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835267.821215:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 44 00000100:00100000:3.0:1788835267.827356:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835267.827432:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242525312 00000100:00100000:1.0:1788835267.827442:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242525312 00000100:00100000:1.0:1788835267.827492:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 45 00000100:00100000:1.0:1788835267.827500:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+24:15609:x1875729242525312:12345-192.168.203.22@tcp:36:dd.0 00010000:00010000:1.0:1788835267.827720:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d33a7 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.827737:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d33a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.827747:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d33a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788835267.827805:0:17061:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:1.0:1788835267.827839:0:17061:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000000ee742b reply state 00000000d9e03ad7 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d33a7 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.827851:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d33a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.827857:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:1.0:1788835267.827860:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:1.0:1788835267.827863:0:17061:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1788835267.833449:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+27:15609:x1875729242525312:12345-192.168.203.22@tcp:36:dd.0 Request processed in 5936us (6090us total) trans 8589934610 rc 0/0 00000100:00100000:1.0:1788835267.833460:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 45 00000020:00080000:1.0:1788835267.833468:0:17061:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788835267.837641:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835267.840139:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242525440 00000100:00100000:1.0:1788835267.840153:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242525440 00000100:00100000:1.0:1788835267.840268:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:1.0:1788835267.840279:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:509130d2-ab52-48a7-b813-2f954b790e9f+27:15609:x1875729242525440:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:1.0:1788835267.840302:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835267.840360:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d33ae lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0a17 expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.840415:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d33ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a17 expref: 28 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.840430:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d33ae lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a17 expref: 28 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.840470:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:1.0:1788835267.840473:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788835267.840476:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc2166800, rc 0) 00000100:00100000:1.0:1788835267.840536:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83eff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:509130d2-ab52-48a7-b813-2f954b790e9f+28:15609:x1875729242525440:12345-192.168.203.22@tcp:101:dd.0 Request processed in 259us (2904us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835267.840543:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 46 00000100:00100000:3.0:1788835267.861770:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835267.862192:0:17047:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242525696 00000100:00100000:2.0:1788835267.862202:0:17047:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242525696 00000100:00100000:2.0:1788835267.862362:0:17047:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:2.0:1788835267.862373:0:17047:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:509130d2-ab52-48a7-b813-2f954b790e9f+28:15609:x1875729242525696:12345-192.168.203.22@tcp:103:dd.0 00010000:00010000:2.0:1788835267.862389:0:17047:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835267.862414:0:17047:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d33ae lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a17 expref: 28 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835267.862436:0:17047:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:2.0:1788835267.862440:0:17047:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835267.862486:0:17047:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:509130d2-ab52-48a7-b813-2f954b790e9f+27:15609:x1875729242525696:12345-192.168.203.22@tcp:103:dd.0 Request processed in 115us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835267.862493:0:17047:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 2 00000100:00100000:0.0:1788835267.864176:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835267.864408:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242525824 00000100:00100000:3.0:1788835267.864416:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242525824 00000100:00100000:3.0:1788835267.864475:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:3.0:1788835267.864484:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+27:15609:x1875729242525824:12345-192.168.203.22@tcp:58:dd.0 00010000:00010000:3.0:1788835267.864587:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d33b5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835267.864603:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d33b5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835267.864615:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d33b5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1788835267.868918:0:17062:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1788835267.869224:0:17062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1788835267.870185:0:17062:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1788835267.870379:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+27:15609:x1875729242525824:12345-192.168.203.22@tcp:58:dd.0 Request processed in 5891us (6206us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835267.870391:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 47 00000100:00100000:0.0:1788835267.877479:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835267.877566:0:19148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242525952 00000100:00100000:1.0:1788835267.877576:0:19148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242525952 00000100:00100000:1.0:1788835267.877637:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 48 00000100:00100000:1.0:1788835267.877647:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+27:15609:x1875729242525952:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:1.0:1788835267.877670:0:19148:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835267.877691:0:19148:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d33bc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0a1e expref: -99 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.877746:0:19148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d33b5 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.877758:0:19148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d33bc lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a1e expref: 28 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.877776:0:19148:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d33b5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.877788:0:19148:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d33bc lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a1e expref: 28 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.877800:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:1.0:1788835267.877816:0:19148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788835267.877821:0:19148:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d33bc lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a1e expref: 28 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835267.877829:0:19148:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc2167e00, rc 0) 00000100:00100000:1.0:1788835267.877892:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+28:15609:x1875729242525952:12345-192.168.203.22@tcp:101:dd.0 Request processed in 247us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835267.877899:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 48 00000040:00080000:3.0:1788835268.261534:0:17095:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1788835268.261543:0:17095:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1788835268.261613:0:17095:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1788835268.261623:0:17095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788835268.261921:0:17095:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83efdc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17095:1875729254131584:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1788835268.262215:0:17095:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd81254a80 going to sleep for 11 seconds 00000100:00100000:0.0:1788835268.274207:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835268.275902:0:17095:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83efdc00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:17095:1875729254131584:192.168.203.22@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1788835268.282784:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242526080 00000100:00100000:1.0:1788835268.282802:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242526080 00000100:00100000:1.0:1788835268.283051:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:1.0:1788835268.283065:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+28:15610:x1875729242526080:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1788835268.283097:0:17061:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1788835268.283226:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+28:15610:x1875729242526080:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 165us (9030us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835268.283234:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 49 00000100:00100000:3.0:1788835268.291051:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835268.291343:0:19148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242526208 00000100:00100000:1.0:1788835268.291354:0:19148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242526208 00000100:00100000:1.0:1788835268.291412:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:1.0:1788835268.291422:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+28:15610:x1875729242526208:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1788835268.291493:0:19148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d33c3 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.291509:0:19148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d33c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.291523:0:19148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d33c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1788835268.292533:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1788835268.296920:0:19148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d33ca lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.296954:0:19148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d33ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.296969:0:19148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d33ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297030:0:19148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d33d1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297041:0:19148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d33d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297048:0:19148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d33d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835268.297105:0:19148:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1788835268.297110:0:19148:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:1.0:1788835268.297125:0:19148:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d33d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297137:0:19148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d33c3 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297145:0:19148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d33c3 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297152:0:19148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d33c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297170:0:19148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc2166800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835268.297174:0:19148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d33c3 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297182:0:19148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d33c3 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297195:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afd84cf1a00) 00010000:00010000:1.0:1788835268.297198:0:19148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835268.297202:0:19148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d33c3 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297208:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166800/0xdf60171e5a5d33c3 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297226:0:19148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d33ca lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297232:0:19148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d33ca lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297238:0:19148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d33ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297243:0:19148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e61800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835268.297246:0:19148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d33ca lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297252:0:19148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d33ca lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297267:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9afd84cf1300) 00010000:00010000:1.0:1788835268.297269:0:19148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835268.297272:0:19148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d33ca lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297278:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e61800/0xdf60171e5a5d33ca lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297292:0:19148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d33d1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297297:0:19148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d33d1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297303:0:19148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d33d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297308:0:19148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdaf321a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835268.297311:0:19148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d33d1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297333:0:19148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d33d1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297339:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:1.0:1788835268.297341:0:19148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835268.297344:0:19148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d33d1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.297349:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d33d1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835268.297443:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+28:15610:x1875729242526208:12345-192.168.203.22@tcp:34:lhsmtool_posix.0 Request processed in 6019us (6399us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835268.297452:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 50 00000100:00100000:0.0:1788835268.303351:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835268.303714:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242526464 00000100:00100000:1.0:1788835268.303725:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242526464 00000100:00100000:1.0:1788835268.303788:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:1.0:1788835268.303799:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+28:15610:x1875729242526464:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788835268.303820:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835268.303841:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf320200/0xdf60171e5a5d33d8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0a25 expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.304356:0:17061:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d33df lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT flags: 0x40000000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.304373:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d33df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.304386:0:17061:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d33df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1788835268.304397:0:17061:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1788835268.304473:0:17061:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d33df lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.304480:0:17061:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d33df lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x50210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.304487:0:17061:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d33df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.304509:0:17061:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdaf321800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835268.304514:0:17061:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d33df lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.304521:0:17061:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d33df lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x40218400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.304534:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:1.0:1788835268.304537:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788835268.304542:0:17061:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d33df lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.304548:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d33df lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 7 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.304665:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf320200/0xdf60171e5a5d33d8 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a25 expref: 30 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.304735:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9afd84cf1a00) 00010000:00010000:1.0:1788835268.304738:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1788835268.304742:0:17061:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf320200/0xdf60171e5a5d33d8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a25 expref: 30 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.304753:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdaf320200, rc 0) 00000100:00100000:1.0:1788835268.304821:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+29:15610:x1875729242526464:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 1024us (1510us total) trans 8589934611 rc 301/301 00000100:00100000:1.0:1788835268.304829:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 51 00000100:00100000:0.0:1788835268.312499:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835268.313498:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242526592 00000100:00100000:3.0:1788835268.313517:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242526592 00000100:00100000:3.0:1788835268.313681:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:3.0:1788835268.313695:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc844a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:509130d2-ab52-48a7-b813-2f954b790e9f+29:15610:x1875729242526592:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1788835268.313743:0:17060:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1788835268.313923:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc844a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:509130d2-ab52-48a7-b813-2f954b790e9f+29:15610:x1875729242526592:12345-192.168.203.22@tcp:53:lhsmtool_posix.0 Request processed in 230us (1434us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835268.313942:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 52 00000100:00100000:3.0:1788835268.320724:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835268.320856:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242526848 00000100:00100000:0.0:1788835268.320869:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242526848 00000100:00100000:0.0:1788835268.320957:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:0.0:1788835268.320969:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+29:15610:x1875729242526848:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788835268.321006:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835268.321051:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669400/0xdf60171e5a5d33ed lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0a2c expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1788835268.321613:0:17062:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000401:0x6:0x0], count =28 00000004:00080000:0.0:1788835268.321623:0:17062:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000401:0x6:0x0]+28 in llog 00000004:00080000:0.0:1788835268.321647:0:17062:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x280000401:0x22:0x0], index 0: 0 00010000:00010000:0.0:1788835268.321838:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669800/0xdf60171e5a5d33f4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.321855:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669800/0xdf60171e5a5d33f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.321868:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669800/0xdf60171e5a5d33f4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.321950:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669400/0xdf60171e5a5d33ed lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a2c expref: 32 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.321976:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669800/0xdf60171e5a5d33f4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a2c expref: 31 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.321985:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afc835ce900) 00010000:00010000:0.0:1788835268.321988:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1788835268.321991:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd81669800, rc 0) 00000100:00100000:0.0:1788835268.322084:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+31:15610:x1875729242526848:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 1117us (1375us total) trans 8589934612 rc 0/0 00000100:00100000:0.0:1788835268.322092:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 53 00000100:00100000:0.0:1788835268.329581:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835268.329683:0:19148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242527104 00000100:00100000:1.0:1788835268.329712:0:19148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242527104 00000100:00100000:1.0:1788835268.329785:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:1.0:1788835268.329797:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+31:15610:x1875729242527104:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788835268.329886:0:19148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835268.329926:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669800/0xdf60171e5a5d33f4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a2c expref: 31 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.329963:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afc835ce900) 00010000:00010000:1.0:1788835268.329975:0:19148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788835268.330018:0:19148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf320200/0xdf60171e5a5d3402 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.330041:0:19148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf320200/0xdf60171e5a5d3402 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.330054:0:19148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf320200/0xdf60171e5a5d3402 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.330081:0:19148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d3409 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xeb2f6cb6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.330089:0:19148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d3409 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeb2f6cb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.330095:0:19148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d3409 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeb2f6cb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.330154:0:19148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf320200/0xdf60171e5a5d3402 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.330161:0:19148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf320200/0xdf60171e5a5d3402 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.330179:0:19148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf320200/0xdf60171e5a5d3402 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.330186:0:19148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdaf320200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835268.330191:0:19148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf320200/0xdf60171e5a5d3402 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.330200:0:19148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf320200/0xdf60171e5a5d3402 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.330209:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9afd84cf1b00) 00010000:00010000:1.0:1788835268.330212:0:19148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835268.330216:0:19148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf320200/0xdf60171e5a5d3402 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.330223:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf320200/0xdf60171e5a5d3402 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.330233:0:19148:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d3409 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeb2f6cb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.330239:0:19148:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d3409 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeb2f6cb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.330245:0:19148:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d3409 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeb2f6cb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.330250:0:19148:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdaf321800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835268.330253:0:19148:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d3409 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeb2f6cb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.330269:0:19148:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d3409 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xeb2f6cb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.330278:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xeb2f6cb6 (ffff9afd84cf1300) 00010000:00010000:1.0:1788835268.330280:0:19148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835268.330283:0:19148:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d3409 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xeb2f6cb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.330289:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d3409 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xeb2f6cb6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835268.330460:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+30:15610:x1875729242527104:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 663us (890us total) trans 0 rc -2/-2 00000100:00100000:1.0:1788835268.330467:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 54 00000100:00100000:2.0:1788835268.334511:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835268.337703:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242527232 00000100:00100000:0.0:1788835268.337754:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242527232 00000100:00100000:0.0:1788835268.337855:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:0.0:1788835268.337870:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+30:15610:x1875729242527232:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788835268.337900:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835268.337944:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669400/0xdf60171e5a5d3410 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0a33 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.338136:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668200/0xdf60171e5a5d3417 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.338153:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668200/0xdf60171e5a5d3417 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.338166:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668200/0xdf60171e5a5d3417 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.338308:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669400/0xdf60171e5a5d3410 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a33 expref: 32 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.338685:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668200/0xdf60171e5a5d3417 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a33 expref: 31 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.338696:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afc835ce700) 00010000:00010000:0.0:1788835268.338700:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1788835268.338704:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd81668200, rc 0) 00000100:00100000:0.0:1788835268.338838:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82076a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+31:15610:x1875729242527232:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 972us (4343us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835268.338847:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 55 00000100:00100000:3.0:1788835268.349127:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835268.349236:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242527488 00000100:00100000:2.0:1788835268.349249:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242527488 00000100:00100000:2.0:1788835268.349471:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:2.0:1788835268.349484:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:509130d2-ab52-48a7-b813-2f954b790e9f+31:15610:x1875729242527488:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1788835268.349603:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d341e lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.349623:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d341e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.349639:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d341e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1788835268.349865:0:17060:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].2, 88 off8344 00000004:00080000:2.0:1788835268.349890:0:17060:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 510391573463ns, next at 511391557568ns, rc = 0 00000004:00010000:2.0:1788835268.349966:0:17060:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008e6c4e05 reply state 00000000740b7e28 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d341e lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.349982:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d341e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.350001:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afc835ce700) 00010000:00010000:2.0:1788835268.350005:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00000100:00100000:2.0:1788835268.350009:0:17060:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1788835268.350145:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:509130d2-ab52-48a7-b813-2f954b790e9f+33:15610:x1875729242527488:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 662us (1033us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1788835268.350153:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 56 00000100:00100000:2.0:1788835268.358015:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835268.358154:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242527616 00000100:00100000:1.0:1788835268.358166:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242527616 00000100:00100000:1.0:1788835268.358244:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:1.0:1788835268.358256:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc82075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+33:15610:x1875729242527616:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1788835268.358289:0:17061:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1788835268.358365:0:17061:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d3425 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0a3a expref: -99 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.358440:0:17061:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d3425 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a3a expref: 34 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.358456:0:17061:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d3425 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a3a expref: 34 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.358496:0:17061:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afc835ce700) 00010000:00010000:1.0:1788835268.358499:0:17061:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1788835268.358504:0:17061:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdaf321800, rc 0) 00000100:00100000:1.0:1788835268.358812:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc82075c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+34:15610:x1875729242527616:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 555us (817us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835268.358820:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 57 00000100:00100000:3.0:1788835268.362721:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835268.362937:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242527744 00000100:00100000:1.0:1788835268.362950:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242527744 00000100:00100000:1.0:1788835268.363042:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:1.0:1788835268.363055:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:509130d2-ab52-48a7-b813-2f954b790e9f+5:2385:x1875729242527744:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1788835268.363450:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1788835268.363706:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:509130d2-ab52-48a7-b813-2f954b790e9f+6:2385:x1875729242527744:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 651us (995us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1788835268.363717:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:3.0:1788835268.373540:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835268.373824:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242528000 00000100:00100000:2.0:1788835268.373838:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242528000 00000100:00100000:2.0:1788835268.373925:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1788835268.373948:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:509130d2-ab52-48a7-b813-2f954b790e9f+34:15610:x1875729242528000:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1788835268.374284:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83eff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:509130d2-ab52-48a7-b813-2f954b790e9f+35:15610:x1875729242528000:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 337us (757us total) trans 8589934614 rc 0/0 00000100:00100000:2.0:1788835268.374293:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 9 00000100:00100000:2.0:1788835268.386481:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835268.386668:0:19148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242528256 00000100:00100000:1.0:1788835268.386682:0:19148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242528256 00000100:00100000:1.0:1788835268.386759:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:1.0:1788835268.386771:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+35:15610:x1875729242528256:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788835268.386953:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+35:15610:x1875729242528256:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 184us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835268.386961:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 58 00000100:00100000:1.0:1788835268.389680:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254131712:0@lo:13:osp-pre-0-1.0 00000100:00100000:1.0:1788835268.389775:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835268.390442:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835268.397892:0:18570:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254131712 00000100:00100000:3.0:1788835268.397910:0:18570:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254131712 00000100:00100000:3.0:1788835268.398025:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788835268.398037:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254131712:12345-0@lo:13:osp-pre-0-1.0 00002000:00000024:3.0:1788835268.398083:0:18570:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923513344 avail 3691991040 00000100:00100000:3.0:1788835268.398195:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90faa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3615:x1875729254131712:12345-0@lo:13:osp-pre-0-1.0 Request processed in 161us (8420us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835268.398203:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1788835268.398274:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0001-mdtlov_UUID:3615:1875729254131712:0@lo:13:osp-pre-0-1.0 00000100:00080000:2.0:1788835268.398419:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788835268.399954:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242528384 00000100:00100000:0.0:1788835268.399989:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242528384 00000100:00100000:0.0:1788835268.400115:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:0.0:1788835268.400127:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+35:15610:x1875729242528384:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1788835268.400152:0:17062:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1788835268.400179:0:17062:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669400/0xdf60171e5a5d342c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0a41 expref: -99 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.400269:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668000/0xdf60171e5a5d3433 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.400287:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668000/0xdf60171e5a5d3433 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.400302:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668000/0xdf60171e5a5d3433 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1788835268.400392:0:17062:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 2 00000004:00010000:0.0:1788835268.400417:0:17062:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668000/0xdf60171e5a5d3433 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.400452:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669400/0xdf60171e5a5d342c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a41 expref: 37 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.400478:0:17062:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668000/0xdf60171e5a5d3433 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a41 expref: 36 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.400487:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afc835ce700) 00010000:00010000:0.0:1788835268.400490:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1788835268.400494:0:17062:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd81668000, rc 0) 00000100:00100000:0.0:1788835268.400652:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83efea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+36:15610:x1875729242528384:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 527us (10214us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835268.400668:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 59 00000100:00100000:3.0:1788835268.415188:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835268.417029:0:19538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242528512 00000100:00100000:2.0:1788835268.417046:0:19538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242528512 00000100:00100000:2.0:1788835268.417132:0:19538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:2.0:1788835268.417142:0:19538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:509130d2-ab52-48a7-b813-2f954b790e9f+6:2385:x1875729242528512:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1788835268.417166:0:19538:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1788835268.417191:0:19538:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ead74886/0xdf60171e5a5d343a lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0a48 expref: -99 pid: 19538 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1788835268.417221:0:19538:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a9f75c5, blocks: 0x0 00010000:00010000:2.0:1788835268.417247:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=510s v=(0 0) 00010000:00010000:2.0:1788835268.417252:0:19538:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1788835268.417264:0:19538:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ead74886/0xdf60171e5a5d343a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a48 expref: 7 pid: 19538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.417287:0:19538:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ead74886/0xdf60171e5a5d343a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a48 expref: 7 pid: 19538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.417348:0:19538:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afd866f4400, rc 0) 00000100:00100000:2.0:1788835268.417425:0:19538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83f39f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:509130d2-ab52-48a7-b813-2f954b790e9f+7:2385:x1875729242528512:12345-192.168.203.22@tcp:101:lhsmtool_posix.0 Request processed in 283us (2244us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835268.417433:0:19538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:3.0:1788835268.429544:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835268.429689:0:19148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242528768 00000100:00100000:1.0:1788835268.429701:0:19148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242528768 00000100:00100000:1.0:1788835268.429808:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:1.0:1788835268.429822:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+36:15610:x1875729242528768:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1788835268.429982:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+36:15610:x1875729242528768:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 163us (453us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835268.429991:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:3.0:1788835268.438811:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835268.439009:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242528896 00000100:00100000:2.0:1788835268.439022:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242528896 00000100:00100000:2.0:1788835268.439099:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:2.0:1788835268.439111:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+36:15610:x1875729242528896:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1788835268.444270:0:17040:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:0.0:1788835268.444295:0:17040:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000001:00080000:0.0:1788835268.444395:0:17040:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00010000:00010000:2.0:1788835268.444586:0:3600:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d32c7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.444602:0:3600:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d32c7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.444610:0:3600:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d32c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.444618:0:3600:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5400 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:2.0:1788835268.444624:0:3600:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d32c7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.444633:0:3600:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d32c7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.444655:0:3600:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9afd84cf1b00) 00010000:00010000:2.0:1788835268.444658:0:3600:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1788835268.444665:0:3600:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d32c7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.444691:0:3600:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d32c7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835268.444922:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaa9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+19:15610:x1875729242528896:12345-192.168.203.22@tcp:44:lhsmtool_posix.0 Request processed in 5805us (6117us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835268.444942:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:0.0:1788835268.446600:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254131840:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1788835268.446677:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835268.450543:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254131840 00000100:00100000:3.0:1788835268.450565:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254131840 00000100:00100000:3.0:1788835268.450682:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1788835268.450695:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254131840:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:3.0:1788835268.451078:0:19151:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1788835268.451083:0:19151:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1788835268.451085:0:19151:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1788835268.451087:0:19151:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788835269 -> 1788835269 00002000:00010000:3.0:1788835268.451090:0:19151:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:3.0:1788835268.451197:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3616:x1875729254131840:12345-0@lo:2:osp-syn-0-0.0 Request processed in 504us (4519us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1788835268.451206:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000004:00080000:3.0:1788835268.451281:0:3616:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9afdba36f800/2, rc 0, transno 8589934596 00000100:00100000:3.0:1788835268.451289:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254131840:0@lo:2:osp-syn-0-0.0 00000100:00080000:0.0:1788835268.452219:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1788835268.452488:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3273 lrc: 3/0,1 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452504:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3273 lrc: 2/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452512:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3273 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452519:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc2166000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835268.452524:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3273 lrc: 3/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452533:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3273 lrc: 4/0,0 mode: TXN/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452555:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9afd84cf1500) 00010000:00010000:1.0:1788835268.452558:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835268.452563:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3273 lrc: 2/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452571:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166000/0xdf60171e5a5d3273 lrc: 0/0,0 mode: --/TXN res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452598:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d327a lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452622:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d327a lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452628:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d327a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452635:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc2166c00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835268.452638:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d327a lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452644:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d327a lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452654:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9afd84cf1b00) 00010000:00010000:1.0:1788835268.452656:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835268.452659:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d327a lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452664:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2166c00/0xdf60171e5a5d327a lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452680:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d3322 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452686:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d3322 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452691:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d3322 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452696:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f4800 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835268.452705:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d3322 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452712:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d3322 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452721:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9afdb2e5e500) 00010000:00010000:1.0:1788835268.452724:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835268.452726:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d3322 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452732:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f4800/0xdf60171e5a5d3322 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452752:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d33a7 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452758:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d33a7 lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452765:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d33a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452770:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdb2e60200 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835268.452773:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d33a7 lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452778:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d33a7 lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.452855:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:1.0:1788835268.452858:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1788835268.452867:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d33a7 lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.453272:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60200/0xdf60171e5a5d33a7 lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 17061 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.453294:0:3601:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d341e lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.453301:0:3601:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d341e lrc: 2/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.453308:0:3601:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d341e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.453321:0:3601:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:1.0:1788835268.453325:0:3601:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d341e lrc: 3/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.453405:0:3601:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d341e lrc: 4/0,0 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.453420:0:3601:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afc835ce700) 00010000:00010000:1.0:1788835268.453422:0:3601:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1788835268.453426:0:3601:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d341e lrc: 2/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.453539:0:3601:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5600/0xdf60171e5a5d341e lrc: 0/0,0 mode: --/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835268.455022:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835268.455138:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242529024 00000100:00100000:1.0:1788835268.455150:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242529024 00000100:00100000:1.0:1788835268.455230:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:1.0:1788835268.455264:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdc1f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:509130d2-ab52-48a7-b813-2f954b790e9f+7:2386:x1875729242529024:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1788835268.455721:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdc1f25050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:509130d2-ab52-48a7-b813-2f954b790e9f+7:2386:x1875729242529024:12345-192.168.203.22@tcp:16:lhsmtool_posix.0 Request processed in 458us (708us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835268.455731:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:3.0:1788835268.469760:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835268.469874:0:19148:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242529280 00000100:00100000:1.0:1788835268.469896:0:19148:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242529280 00000100:00100000:1.0:1788835268.469984:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:1.0:1788835268.469997:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+15:15610:x1875729242529280:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1788835268.470067:0:19148:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1788835268.470104:0:19148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668000/0xdf60171e5a5d3433 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a41 expref: 15 pid: 17062 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.470130:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afc835ce700) 00010000:00010000:1.0:1788835268.470138:0:19148:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1788835268.470280:0:19148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669a00/0xdf60171e5a5d3441 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.470298:0:19148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669a00/0xdf60171e5a5d3441 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.470310:0:19148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669a00/0xdf60171e5a5d3441 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1788835268.470510:0:19148:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007c9bbf9e reply state 000000008c89581f transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669a00/0xdf60171e5a5d3441 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.470523:0:19148:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81669a00/0xdf60171e5a5d3441 lrc: 3/0,1 mode: TXN/TXN res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 19148 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.470531:0:19148:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afc835ce700) 00010000:00010000:0.0:1788835268.470534:0:19148:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00000100:00100000:0.0:1788835268.470537:0:19148:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1788835268.470660:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+16:15610:x1875729242529280:12345-192.168.203.22@tcp:36:lhsmtool_posix.0 Request processed in 665us (916us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1788835268.470668:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:1.0:1788835268.476395:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835268.476545:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242529408 00000100:00100000:0.0:1788835268.476576:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242529408 00000100:00100000:0.0:1788835268.476649:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:0.0:1788835268.476661:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:509130d2-ab52-48a7-b813-2f954b790e9f+7:2385:x1875729242529408:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1788835268.476865:0:18568:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1788835268.476870:0:18568:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 0 -> 1788835268 00002000:00010000:0.0:1788835268.476873:0:18568:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb atime from disk: 0 -> 1788835268 00002000:00010000:0.0:1788835268.476876:0:18568:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788835269 -> 1788835268 00002000:00010000:0.0:1788835268.476878:0:18568:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 0 00000100:00100000:0.0:1788835268.476980:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:509130d2-ab52-48a7-b813-2f954b790e9f+8:2385:x1875729242529408:12345-192.168.203.22@tcp:2:lhsmtool_posix.0 Request processed in 321us (668us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1788835268.476988:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:3.0:1788835268.482780:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835268.483040:0:18569:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242529536 00000100:00100000:0.0:1788835268.483053:0:18569:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242529536 00000100:00100000:0.0:1788835268.483124:0:18569:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:0.0:1788835268.483136:0:18569:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:509130d2-ab52-48a7-b813-2f954b790e9f+8:2385:x1875729242529536:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1788835268.483194:0:18569:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000076d8e01f/0xdf60171e5a5d3448 lrc: 3/1,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.483217:0:18569:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835268.483224:0:18569:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835268.483231:0:18569:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076d8e01f/0xdf60171e5a5d3448 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.483248:0:18569:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076d8e01f/0xdf60171e5a5d3448 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.483282:0:18569:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000076d8e01f/0xdf60171e5a5d3448 lrc: 3/1,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.483308:0:18569:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076d8e01f/0xdf60171e5a5d3448 lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.483446:0:18569:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076d8e01f/0xdf60171e5a5d3448 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.483456:0:18569:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd81668c00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835268.483462:0:18569:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076d8e01f/0xdf60171e5a5d3448 lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.483474:0:18569:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076d8e01f/0xdf60171e5a5d3448 lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.483495:0:18569:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076d8e01f/0xdf60171e5a5d3448 lrc: 2/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.483505:0:18569:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076d8e01f/0xdf60171e5a5d3448 lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18569 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835268.483613:0:18569:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:509130d2-ab52-48a7-b813-2f954b790e9f+8:2385:x1875729242529536:12345-192.168.203.22@tcp:1:lhsmtool_posix.0 Request processed in 478us (848us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835268.483623:0:18569:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 25 00000100:00100000:3.0:1788835268.506903:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835268.507361:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242529792 00000100:00100000:0.0:1788835268.507375:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242529792 00000100:00100000:0.0:1788835268.507457:0:17062:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:0.0:1788835268.507488:0:17062:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+16:15610:x1875729242529792:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1788835268.507601:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d344f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.507623:0:17062:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d33a0 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a10 expref: 16 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.507634:0:17062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d344f lrc: 4/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.507678:0:17062:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d33a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a10 expref: 16 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.507694:0:17062:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d33a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a10 expref: 16 pid: 19148 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835268.507712:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17062:1875729254131968:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788835268.507831:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afdb2e0e540 going to sleep for 11 seconds 00000100:00100000:0.0:1788835268.515962:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17062:1875729254131968:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788835268.516017:0:17062:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d344f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835268.517918:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835268.518643:0:18215:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242529920 00000100:00100000:0.0:1788835268.518658:0:18215:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242529920 00010000:00010000:0.0:1788835268.518716:0:18215:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d33a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a10 expref: 17 pid: 19148 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835268.518771:0:18215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:0.0:1788835268.518813:0:18215:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:509130d2-ab52-48a7-b813-2f954b790e9f+17:2385:x1875729242529920:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1788835268.518832:0:18215:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1788835268.518840:0:18215:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d33a0 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a10 expref: 17 pid: 19148 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.518854:0:18215:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d33a0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a10 expref: 17 pid: 19148 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.518893:0:18215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdb2e60800/0xdf60171e5a5d33a0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 7 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a10 expref: 17 pid: 19148 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.518914:0:18215:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:0.0:1788835268.518920:0:18215:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d33bc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a1e expref: 16 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.518943:0:18215:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 5 ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d344f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.518953:0:18215:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d344f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.518961:0:18215:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d344f lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 6 type: IBT flags: 0x40290000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.519010:0:18215:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788835268.519440:0:17062:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d344f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.519451:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d344f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.519718:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d3456 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.519733:0:17062:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d3425 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a3a expref: 17 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.519744:0:17062:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d3456 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.519790:0:17062:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d3425 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a3a expref: 17 pid: 17061 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.519806:0:17062:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d3425 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a3a expref: 17 pid: 17061 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835268.519822:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17062:1875729254132096:192.168.203.22@tcp:104: 00000100:00100000:0.0:1788835268.519984:0:18215:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:509130d2-ab52-48a7-b813-2f954b790e9f+17:2385:x1875729242529920:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 1170us (2076us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835268.520004:0:18215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 19 00000100:00100000:1.0:1788835268.521256:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc823ccd80 going to sleep for 11 seconds 00000100:00100000:1.0:1788835268.525914:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835268.526223:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17062:1875729254132096:192.168.203.22@tcp:104: 00010000:00010000:0.0:1788835268.526292:0:17062:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d3456 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835268.526506:0:17046:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242530048 00000100:00100000:2.0:1788835268.526516:0:17046:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242530048 00010000:00010000:2.0:1788835268.526565:0:17046:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d3425 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a3a expref: 17 pid: 17061 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1788835268.526612:0:17046:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 20 00000100:00100000:2.0:1788835268.526623:0:17046:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:509130d2-ab52-48a7-b813-2f954b790e9f+17:2385:x1875729242530048:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1788835268.526641:0:17046:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1788835268.526649:0:17046:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d3425 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a3a expref: 17 pid: 17061 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.526663:0:17046:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d3425 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a3a expref: 17 pid: 17061 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.526691:0:17046:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321800/0xdf60171e5a5d3425 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a3a expref: 17 pid: 17061 timeout: 610 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.526710:0:17046:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afc835ce700) 00010000:00010000:2.0:1788835268.526716:0:17046:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d3456 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.526739:0:17046:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d3456 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.526748:0:17046:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d3456 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.526788:0:17046:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1788835268.526855:0:17046:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:509130d2-ab52-48a7-b813-2f954b790e9f+16:2385:x1875729242530048:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 232us (956us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835268.526863:0:17046:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 20 00010000:00010000:1.0:1788835268.527761:0:17062:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d3456 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.527777:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d3456 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1788835268.527965:0:17062:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:1.0:1788835268.528134:0:17062:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:1.0:1788835268.528179:0:17062:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:1.0:1788835268.529428:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17062:1875729254132224:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788835268.529523:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835268.529573:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc823cc600 going to sleep for 11 seconds 00000100:00100000:2.0:1788835268.530179:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254132224 00000100:00100000:2.0:1788835268.530190:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254132224 00000100:00100000:2.0:1788835268.530265:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1788835268.530277:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17062:x1875729254132224:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1788835268.530551:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:17062:x1875729254132224:12345-0@lo:1000:mdt00_002.0 Request processed in 275us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835268.530559:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1788835268.531063:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17062:1875729254132224:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1788835268.531494:0:17062:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:1.0:1788835268.531603:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17062:1875729254132352:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1788835268.531689:0:17062:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835268.531726:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc823cc6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1788835268.531828:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254132352 00000100:00100000:0.0:1788835268.531836:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254132352 00000100:00100000:0.0:1788835268.531900:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1788835268.531910:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+6:17062:x1875729254132352:12345-0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1788835268.532096:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90f9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:17062:x1875729254132352:12345-0@lo:1000:mdt00_002.0 Request processed in 187us (406us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1788835268.532104:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1788835268.532271:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:17062:1875729254132352:0@lo:1000:mdt00_002.0 00010000:00010000:3.0:1788835268.532364:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d3456 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.532375:0:17062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d3456 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.532383:0:17062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d3456 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.532405:0:17062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdaf321a00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835268.532411:0:17062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d3456 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.532419:0:17062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d3456 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.532439:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afc835ce700) 00010000:00010000:3.0:1788835268.532443:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788835268.532448:0:17062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d3456 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.532455:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdaf321a00/0xdf60171e5a5d3456 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.532494:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d33b5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.532501:0:17062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d33b5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.532507:0:17062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d33b5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.532513:0:17062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204b000 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835268.532516:0:17062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d33b5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.532522:0:17062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d33b5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.532541:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:3.0:1788835268.532543:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1788835268.532552:0:17062:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d33bc lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a1e expref: 19 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.532566:0:17062:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d33bc lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a1e expref: 19 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.532577:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d33bc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a1e expref: 19 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.532637:0:17062:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc2167e00/0xdf60171e5a5d33bc lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a1e expref: 19 pid: 19148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835268.532651:0:17062:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17062:1875729254132480:192.168.203.22@tcp:105: 00000100:00100000:3.0:1788835268.532731:0:17062:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afd81254a80 going to sleep for 11 seconds 00000100:00100000:3.0:1788835268.536189:0:17062:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:17062:1875729254132480:192.168.203.22@tcp:105: 00010000:00010000:3.0:1788835268.536227:0:17062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d33b5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.536239:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b000/0xdf60171e5a5d33b5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.536278:0:17062:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d345d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.536295:0:17062:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d345d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.539712:0:17062:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d345d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.539733:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d345d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.539741:0:17062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d345d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.539749:0:17062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d345d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.539757:0:17062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdc204a600 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835268.539762:0:17062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d345d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.539770:0:17062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d345d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.539802:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:3.0:1788835268.539806:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1788835268.539812:0:17062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d345d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.539819:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a600/0xdf60171e5a5d345d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.539841:0:17062:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d344f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.539848:0:17062:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d344f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.539891:0:17062:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d344f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.539897:0:17062:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd81668c00 already unused, calling callback (ffffffffc1aaf4f0) 00010000:00010000:3.0:1788835268.539900:0:17062:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d344f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.539907:0:17062:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d344f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.539917:0:17062:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:3.0:1788835268.539920:0:17062:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788835268.539923:0:17062:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d344f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.539940:0:17062:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd81668c00/0xdf60171e5a5d344f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 17062 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1788835268.540568:0:17095:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788835268.540579:0:17095:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788835268.540607:0:17095:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788835268.540615:0:17095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1788835268.540763:0:17062:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:509130d2-ab52-48a7-b813-2f954b790e9f+19:15610:x1875729242529792:12345-192.168.203.22@tcp:57:lhsmtool_posix.0 Request processed in 33269us (33877us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1788835268.540777:0:17062:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00000020:00080000:3.0:1788835268.540785:0:17062:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1788835268.540906:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835268.543799:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242530176 00000100:00100000:3.0:1788835268.543819:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242530176 00000100:00100000:3.0:1788835268.543921:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:3.0:1788835268.543945:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83d16050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:509130d2-ab52-48a7-b813-2f954b790e9f+19:15609:x1875729242530176:12345-192.168.203.22@tcp:49:dd.0 00000100:00100000:3.0:1788835268.544170:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83d16050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:509130d2-ab52-48a7-b813-2f954b790e9f+19:15609:x1875729242530176:12345-192.168.203.22@tcp:49:dd.0 Request processed in 228us (3263us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835268.544199:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 10 00000100:00100000:1.0:1788835268.546134:0:3608:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835268.549570:0:17064:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242530432 00000100:00100000:2.0:1788835268.549591:0:17064:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242530432 00000100:00100000:2.0:1788835268.549679:0:17064:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 11 00000100:00100000:2.0:1788835268.549691:0:17064:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdb90fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:509130d2-ab52-48a7-b813-2f954b790e9f+19:15610:x1875729242530432:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1788835268.550483:0:17064:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1788835268.550528:0:17064:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1788835268.550578:0:17064:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d3464 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.550599:0:17064:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d3464 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010080000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.550634:0:17064:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d3464 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.550644:0:17064:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d3464 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010080000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.550651:0:17064:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d3464 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.550658:0:17064:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d3464 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x50010480000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1788835268.550729:0:17064:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1788835268.550963:0:17064:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdb90fb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:509130d2-ab52-48a7-b813-2f954b790e9f+21:15610:x1875729242530432:12345-192.168.203.22@tcp:35:lhsmtool_posix.0 Request processed in 1270us (4838us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1788835268.550974:0:17064:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 11 00000020:00080000:2.0:1788835268.550981:0:17064:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1788835268.551689:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835268.551730:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242530560 00000100:00100000:3.0:1788835268.551740:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242530560 00000100:00100000:3.0:1788835268.551794:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 64 00000100:00100000:3.0:1788835268.551804:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:509130d2-ab52-48a7-b813-2f954b790e9f+21:15609:x1875729242530560:12345-192.168.203.22@tcp:101:dd.0 00010000:00010000:3.0:1788835268.551825:0:17060:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1788835268.551844:0:17060:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d346b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xc82ff77cbdae0a4f expref: -99 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.551896:0:17060:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d3472 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.551909:0:17060:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d3472 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.551920:0:17060:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d3472 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 17060 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.552252:0:17060:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204a200/0xdf60171e5a5d346b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a4f expref: 23 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.552275:0:17060:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9afdc204b800/0xdf60171e5a5d3472 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a4f expref: 22 pid: 17060 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.552284:0:17060:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9afdb2e5eb00) 00010000:00010000:3.0:1788835268.552287:0:17060:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1788835268.552292:0:17060:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9afdc204b800, rc 0) 00000100:00100000:3.0:1788835268.552538:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:509130d2-ab52-48a7-b813-2f954b790e9f+22:15609:x1875729242530560:12345-192.168.203.22@tcp:101:dd.0 Request processed in 733us (852us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835268.552547:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 64 00010000:00010000:0.0:1788835268.559469:0:17049:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1788835268.559490:0:17049:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d3464 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.559504:0:17049:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd866f5400 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835268.559510:0:17049:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d3464 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40010480000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.559522:0:17049:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d3464 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x40018480000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.559547:0:17049:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9afc835ce700) 00010000:00010000:0.0:1788835268.559551:0:17049:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1788835268.559556:0:17049:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d3464 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.559562:0:17049:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9afd866f5400/0xdf60171e5a5d3464 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 17064 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.559588:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835268.559615:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1788835268.559617:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1788835268.761013:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835268.761149:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835268.769227:0:18572:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242530688 00000100:00100000:3.0:1788835268.769229:0:18573:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242530816 00000100:00100000:1.0:1788835268.769250:0:18572:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242530688 00000100:00100000:3.0:1788835268.769251:0:18573:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242530816 00000100:00100000:1.0:1788835268.769523:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:1.0:1788835268.769540:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:509130d2-ab52-48a7-b813-2f954b790e9f+9:2385:x1875729242530688:12345-192.168.203.22@tcp:4:dd.0 00010000:00010000:1.0:1788835268.769589:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad38bced/0xdf60171e5a5d3479 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.769614:0:18572:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ead74886/0xdf60171e5a5d343a lrc: 2/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a48 expref: 9 pid: 19538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.769624:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835268.769629:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1788835268.769634:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad38bced/0xdf60171e5a5d3479 lrc: 4/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.769683:0:18572:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ead74886/0xdf60171e5a5d343a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a48 expref: 9 pid: 19538 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.769707:0:18572:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ead74886/0xdf60171e5a5d343a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a48 expref: 9 pid: 19538 timeout: 610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1788835268.769727:0:18572:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:18572:1875729254132608:192.168.203.22@tcp:104: 00000100:00100000:1.0:1788835268.769881:0:18572:0:(client.c:2715:ptlrpc_set_wait()) set ffff9afc823ccb40 going to sleep for 11 seconds 00010000:00010000:3.0:1788835268.780518:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835268.780756:0:18572:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fa680 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0000_UUID:18572:1875729254132608:192.168.203.22@tcp:104: 00010000:00010000:3.0:1788835268.780785:0:18572:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ad38bced/0xdf60171e5a5d3479 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835268.782597:0:3609:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835268.783128:0:17045:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242530944 00000100:00100000:3.0:1788835268.783142:0:17045:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242530944 00010000:00010000:3.0:1788835268.783188:0:17045:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ead74886/0xdf60171e5a5d343a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a48 expref: 10 pid: 19538 timeout: 610 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1788835268.783229:0:17045:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:3.0:1788835268.783238:0:17045:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:509130d2-ab52-48a7-b813-2f954b790e9f+10:2386:x1875729242530944:12345-192.168.203.22@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1788835268.783254:0:17045:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1788835268.783274:0:17045:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ead74886/0xdf60171e5a5d343a lrc: 4/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a48 expref: 10 pid: 19538 timeout: 610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.783288:0:17045:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ead74886/0xdf60171e5a5d343a lrc: 3/0,0 mode: PR/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a48 expref: 10 pid: 19538 timeout: 610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.783311:0:17045:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ead74886/0xdf60171e5a5d343a lrc: 0/0,0 mode: --/PR res: [0x280000401:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.22@tcp remote: 0xc82ff77cbdae0a48 expref: 10 pid: 19538 timeout: 610 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.783399:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835268.783403:0:17045:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1788835268.783409:0:17045:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ad38bced/0xdf60171e5a5d3479 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.783419:0:17045:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ad38bced/0xdf60171e5a5d3479 lrc: 4/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 3 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1788835268.783455:0:17045:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1788835268.783492:0:18572:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ad38bced/0xdf60171e5a5d3479 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1788835268.783508:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ad38bced/0xdf60171e5a5d3479 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835268.783653:0:17045:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:509130d2-ab52-48a7-b813-2f954b790e9f+9:2386:x1875729242530944:12345-192.168.203.22@tcp:103:ldlm_bl.0 Request processed in 404us (1058us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835268.783664:0:17045:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000001:00080000:3.0:1788835268.899646:0:18563:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934599 is committed 00000001:00080000:3.0:1788835268.899668:0:18563:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934598 is committed 00002000:00010000:0.0:1788835268.901201:0:18572:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:0.0:1788835268.901211:0:18572:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb mtime from disk: 1788835268 -> 1788835269 00002000:00010000:0.0:1788835268.901214:0:18572:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb ctime from disk: 1788835268 -> 1788835269 00002000:00010000:0.0:1788835268.901217:0:18572:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 0 -> 8192 00010000:00010000:0.0:1788835268.901240:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ad38bced/0xdf60171e5a5d3479 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.901254:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ad38bced/0xdf60171e5a5d3479 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.901265:0:18572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ad38bced/0xdf60171e5a5d3479 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.901273:0:18572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afdaf321c00 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835268.901278:0:18572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad38bced/0xdf60171e5a5d3479 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.901289:0:18572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ad38bced/0xdf60171e5a5d3479 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.901396:0:18572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ad38bced/0xdf60171e5a5d3479 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.901405:0:18572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ad38bced/0xdf60171e5a5d3479 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->4194303] (req 0->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835268.901540:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:509130d2-ab52-48a7-b813-2f954b790e9f+6:2385:x1875729242530688:12345-192.168.203.22@tcp:4:dd.0 Request processed in 131999us (140532us total) trans 8589934599 rc 0/0 00000100:00100000:0.0:1788835268.901551:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 0 00000100:00100000:0.0:1788835268.901610:0:18572:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:0.0:1788835268.901624:0:18572:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbf9b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:509130d2-ab52-48a7-b813-2f954b790e9f+5:2385:x1875729242530816:12345-192.168.203.22@tcp:4:dd.0 00002000:00010000:0.0:1788835268.903045:0:18572:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000401:0x22:0x0] initial LVB size: 4194304, mtime: 0x6a9f75c5, atime: 0x6a9f75c4, ctime: 0x6a9f75c5, blocks: 0x2000 00010000:00010000:0.0:1788835268.903066:0:18572:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095cd8689/0xdf60171e5a5d3480 lrc: 3/0,1 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.903085:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=510s v=(0 0) 00010000:00010000:0.0:1788835268.903090:0:18572:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000401:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1788835268.903097:0:18572:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095cd8689/0xdf60171e5a5d3480 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.903113:0:18572:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095cd8689/0xdf60171e5a5d3480 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1788835268.968081:0:18563:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934600 is committed 00002000:00010000:0.0:1788835268.968270:0:18572:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:0.0:1788835268.968277:0:18572:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000401:0x22:0x0] updating lvb blocks from disk: 8192 -> 14952 00010000:00010000:0.0:1788835268.968854:0:18572:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095cd8689/0xdf60171e5a5d3480 lrc: 3/0,1 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.968883:0:18572:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095cd8689/0xdf60171e5a5d3480 lrc: 2/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.968893:0:18572:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095cd8689/0xdf60171e5a5d3480 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.968901:0:18572:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9afd81668800 already unused, calling callback (ffffffffc0eae350) 00010000:00010000:0.0:1788835268.968907:0:18572:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095cd8689/0xdf60171e5a5d3480 lrc: 3/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.968917:0:18572:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095cd8689/0xdf60171e5a5d3480 lrc: 4/0,0 mode: PW/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.968959:0:18572:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095cd8689/0xdf60171e5a5d3480 lrc: 2/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1788835268.968967:0:18572:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095cd8689/0xdf60171e5a5d3480 lrc: 0/0,0 mode: --/PW res: [0x280000401:0x22:0x0].0x0 rrc: 2 type: EXT [4194304->7655423] (req 4194304->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 18572 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1788835268.969186:0:18572:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbf9b5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:509130d2-ab52-48a7-b813-2f954b790e9f+5:2385:x1875729242530816:12345-192.168.203.22@tcp:4:dd.0 Request processed in 67560us (208031us total) trans 8589934600 rc 0/0 00000100:00100000:0.0:1788835268.969198:0:18572:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 1 00000100:00100000:2.0:1788835269.413829:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254132736:0@lo:41:osp-pre-0-1.0 00000100:00100000:2.0:1788835269.413937:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835269.414908:0:17801:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254132736 00000100:00100000:0.0:1788835269.414930:0:17801:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254132736 00000100:00100000:0.0:1788835269.415044:0:17801:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1788835269.415055:0:17801:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254132736:12345-0@lo:41:osp-pre-0-1.0 00000004:00000024:0.0:1788835269.415110:0:17801:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446293504 avail 1300054016 00000100:00100000:3.0:1788835269.415232:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254132864:0@lo:41:osp-pre-1-0.0 00000100:00100000:3.0:1788835269.415274:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835269.415379:0:17066:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254132864 00000100:00100000:3.0:1788835269.415384:0:17066:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254132864 00000100:00100000:3.0:1788835269.415407:0:17066:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1788835269.415413:0:17066:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254132864:12345-0@lo:41:osp-pre-1-0.0 00000004:00000024:3.0:1788835269.415433:0:17066:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 4292608 pending 0 free 1446461440 avail 1300221952 00000100:00100000:3.0:1788835269.416619:0:17066:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254132864:12345-0@lo:41:osp-pre-1-0.0 Request processed in 1198us (1337us total) trans 0 rc 0/0 00000100:00100000:3.0:1788835269.416634:0:17066:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1788835269.416792:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254132864:0@lo:41:osp-pre-1-0.0 00000100:00100000:0.0:1788835269.422670:0:17801:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254132736:12345-0@lo:41:osp-pre-0-1.0 Request processed in 7602us (8719us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835269.422691:0:17801:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1788835269.422816:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254132736:0@lo:41:osp-pre-0-1.0 00010000:00010000:3.0:1788835269.797863:0:19542:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1788835270.444016:0:20240:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:0.0:1788835270.822677:0:17049:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1788835271.262000:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835271.262057:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835271.262098:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835271.262120:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835271.262141:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:0.0:1788835271.262263:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242531328 00000100:00100000:0.0:1788835271.262273:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242531328 00000100:00100000:1.0:1788835271.262470:0:17054:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242531072 00000100:00100000:1.0:1788835271.262475:0:17054:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242531072 00000100:00100000:1.0:1788835271.262510:0:17054:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 166 00000100:00100000:1.0:1788835271.262520:0:17054:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:2386:x1875729242531072:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835271.262585:0:17054:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaafc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:30278e9d-0337-40e4-817b-5d5e80a2a1f2+13:2386:x1875729242531072:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 67us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835271.262593:0:17054:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 166 00000100:00100000:0.0:1788835271.262944:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242531840 00000100:00100000:0.0:1788835271.262949:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242531840 00000100:00100000:0.0:1788835271.262975:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:0.0:1788835271.262982:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+5:2386:x1875729242531328:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835271.263018:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:509130d2-ab52-48a7-b813-2f954b790e9f+5:2386:x1875729242531328:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 36us (961us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835271.263025:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 60 00000100:00100000:0.0:1788835271.263039:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00100000:0.0:1788835271.263045:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:2386:x1875729242531840:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835271.263070:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:2386:x1875729242531840:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 26us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835271.263076:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 61 00000100:00080000:0.0:1788835271.263093:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788835271.265226:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835271.265699:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242531584 00000100:00100000:1.0:1788835271.265708:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242531584 00000100:00100000:1.0:1788835271.265800:0:18567:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242532096 00000100:00100000:1.0:1788835271.265804:0:18567:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242532096 00000100:00100000:1.0:1788835271.265832:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:1.0:1788835271.265841:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:509130d2-ab52-48a7-b813-2f954b790e9f+5:2386:x1875729242531584:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835271.265930:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:509130d2-ab52-48a7-b813-2f954b790e9f+5:2386:x1875729242531584:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 90us (3831us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835271.265938:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 21 00000100:00100000:1.0:1788835271.265954:0:18567:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00100000:1.0:1788835271.265962:0:18567:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:2386:x1875729242532096:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835271.266001:0:18567:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:2386:x1875729242532096:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 40us (3859us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835271.266008:0:18567:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 22 00000100:00080000:1.0:1788835271.266105:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1788835271.268372:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:3.0:1788835271.268409:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:1.0:1788835271.268506:0:19538:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242531456 00000100:00100000:1.0:1788835271.268513:0:19538:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242531456 00000100:00100000:1.0:1788835271.268559:0:19538:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00100000:1.0:1788835271.268569:0:19538:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:509130d2-ab52-48a7-b813-2f954b790e9f+5:2386:x1875729242531456:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:1.0:1788835271.268626:0:19538:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:509130d2-ab52-48a7-b813-2f954b790e9f+5:2386:x1875729242531456:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 59us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835271.268634:0:19538:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 23 00000100:00080000:1.0:1788835271.268652:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1788835271.283714:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242531200 00000100:00100000:0.0:1788835271.283729:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242531200 00000100:00080000:0.0:1788835271.283776:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1788835271.283777:0:3607:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.22@tcp (source: 12345-192.168.203.22@tcp) 00000100:00100000:2.0:1788835271.283791:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242531712 00000100:00100000:1.0:1788835271.283875:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:1.0:1788835271.283887:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+22:2386:x1875729242531200:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:2.0:1788835271.283894:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242531712 00000100:00100000:0.0:1788835271.283917:0:18568:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729242531968 00000100:00100000:0.0:1788835271.283922:0:18568:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729242531968 00000100:00100000:0.0:1788835271.283962:0:18568:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:0.0:1788835271.283973:0:18568:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:2386:x1875729242531968:12345-192.168.203.22@tcp:400:kworker.0 00000100:00100000:0.0:1788835271.284000:0:18568:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:29ff5b29-0bb6-41bb-a110-0090199a3fb2+5:2386:x1875729242531968:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 33us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835271.284006:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:0.0:1788835271.284008:0:18568:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 24 00000100:00100000:2.0:1788835271.284021:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:2386:x1875729242531712:12345-192.168.203.22@tcp:400:kworker.0 00000100:00080000:0.0:1788835271.284029:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1788835271.284032:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1788835271.284063:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:29ff5b29-0bb6-41bb-a110-0090199a3fb2+6:2386:x1875729242531712:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 46us (15652us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835271.284070:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 63 00000100:00100000:1.0:1788835271.285219:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:509130d2-ab52-48a7-b813-2f954b790e9f+22:2386:x1875729242531200:12345-192.168.203.22@tcp:400:kworker.0 Request processed in 85us (18751us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835271.285232:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.22@tcp, seq: 62 00000100:00100000:3.0:1788835271.461618:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdba36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254133120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1788835271.461702:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835271.461702:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254133376:0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.461747:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835271.461753:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254133632:0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.461777:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254133888:0@lo:400:kworker.0 00000100:00100000:3.0:1788835271.461803:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835271.461814:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835271.461840:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729254134144:0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.461844:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254134400:0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.461868:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835271.461886:0:3614:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 4 async RPCs [1->0] 00000100:00100000:1.0:1788835271.461922:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb888812-a79c-4531-9a69-89c757e37463:3614:1875729254132992:0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.461958:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835271.461959:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdb90fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254133248:0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.461995:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254133504:0@lo:400:kworker.0 00000100:00100000:2.0:1788835271.462001:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835271.462029:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254133760:0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.462033:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835271.462061:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254134016:0@lo:400:kworker.0 00000100:00100000:2.0:1788835271.462063:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1788835271.462090:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc845fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254134272:0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.462098:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835271.462123:0:3614:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc8310ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875729254134528:0@lo:400:kworker.0 00000100:00100000:2.0:1788835271.462136:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835271.462380:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254133632 00000100:00100000:0.0:1788835271.462387:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254133632 00000100:00100000:0.0:1788835271.462433:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254134400 00000100:00100000:0.0:1788835271.462436:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254134400 00000100:00100000:0.0:1788835271.462458:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254134272 00000100:00100000:0.0:1788835271.462461:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254134272 00000100:00100000:0.0:1788835271.462479:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788835271.462487:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254133632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.466000:0:3614:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835271.467095:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254133376 00000100:00100000:1.0:1788835271.467106:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254133376 00000100:00100000:1.0:1788835271.467172:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254133888 00000100:00100000:1.0:1788835271.467176:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254133888 00000100:00100000:1.0:1788835271.467192:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254133504 00000100:00100000:1.0:1788835271.467195:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254133504 00000100:00100000:1.0:1788835271.467208:0:19151:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254134016 00000100:00100000:1.0:1788835271.467210:0:19151:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254134016 00000100:00100000:1.0:1788835271.467228:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788835271.467237:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254133376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.467336:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83108a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254133376:12345-0@lo:400:kworker.0 Request processed in 99us (5588us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835271.467344:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788835271.467360:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788835271.467366:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254133888:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.467398:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254133888:12345-0@lo:400:kworker.0 Request processed in 32us (5584us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835271.467403:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788835271.467415:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788835271.467437:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254133504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.467471:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3614:x1875729254133504:12345-0@lo:400:kworker.0 Request processed in 35us (5442us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835271.467477:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1788835271.467488:0:19151:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788835271.467494:0:19151:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254134016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.467523:0:19151:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0001-mdtlov_UUID+5:3614:x1875729254134016:12345-0@lo:400:kworker.0 Request processed in 29us (5428us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835271.467529:0:19151:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1788835271.467553:0:17055:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254132992 00000100:00100000:1.0:1788835271.467557:0:17055:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254132992 00000100:00100000:1.0:1788835271.467597:0:17055:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1788835271.467604:0:17055:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfaaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+24:3614:x1875729254132992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835271.467803:0:3617:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afdbf9b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254134784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788835271.467823:0:17055:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfaaf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:cb888812-a79c-4531-9a69-89c757e37463+24:3614:x1875729254132992:12345-0@lo:400:kworker.0 Request processed in 217us (5864us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835271.467832:0:17055:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1788835271.467863:0:3617:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835271.467869:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254133248 00000100:00100000:1.0:1788835271.467874:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254133248 00000100:00100000:2.0:1788835271.467919:0:17060:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254134528 00000100:00100000:1.0:1788835271.467919:0:17065:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254133760 00000100:00100000:2.0:1788835271.467925:0:17060:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254134528 00000100:00100000:1.0:1788835271.467926:0:17065:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254133760 00000100:00100000:1.0:1788835271.467959:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788835271.467966:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1788835271.467968:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254133248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835271.467978:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdbfa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254134400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.468020:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:3617:x1875729254133248:12345-0@lo:400:kworker.0 Request processed in 54us (6021us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835271.468028:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1788835271.468032:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdbfa2ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0001-lwp-OST0000_UUID+5:3614:x1875729254134400:12345-0@lo:400:kworker.0 Request processed in 56us (6161us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835271.468043:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1788835271.468060:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788835271.468067:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254134272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.468086:0:17065:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1788835271.468096:0:17065:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254133760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1788835271.468100:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3617:x1875729254134272:12345-0@lo:400:kworker.0 Request processed in 33us (5964us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835271.468114:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1788835271.468146:0:17060:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788835271.468148:0:17065:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83ed3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254133760:12345-0@lo:400:kworker.0 Request processed in 51us (6083us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835271.468157:0:17060:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afd9e817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875729254134528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.468158:0:17065:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1788835271.468198:0:17060:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afd9e817b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3614:x1875729254134528:12345-0@lo:400:kworker.0 Request processed in 44us (2205us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835271.468204:0:17060:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1788835271.468240:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254133120 00000100:00100000:1.0:1788835271.468245:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254133120 00000100:00100000:2.0:1788835271.468248:0:3615:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1788835271.468261:0:3615:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afd9e817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254134912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788835271.468266:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254134784 00000100:00100000:1.0:1788835271.468271:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254134784 00000100:00100000:1.0:1788835271.468287:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1788835271.468297:0:3615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1788835271.468297:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254133120:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1788835271.468343:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:2.0:1788835271.468355:0:18570:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 2 min 2 max 16 00000100:00100000:2.0:1788835271.468365:0:18570:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_002' 00000100:00100000:1.0:1788835271.468384:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3616:x1875729254133120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 90us (6685us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835271.468391:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1788835271.468402:0:18571:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254134912 00000100:00100000:1.0:1788835271.468405:0:18571:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254134912 00000100:00100000:1.0:1788835271.468423:0:18571:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1788835271.468429:0:18571:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254134784:12345-0@lo:13:osp-pre-1-1.0 00002000:00000024:1.0:1788835271.468439:0:18571:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 17153728 pending 0 free 3923505152 avail 3691982848 00000100:00100000:1.0:1788835271.468464:0:18571:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0001-mdtlov_UUID+5:3617:x1875729254134784:12345-0@lo:13:osp-pre-1-1.0 Request processed in 36us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835271.468470:0:18571:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1788835271.468483:0:18570:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1788835271.468569:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90f9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:cb888812-a79c-4531-9a69-89c757e37463:3614:1875729254132992:0@lo:400:kworker.0 00000100:00100000:2.0:1788835271.468612:0:18570:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc8345ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254134912:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1788835271.468635:0:18570:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 4218880 granted 26324672 pending 0 free 3915857920 avail 3684335616 00000100:00100000:2.0:1788835271.468671:0:18570:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc8345ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3615:x1875729254134912:12345-0@lo:13:osp-pre-0-0.0 Request processed in 180us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1788835271.468678:0:18570:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1788835271.468703:0:3615:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934598 gen 2 00000004:00080000:2.0:1788835271.468709:0:3615:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9afdba36f800, transno 8589934596 00000004:00080000:2.0:1788835271.468721:0:3615:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934598 committed transno 8589934598 00000100:00100000:2.0:1788835271.468744:0:3615:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afd9e817100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3615:1875729254134912:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1788835271.468764:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254133504:0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.468779:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254134016:0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.468790:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc8310ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3614:1875729254134528:0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.468819:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9bad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3614:1875729254133376:0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.468831:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-mdtlov_UUID:3614:1875729254133888:0@lo:400:kworker.0 00010000:00080000:1.0:1788835271.468846:0:3614:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83109880 x1875729254134400/t0(0) o400->lustre-MDT0001-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1788835271.468856:0:3614:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0001-lwp-OST0000_UUID:3614:1875729254134400:0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.468901:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254134784:0@lo:13:osp-pre-1-1.0 00000100:00100000:1.0:1788835271.468925:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdb90fa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3617:1875729254133248:0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.468939:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0001-mdtlov_UUID:3617:1875729254133760:0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.468951:0:3617:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3617:1875729254134272:0@lo:400:kworker.0 00000100:00080000:2.0:1788835271.468985:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1788835271.468990:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1788835271.468994:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1788835271.468996:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:3.0:1788835271.469084:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1788835271.469200:0:3616:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9afc83109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254134656:0@lo:400:kworker.0 00000100:00100000:3.0:1788835271.469228:0:3616:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1788835271.470140:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3616:x1875729254133632:12345-0@lo:400:kworker.0 Request processed in 7650us (8334us total) trans 0 rc 0/0 00000100:00100000:0.0:1788835271.470151:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1788835271.473435:0:17061:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254134144 00000100:00100000:0.0:1788835271.473450:0:17061:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254134144 00000100:00100000:3.0:1788835271.473491:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdba36ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3616:1875729254133120:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1788835271.473517:0:17062:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1875729254134656 00000100:00100000:0.0:1788835271.473523:0:17062:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1875729254134656 00000100:00100000:3.0:1788835271.473539:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afdbf9b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3616:1875729254133632:0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.473762:0:19148:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788835271.473776:0:19148:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afdba36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729254134144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1788835271.473869:0:19148:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afdba36f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0001_UUID+5:3616:x1875729254134144:12345-0@lo:400:kworker.0 Request processed in 98us (4786us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835271.473877:0:19148:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1788835271.473928:0:17061:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1788835271.473937:0:17061:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9afc83743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254134656:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1788835271.473946:0:17056:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0001 00000100:00100000:1.0:1788835271.473975:0:17061:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9afc83743b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0001-lwp-OST0001_UUID+5:3616:x1875729254134656:12345-0@lo:400:kworker.0 Request processed in 40us (4746us total) trans 0 rc 0/0 00000100:00100000:1.0:1788835271.473982:0:17061:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1788835271.478804:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc845ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0001_UUID:3616:1875729254134144:0@lo:400:kworker.0 00010000:00080000:3.0:1788835271.478827:0:3616:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=46162) req@ffff9afc83109180 x1875729254134656/t0(0) o400->lustre-MDT0001-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1788835287 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1788835271.478838:0:3616:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9afc83109180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0001-lwp-OST0001_UUID:3616:1875729254134656:0@lo:400:kworker.0 00000040:00080000:1.0:1788835271.589642:0:17095:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1788835271.589651:0:17095:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1788835271.589671:0:17095:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1788835271.589692:0:17095:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1788835271.845462:0:17048:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 42036 lines, 42036 kept, 0 dropped, 0 bad.